Dignity – Tricking

The robot should not lie or trick the users into anthropomorphising its behaviour.

Tricking into anthropomorphising, within the value of dignity in human-robot interaction, concerns the risk that robots may mislead users, intentionally or not, into forming beliefs about the robot that are not grounded in reality. This is not limited to explicit deception. It also includes subtle forms of anthropomorphic design that encourage users to treat robots as if they have emotions, intentions, or social presence. The concern becomes particularly relevant when robots are deployed in care, education, or domestic environments, where users may be vulnerable or where long-term interaction can shape perceptions and expectations in meaningful ways.

Respecting dignity in this context means ensuring that users are not misled into inappropriate interpretations of a robot's capabilities or "inner life." A robot that simulates emotional responses, for instance, can create confusion about whether those responses are genuine, potentially leading to misplaced trust or emotional attachment. This issue is especially significant in populations for whom the artificial nature of the system may not be immediately obvious, or where cognitive or social vulnerability may reduce the ability to critically interpret the interaction. Design choices therefore directly influence whether interaction remains transparent or drifts into forms of unintended deception.

The literature consistently reflects this tension between useful engagement and problematic illusion. In educational settings, concerns arise that robots may provide incorrect information due to faulty human input, raising issues of trust and reliability. In assistive contexts, robots are sometimes considered for users who may gradually lose the ability to distinguish living from non-living entities, increasing the risk of misinterpretation. Across multiple studies, the idea of "pretend reciprocity" is explicitly questioned, with authors noting that apparent emotional responsiveness does not constitute genuine social relation

This issue becomes more pronounced in care and companionship scenarios. Some analyses argue that meaningful interaction may depend, at least in part, on users attributing emotional states to robots, effectively being "tricked" into social engagement. This raises ethical discomfort when, for example, people express affection toward robots that reciprocate with scripted responses, challenging expectations of authenticity. At the same time, systems like Paro demonstrate that users can derive real emotional comfort even when fully aware of the robot's artificial nature, suggesting a more complex boundary between illusion and acceptance.

Other perspectives highlight that this "delusion" may be context-dependent: for competent users, playful anthropomorphism may be harmless or even enjoyable, similar to projecting personality onto inanimate objects. However, in care contexts, especially with older adults or vulnerable populations, the same mechanisms can raise concerns about infantilisation, consent, and manipulation. Overall, the literature does not reject emotional engagement with robots outright, but it stresses the importance of carefully managing when and how such engagement becomes misleading rather than supportive.

Excerpts from the paper:

About the value "Dignity"

Dignity groups the topics relating to the respect owed to all humans and to the subject's self-image. Although it was not identified as an initial value during the scoping review, focus groups participants agreed that dignity should replace honour as a value, with agency considered separately.

About "Tricking"

Respecting the dignity of users involves ensuring that the robots do not deceive or trick them into anthropomorphising their behaviour, as pointed out by the focus groups participants. For example, a robot that pretends to have emotions might lead users to form attachments or expectations that are not appropriate, leading to confusion or emotional harm. This is especially true in those segments of the population for whom the artificial nature of the robot may not be immediately evident.

Papers related to this topic

  1. Smakman, M; Jansen, B; Leunen, J; Konijn, E; 2020. Acceptable Social Robots in Education: A Value Sensitive Parent Perspective
  2. Tijs Van demeulebroucke M.A.; Casterlé B.D.; Welbergen L.; Massart M.; Gastmans C.; 2020. The ethics of socially assistive robots in aged care. A focus group study with older adults in Flanders, Belgium
  3. Fiske A.; Henningsen P.; Buyx A.; 2019. Your robot therapist will see you now: Ethical implications of embodied artificial intelligence in psychiatry, psychology, and psychotherapy
  4. Battistuzzi L.; Sgorbissa A.; Papadopoulos C.; Papadopoulos I.; Koulouglioti C.; 2018. Embedding Ethics in the Design of Culturally Competent Socially Assistive Robots
  5. Cresswell K.; Cunningham-Burley S.; Sheikh A.; 2018. Health care robotics: Qualitative exploration of key challenges and future directions
  6. Misselhorn C.; Pompe U.; Stapleton M.; 2013. Ethical considerations regarding the use of social robots in the fourth age
  7. Sharkey A.; Sharkey N.; 2012. Granny and the robots: Ethical issues in robot care for the elderly
  8. Calo C.J.; Hunt-Bull N.; Lewis L.; Metzler T.; 2011. Ethical implications of using the Paro robot with a focus on dementia patient care
  9. Sharkey A.; Sharkey N.; 2010. Ethical issues in robot care for the elderly: Dystopia or optimism?