Welfare – Safety

The robot is safe and it does not harm the users.

Safety is one of the most immediate and widely recognised concerns in human-robot interaction. Unlike more abstract values, it tends to surface early in both design discussions and user expectations, because it connects directly to physical integrity and perceived risk. Whether robots are used in care settings, homes, or public environments, users tend to ask a simple question: can this system cause harm, or prevent it? This makes safety a baseline condition for acceptance, rather than an optional feature.

Safety in HRI is typically framed as the requirement that robots should not pose a risk of physical injury to users, including vulnerable populations such as older adults or children. This includes constraints on force, movement, and system behaviour, as well as design choices that reduce the likelihood of accidents. Beyond direct physical harm, safety also extends to the ability of robots to monitor environments and respond to dangerous situations in a way that supports wellbeing. For example, systems may be designed to detect falls, trigger alerts, or intervene in potentially hazardous scenarios. At the same time, this introduces a tension between intervention and user autonomy, particularly when safety measures involve surveillance or external notification.

As noted in the focus group findings, safety is not only about preventing immediate harm, but also about ensuring that robots can be used without creating new forms of vulnerability or discomfort, especially in everyday domestic contexts. This concern is strongly reflected in the literature, often in very concrete terms. Safety is described as the ability to avoid pain or harm, reinforcing its role as a fundamental requirement in companion systems. In care contexts, robots are envisioned as systems that can detect falls and trigger alarms to support timely intervention, or even anticipate dangerous situations and take preventive actions such as turning off appliances or restraining movement when necessary. These capabilities are also tied to broader notions of security and continuous monitoring, where robots contribute to perceived safety through constant presence and alert systems. In dementia care, safety is explicitly positioned as a primary ethical goal alongside wellbeing and harm prevention. Empirical studies with older adults similarly report that robots can increase both physical and psychological feelings of safety, for instance by monitoring users and notifying caregivers in case of emergencies.

At the same time, real-world deployments have also revealed the importance of robust engineering, as accidents such as entrapment or collisions have occurred in field settings. Finally, design guidelines often emphasise limiting physical force and ensuring smooth, predictable motion to minimise risk, especially when robots operate near children or other vulnerable users.

Excerpts from the paper:

About the value "Welfare"

Finally, the topics that cover the positive influence of interacting with a robot were grouped under the value of welfare as identified during the scoping review. These span from the mental to the physical welfare of the user. Notably, while we found prescriptive instructions about how the robot should be made safe, we did not find many topics expressed in negative terms. For this reason, there are no topics with negative valence for this value. This might suggest that the capabilities of social robots are not considered advanced enough to pose a risk in this sense. However, we anticipate this could change in the future. Focus groups participants emphasised that welfare is crucial, particularly regarding usage constraints, such as ensuring a robot is not used by a child at night.

About "Safety"

Safety is a fundamental concern in the design and use of robots, and this is not limited to interactions with vulnerable populations. Robots must be designed to be physically safe, meaning they should not pose any risk of injury to users, as also highlighted by our focus groups participants. This topic is present in previous literature with positive connotations, inviting us to reflect on this aspect during the design phase of a robot.

Papers related to this topic

  1. Prescott, TJ; Robillard, JM; 2021. Are friends electric? The benefits and risks of human-robot relationships
  2. Poulsen A.; Fosch-Villaronga E.; Burmeister O.K.; 2020. Cybersecurity, value sensing robots for LGBTIQ+ elderly, and the need for revised codes of conduct
  3. Tijs Van demeulebroucke M.A.; Casterlé B.D.; Welbergen L.; Massart M.; Gastmans C.; 2020. The ethics of socially assistive robots in aged care. A focus group study with older adults in Flanders, Belgium
  4. Cresswell K.; Cunningham-Burley S.; Sheikh A.; 2018. Health care robotics: Qualitative exploration of key challenges and future directions
  5. Čaić M.; Odekerken-Schröder G.; Mahr D.; 2018. Service robots: value co-creation and co-destruction in elderly care networks
  6. Ienca M.; Jotterand F.; Vică C.; Elger B.; 2016. Social and Assistive Robotics in Dementia Care: Ethical Recommendations for Research and Practice
  7. Fridin M.; 2014. Kindergarten social assistive robot: First meeting and ethical issues
  8. F. Amirabdollahian; R. op den Akker; S. Bedaf; R. Bormann; H. Draper; V. Evers; G. J. Gelderblom; C. G. Ruiz; D. Hewson; N. Hu; I. Iacono; K. L. Koay; B. Kröse; P. Marti; H. Michel; H. Prevot-Huille; U. Reiser; J. Saunders; T. Sorell; K. Dautenhahn; 2013. Accompany: Acceptable robotiCs COMPanions for AgeiNG Years — Multidimensional aspects of human-system interactions
  9. Amirabdollahian F.; Akker R.O.D.; Bedaf S.; Bormann R.; Draper H.; Evers V.; Pérez J.G.; Gelderblom G.J.; Ruiz C.G.; Hewson D.; Hu N.; Koay K.L.; Kröse B.; Lehmann H.; Mart P.; Michel H.; Prevot-Huille H.; Reiser U.; Saunders J.; Sorell T.; Stienstra J.; Syrdal D.; Walters M.; Dautenhahn K.; 2013. Assistive technology design and development for acceptable robotics companions for ageing years
  10. Sharkey A.; Sharkey N.; 2012. Granny and the robots: Ethical issues in robot care for the elderly