Header

UZH-Logo

Maintenance Infos

Who is controlling whom? Reframing “meaningful human control” of AI systems in security


Christen, Markus; Burri, Thomas; Kandul, Serhiy; Vörös, Pascal (2023). Who is controlling whom? Reframing “meaningful human control” of AI systems in security. Ethics and Information Technology, 25(1):10.

Abstract

Decisions in security contexts, including armed conflict, law enforcement, and disaster relief, often need to be taken under circumstances of limited information, stress, and time pressure. Since AI systems are capable of providing a certain amount of relief in such contexts, such systems will become increasingly important, be it as decision-support or decision-making systems. However, given that human life may be at stake in such situations, moral responsibility for such decisions should remain with humans. Hence the idea of “meaningful human control” of intelligent systems. In this opinion paper, we outline generic configurations of control of AI and we present an alternative to human control of AI, namely the inverse idea of having AI control humans, and we discuss the normative consequences of this alternative.

Abstract

Decisions in security contexts, including armed conflict, law enforcement, and disaster relief, often need to be taken under circumstances of limited information, stress, and time pressure. Since AI systems are capable of providing a certain amount of relief in such contexts, such systems will become increasingly important, be it as decision-support or decision-making systems. However, given that human life may be at stake in such situations, moral responsibility for such decisions should remain with humans. Hence the idea of “meaningful human control” of intelligent systems. In this opinion paper, we outline generic configurations of control of AI and we present an alternative to human control of AI, namely the inverse idea of having AI control humans, and we discuss the normative consequences of this alternative.

Statistics

Citations

Dimensions.ai Metrics
3 citations in Web of Science®
3 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

3 downloads since deposited on 09 Feb 2024
3 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:04 Faculty of Medicine > Institute of Biomedical Ethics and History of Medicine
08 Research Priority Programs > Digital Society Initiative
Dewey Decimal Classification:610 Medicine & health
Scopus Subject Areas:Physical Sciences > Computer Science Applications
Social Sciences & Humanities > Library and Information Sciences
Uncontrolled Keywords:Library and Information Sciences, Computer Science Applications
Language:English
Date:10 February 2023
Deposited On:09 Feb 2024 10:13
Last Modified:31 Mar 2024 01:40
Publisher:Springer
ISSN:1388-1957
OA Status:Hybrid
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.1007/s10676-023-09686-x
PubMed ID:36789353
Project Information:
  • : FunderUniversity of Zurich
  • : Grant ID
  • : Project Title
  • : FunderUniversity of Zurich
  • : Grant ID
  • : Project Title
  • Content: Published Version
  • Language: English
  • Licence: Creative Commons: Attribution 4.0 International (CC BY 4.0)