Dimensions of Autonomous Decision making: A First Step in Transforming the Policies and Ethics Principles Regarding Autonomous Systems into Practical System Engineering Requirements
Abstract
This study identifies the dimensions of autonomous decision-making (DADs) - the categories and causes of potential risk that one should consider before transferring decision-making capabilities to an intelligent autonomous system (IAS). The objective of this study was to provide some of the tools needed to implement existing policies with respect to the legal, ethical, and militarily effective use of IAS. These tools help to identify and either mitigate or accept the risks associated with the use of IAS that might result in a negative outcome. The 13 identified DADs were developed from a comprehensive list of 559 "risk elements" drawn from hundreds of documents authored by parties in favor of, and opposed to, the use of autonomy technology in weapons systems. We record these elements in the form of a question so that they can be used by the acquisition community to develop requirements documents that ensure the ethical use of autonomous systems, and be used by military commanders as a risk assessment checklist to ensure that autonomous systems are not used in an unethical manner. In this way, the Department of Defense can make fully-informed risk assessment decisions before developing or deploying autonomous systems.
Document Details
- Document Type
- Technical Report
- Publication Date
- Sep 01, 2021
- Accession Number
- AD1181791
Entities
People
- Becky Roh
- Kevin Pollpeter
- Mark Rosen
- Michael F. Stumborg
- Sam Bendett
Organizations
- Center for Naval Analyses