It’s risk, Jim, but not as we know it: identifying the risks associated with future Artificial General Intelligence-based Unmanned Combat Aerial Vehicle systems

Paul M. Salmon; Scott McLean; Tony Carden; Brandon King; Jason Thompson; Chris Baber; Neville A. Stanton; Gemma J. M. Read

doi:10.1177/1071181322661140

Back

It’s risk, Jim, but not as we know it: identifying the risks associated with future Artificial General Intelligence-based Unmanned Combat Aerial Vehicle systems

Conference paper

Peer reviewed

It’s risk, Jim, but not as we know it: identifying the risks associated with future Artificial General Intelligence-based Unmanned Combat Aerial Vehicle systems

Paul M. Salmon, Scott McLean, Tony Carden, Brandon King, Jason Thompson, Chris Baber, Neville A. Stanton and Gemma J. M. Read

Human Factors and Ergonomics Society Annual Meeting. Proceedings, Vol.66(1), pp.560-564

Human Factors and Ergonomics Society International Annual Meeting, 66th (Atlanta, United States, 10-Oct-2022–14-Oct-2022)

Sage Publications, Inc.

2022

DOI: https://doi.org/10.1177/1071181322661140

Files and links (1)

url

https://doi.org/10.1177/1071181322661140View

Published Version

Abstract

The next generation of artificial intelligence, known as Artificial General Intelligence (AGI), could either revolutionise or destroy humanity. Human Factors and Ergonomics (HFE) has a critical role to play in the design of safe and ethical AGI; however, there is little evidence that HFE is contributing to development programs. This paper presents the findings from a study which involved the use of the Work Domain Analysis Broken Nodes approach to identify the risks that could emerge in a future ‘envisioned world’ AGI based unmanned combat aerial vehicle system. The findings demonstrate that there are various potential risks, but that the most critical arise not due to poor performance, but rather when the AGI attempts to achieve goals at the expense of other system values, or when the AGI becomes ‘super intelligent’, and humans can no longer manage it. The urgent need for further work exploring the design of AGI controls is emphasised.

Details

Title: It’s risk, Jim, but not as we know it: identifying the risks associated with future Artificial General Intelligence-based Unmanned Combat Aerial Vehicle systems
Authors: Paul M. Salmon (Corresponding Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Sociotechnical Systems
Scott McLean (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Sociotechnical Systems
Tony Carden (Author) - WorkSafe Victoria
Brandon King (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Sociotechnical Systems
Jason Thompson (Author) - University of Melbourne
Chris Baber (Author) - University of Birmingham
Neville A. Stanton (Author) - University of Southampton
Gemma J. M. Read (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Sociotechnical Systems
Publication details: Human Factors and Ergonomics Society Annual Meeting. Proceedings, Vol.66(1), pp.560-564
Conference details: Human Factors and Ergonomics Society International Annual Meeting, 66th (Atlanta, United States, 10-Oct-2022–14-Oct-2022)
Publisher: Sage Publications, Inc.
Date published: 2022
DOI: 10.1177/1071181322661140
ISSN: 1071-1813
Grants: Managing the risks posed by Artificial General Intelligence, DP200100399, Australian Research Council (Australia, Canberra) - ARC
Organisation Unit: Centre for Human Factors and Sociotechnical Systems; School of Health - Psychology
Language: English
Record Identifier: 99686998902621
Output Type: Conference paper

Metrics

54 Record Views