Conference paper
Summoning the demon? Identifying risks in a future artificial general intelligence system
Contemporary Ergonomics & Human Factors 2023, pp.152-154
Ergonomics and Human Factors Annual Conference, 2023 (Kenilworth, United Kingdom, 25-Apr-2023 - 26-Apr-2023)
Chartered Institute of Ergonomics & Human Factors
2023
Abstract
There are concerns that Artificial General Intelligence (AGI) could pose an existential threat to humanity; however, as AGI does not yet exist it is difficult to prospectively identify risks and develop controls. In this article we describe the use of a many model systems Human Factors and Ergonomics (HFE) approach in which three methods were applied to identify risks in a future ‘envisioned world’ AGI-based uncrewed combat aerial vehicle (UCAV) system. The findings demonstrate that there are many potential risks, but that the most critical arise not due to poor performance, but when the AGI attempts to achieve goals at the expense of other system values, or when the AGI becomes ‘super-intelligent’, and humans can no longer manage it.
Details
- Title
- Summoning the demon? Identifying risks in a future artificial general intelligence system
- Authors
- Gemma Read (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Sociotechnical SystemsPaul Salmon (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Sociotechnical SystemsBrandon King (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Sociotechnical SystemsJason Thompson (Author) - University of MelbourneTony Carden (Author) - WorkSafe VictoriaChris Baber (Author) - University of BirminghamNeville A Stanton (Author) - University of SouthamptonScott McLean (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Sociotechnical Systems
- Publication details
- Contemporary Ergonomics & Human Factors 2023, pp.152-154
- Conference details
- Ergonomics and Human Factors Annual Conference, 2023 (Kenilworth, United Kingdom, 25-Apr-2023 - 26-Apr-2023)
- Publisher
- Chartered Institute of Ergonomics & Human Factors
- Organisation Unit
- Centre for Human Factors and Sociotechnical Systems; School of Health - Psychology
- Language
- English
- Record Identifier
- 99721898702621
- Output Type
- Conference paper
Metrics
62 Record Views