Conference paper
Summoning the demon? Identifying risks in a future artificial general intelligence system
Contemporary Ergonomics & Human Factors 2023, pp.152-154
Ergonomics and Human Factors Annual Conference, 2023 (Kenilworth, United Kingdom, 25-Apr-2023–26-Apr-2023)
Chartered Institute of Ergonomics and Human Factors (CIEHF)
2023
Abstract
There are concerns that Artificial General Intelligence (AGI) could pose an existential threat to humanity; however, as AGI does not yet exist it is difficult to prospectively identify risks and develop controls. In this article we describe the use of a many model systems Human Factors and Ergonomics (HFE) approach in which three methods were applied to identify risks in a future ‘envisioned world’ AGI-based uncrewed combat aerial vehicle (UCAV) system. The findings demonstrate that there are many potential risks, but that the most critical arise not due to poor performance, but when the AGI attempts to achieve goals at the expense of other system values, or when the AGI becomes ‘super-intelligent’, and humans can no longer manage it.
Details
- Title
- Summoning the demon? Identifying risks in a future artificial general intelligence system
- Authors
- Gemma Read (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Systems SciencePaul Salmon (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Systems ScienceBrandon King (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Systems ScienceJason Thompson (Author) - The University of MelbourneTony Carden (Author) - WorkSafe VictoriaChris Baber (Author) - University of BirminghamNeville A Stanton (Author) - University of SouthamptonScott McLean (Author) - University of the Sunshine Coast, Queensland, Centre for Human Factors and Systems Science
- Publication details
- Contemporary Ergonomics & Human Factors 2023, pp.152-154
- Conference details
- Ergonomics and Human Factors Annual Conference, 2023 (Kenilworth, United Kingdom, 25-Apr-2023–26-Apr-2023)
- Publisher
- Chartered Institute of Ergonomics and Human Factors (CIEHF)
- Date published
- 2023
- Organisation Unit
- Centre for Human Factors and Systems Science; School of Health - Psychology
- Language
- English
- Record Identifier
- 99721898702621
- Output Type
- Conference paper
Metrics
157 Record Views