Conference paper
Cognitive Work Analysis and Allocation of Responsibility (AoR) in AI Systems
Contemporary Ergonomics and Human Factors 2026, pp.99-106
Ergonomics and Human Factors Annual Conference, 2026 (Nottingham, United Kingdom, 27-Apr-2026–29-Apr-2026)
Chartered Institute of Ergonomics and Human Factors (CIEHF)
2026
Abstract
Often ‘responsible AI’ focuses attention on the design of AI systems. We propose that a more pressing need arises when such systems are deployed. There is a need to predict where to place responsibility for outcomes arising from the activity of AI systems. Responsibility cannot be given to the AI system, human oversight must be designed into the broader sociotechnical system in which the AI is deployed, and human oversight must be considered in terms of meaningful control of the AI system. We demonstrate how methods from the Cognitive Work Analysis (CWA) framework allow exploration of allocation of responsibility, AoR, in AI systems. Using a case study of a human-agent team, we show that the AI system does not operate at the level of physical form, i.e., it is not a tool that supports human activity, but operates at higher levels (e.g., physical and generalized functions) in ways that influence abstract functions (i.e., system values). Introducing AI involves redesign of the system to reflect the need for human oversight. As a result, we need to define new tasks for humans in this system and these could involve either changes to existing roles (e.g., the road traffic management role might extend to cover maintenance scheduling) or the introduction of additional roles (e.g., the highway engineers might need a role to work with the AI system and confirm its schedule), and the new roles could have additional requirements for coordination across the other roles in the system.
Details
- Title
- Cognitive Work Analysis and Allocation of Responsibility (AoR) in AI Systems
- Authors
- Chris Baber - University of BirminghamPaul Salmon - University of the Sunshine CoastPatrick Waterson - Loughborough University
- Contributors
- Dave Golightly (Editor)Rebecca Charles (Editor)Fay Dixon (Editor)
- Publication details
- Contemporary Ergonomics and Human Factors 2026, pp.99-106
- Conference details
- Ergonomics and Human Factors Annual Conference, 2026 (Nottingham, United Kingdom, 27-Apr-2026–29-Apr-2026)
- Publisher
- Chartered Institute of Ergonomics and Human Factors (CIEHF)
- Date published
- 2026
- Grant note
- The work presented in this paper was partially supported by a grant from the EPSRC (EP/X028569/1 - Satisfying Trust in Human-Robot Teams).
- Organisation Unit
- Centre for Human Factors and Systems Science
- Language
- English
- Record Identifier
- 991251397102621
- Output Type
- Conference paper
Metrics
1 Record Views