Measuring Situation Awareness in complex systems: Comparison of measures study

Paul M Salmon; Neville A Stanton; Guy H Walker; D P Jenkins; D Ladva; L Rafferty; M S Young

doi:10.1016/j.ergon.2008.10.010

Back

Measuring Situation Awareness in complex systems: Comparison of measures study

Journal article

Open access

Peer reviewed

Measuring Situation Awareness in complex systems: Comparison of measures study

Paul M Salmon, Neville A Stanton, Guy H Walker, D P Jenkins, D Ladva, L Rafferty and M S Young

International Journal of Industrial Ergonomics, Vol.39(3), pp.490-500

2009

DOI: https://doi.org/10.1016/j.ergon.2008.10.010

Files and links (2)

pdf

PDF - Author's Accepted Version (Open Access)611.13 kBDownload View

Accepted VersionPDF - Author Accepted Version (Open Access)CC BY-NC-ND V4.0, Open Access

url

https://doi.org/10.1016/j.ergon.2008.10.010View

Published Version

Abstract

situation awareness

situation awareness measurement

command and control

Assessing operator situation awareness is a key component of sociotechnical system design and evaluation. This article describes a study that was undertaken in order to compare two different situation awareness measures (a freeze probe recall approach and a post trial subjective rating approach) when used to assess participant situation awareness during a military planning task. The results indicate that only the participant situation awareness scores derived via the freeze probe recall method produced a statistically significant correlation with performance on the planning task and also that there was no significant correlation between the two methods, which suggests that they were measuring different aspects of participant situation awareness during the trials. In conclusion, the findings, whilst raising doubts over the validity of the post trial subjective rating approach, offer validation evidence for the use of freeze probe recall approaches to measure situation awareness during simulated tasks. The findings are subsequently discussed with regard to their wider implications for the future measurement of situation awareness in complex collaborative systems.Relevance to industrySituation Awareness is a critical commodity for teams working in industrial systems. Accordingly, designers and analysts require reliable and valid methods for assessing the impact of new systems, interfaces, training programs and procedures on the level of situation awareness held by operators. This article presents a review and comparison of situation awareness measurement approaches for use in complex industrial systems and provides recommendations on the types of methods to use during future situation awareness assessments.

Details

Title: Measuring Situation Awareness in complex systems: Comparison of measures study
Authors: Paul M Salmon (Author) - Brunel University, United Kingdom
Neville A Stanton (Author) - Brunel University, United Kingdom
Guy H Walker (Author) - Brunel University, United Kingdom
D P Jenkins (Author) - Brunel University, United Kingdom
D Ladva (Author) - Brunel University, United Kingdom
L Rafferty (Author) - Brunel University, United Kingdom
M S Young (Author) - Brunel University, United Kingdom
Publication details: International Journal of Industrial Ergonomics, Vol.39(3), pp.490-500
Publisher: Elsevier BV
Date published: 2009
DOI: 10.1016/j.ergon.2008.10.010
ISSN: 0169-8141
Organisation Unit: Centre for Human Factors and Systems Science; University of the Sunshine Coast, Queensland; School of Law and Society
Language: English
Record Identifier: 99450482502621
Output Type: Journal article

Metrics

176 File views/ downloads

686 Record Views

254 Times Cited - Web of Science

InCites Highlights

These are selected metrics from InCites Benchmarking & Analytics tool, related to this output

Web Of Science research areas: Engineering, Industrial; Ergonomics