Logo image
Back
Developing a contributing factor classification scheme for Rasmussen's AcciMap: Reliability and validity evaluation
Journal article   Peer reviewed

Developing a contributing factor classification scheme for Rasmussen's AcciMap: Reliability and validity evaluation

Natassia Goode, Paul M Salmon, Natalie Taylor, M G Lenne and C F Finch
Applied Ergonomics, Vol.64, pp.14-26
2017
DOI: https://doi.org/10.1016/j.apergo.2017.04.014
url
https://doi.org/10.1016/j.apergo.2017.04.014View
Published Version

Abstract

systems thinking reliability validity incident classification
One factor potentially limiting the uptake of Rasmussen's (1997) Accimap method by practitioners is the lack of a contributing factor classification scheme to guide accident analyses. This article evaluates the intra- and inter-rater reliability and criterion-referenced validity of a classification scheme developed to support the use of Accimap by led outdoor activity (LOA) practitioners. The classification scheme has two levels: the system level describes the actors, artefacts and activity context in terms of 14 codes; the descriptor level breaks the system level codes down into 107 specific contributing factors. The study involved 11 LOA practitioners using the scheme on two separate occasions to code a pre-determined list of contributing factors identified from four incident reports. Criterion-referenced validity was assessed by comparing the codes selected by LOA practitioners to those selected by the method creators. Mean intra-rater reliability scores at the system (M = 83.6%) and descriptor (M = 74%) levels were acceptable. Mean inter-rater reliability scores were not consistently acceptable for both coding attempts at the system level (MT1 = 68.8%; MT2 = 73.9%), and were poor at the descriptor level (MT1 = 58.5%; MT2 = 64.1%). Mean criterion referenced validity scores at the system level were acceptable (MT1 = 73.9%; MT2 = 75.3%). However, they were not consistently acceptable at the descriptor level (MT1 = 67.6%; MT2 = 70.8%). Overall, the results indicate that the classification scheme does not currently satisfy reliability and validity requirements, and that further work is required. The implications for the design and development of contributing factors classification schemes are discussed.

Details

Metrics

3 File views/ downloads
871 Record Views
43 Times Cited - Web of Science

InCites Highlights

These are selected metrics from InCites Benchmarking & Analytics tool, related to this output

Collaboration types
Domestic collaboration
Web Of Science research areas
Engineering, Industrial
Ergonomics
Psychology, Applied

UN Sustainable Development Goals (SDGs)

This output has contributed to the advancement of the following goals:

#3 Good Health and Well-Being

Source: InCites

Logo image