Which code is it? Inter-rater reliability of systems theory-based causal factor taxonomy for the outdoor sector

Natalie Taylor; Natassia Goode; Paul M Salmon; Michael Lenne; C Finch

Back

Which code is it? Inter-rater reliability of systems theory-based causal factor taxonomy for the outdoor sector

Conference paper

Open access

Peer reviewed

Which code is it? Inter-rater reliability of systems theory-based causal factor taxonomy for the outdoor sector

Natalie Taylor, Natassia Goode, Paul M Salmon, Michael Lenne and C Finch

Proceedings of the 19th Triennial Congress of the International Ergonomics Association, 70

Triennial Congress of the International Ergonomics Association, 19th (Melbourne, Australia, 09-Aug-2015–14-Aug-2015)

International Ergonomics Association

2015

Files and links (2)

pdf

PDF - Published Version4.51 MBDownload View

Published VersionPDF - Published Version Open Access

url

http://ergonomics.uq.edu.au/iea/proceedings/Index_files/papers/70.pdfView

Webpage

Abstract

Information Systems

reliability

incident reporting

systems approach

The use of incident reporting systems to enhance understanding of accident causation is widely accepted in most domains. However, to formulate appropriate countermeasures, organisations must be able to reliably identify the contributory factors across incidents. The use of contributory factor taxonomies can enhance the reliability of such analyses, if domainappropriate. This study aims to test the inter-rater reliability of a revised contributory factor taxonomy that was developed for the led outdoor activity domain. The study involved 13 human factors experts using the taxonomy to code 3 incident reports. The results demonstrated that the participants using the revised taxonomy had greatly improved levels of inter-rater reliability compared to the original. However, three issues were identified. First, participants had trouble distinguishing between certain codes. Secondly, mistakes were made when participants were required to place specific actors into categories. Thirdly, participants went beyond the information provided in the incident descriptions. The results show the importance of testing the reliability of a method to save money in the design process, and in some domains, reduce casualties.

Details

Title: Which code is it? Inter-rater reliability of systems theory-based causal factor taxonomy for the outdoor sector
Authors: Natalie Taylor (Author) - University of the Sunshine Coast - Faculty of Arts and Business
Natassia Goode (Author) - University of the Sunshine Coast - Faculty of Arts and Business
Paul M Salmon (Author) - University of the Sunshine Coast - Faculty of Arts and Business
Michael Lenne (Author) - Monash University
C Finch (Author) - Federation University
Contributors: Gitte Lindgaard (Editor)
Dave Moore (Editor)
Publication details: Proceedings of the 19th Triennial Congress of the International Ergonomics Association, 70; 8
Conference details: Triennial Congress of the International Ergonomics Association, 19th (Melbourne, Australia, 09-Aug-2015–14-Aug-2015)
Publisher: International Ergonomics Association
Date published: 2015
Grants: A new complex systems approach to road trauma: Applying systems thinking to the fatal five, FT140100681, Australian Research Council (Australia, Canberra) - ARC
Understanding and preventing injury in the led outdoor activity domain: A theory driven approach to injury surveillance and prevention, LP110100037, Australian Research Council (Australia, Canberra) - ARC
Preventing sports injuries through better targetting of effective interventions and monitoring of safety practices and outcomes, 1058737, National Health and Medical Research Council (Australia, Canberra) - NHMRC
Organisation Unit: Centre for Human Factors and Systems Science; School of Social Sciences - Legacy; School of Law and Society
Language: English
Record Identifier: 99449953202621
Output Type: Conference paper
Research Statement: false

Metrics

345 File views/ downloads

855 Record Views