Logo image
Back
On Understanding Data Worker Interaction Behaviors
Conference paper   Peer reviewed

On Understanding Data Worker Interaction Behaviors

Lei Han, Tianwa Chen, Gianluca Demartini, Marta Indulska and Shazia Sadiq
Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.269-278
International Conference on Research and Development in Information Retrieval (SIGIR), 43rd (Virtual, 25-Jul-2020–30-Jul-2020)
Association for Computing Machinery
2020
DOI: https://doi.org/10.1145/3397271.3401059
url
https://doi.org/10.1145/3397271.3401059View
Published Version Open

Abstract

data curation interaction behaviour search pattern
Understanding how data workers interact with data and various pieces of information (e.g., code snippet examples) is key to design systems that can better support them in exploring a given dataset. To date, however, there is a paucity of research studying information seeking patterns and the strategies adopted by data workers as they carry out data curation activities. In this work, we aim at understanding the behaviors of data workers in discovering data quality issues, and how these behavioral observations relate to their performance. Specifically, we investigate how data workers use information resources and tools to support their task completion. To this end, we collect a multi-modal dataset through a data-driven experiment that relies on the use of eye-tracking technology with a purpose-designed platform built on top of iPython Notebook. The collected data reveals that: (i) searching in external resources is a prevalent action that can be leveraged to achieve better performance; (ii) 'copy-paste-modify' is a typical strategy for writing code to complete tasks; (iii) providing sample code within the system could help data workers to get started with their task; and (iv) surfacing underlying data is an effective way to support exploration. By investigating the behaviors prior to each search action, we also find that the most common reasons that trigger external search actions are the need to seek assistance in writing or debugging code and to search for relevant code to reuse. Our findings provide insights into patterns of interactions with various system components and information resources to perform data curation tasks. This bears implications on the design of domain-specific IR systems for data workers like code-base search.

Details

Metrics

1 Record Views
Logo image