In a Silent Way: Communication Between Al and Improvising Musicians Beyond Sound

Jon McCormack; Toby Gifford; Patrick E Hutchings; Maria Teresa Llano; Matthew Yee-King; Mark D'inverno

doi:10.1145/3290605.3300268

Back

In a Silent Way: Communication Between Al and Improvising Musicians Beyond Sound

Conference paper

Peer reviewed

In a Silent Way: Communication Between Al and Improvising Musicians Beyond Sound

Jon McCormack, Toby Gifford, Patrick E Hutchings, Maria Teresa Llano, Matthew Yee-King and Mark D'inverno

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp.1-11

CHI Conference on Human Factors in Computing Systems, 2019 (Glasgow, United Kingdom, 04-May-2019 - 09-May-2019)

Association for Computing Machinary

2019

DOI: https://doi.org/10.1145/3290605.3300268

Files and links (1)

url

https://doi.org/10.1145/3290605.3300268View

Published Version

Abstract

Music technology and recording

Artificial intelligence

Music

extra-musical communication

improvisation

AI systems

Collaboration is built on trust, and establishing trust with a creative Artificial Intelligence is difficult when the decision process or internal state driving its behaviour isn't exposed. When human musicians improvise together, a number of extra-musical cues are used to augment musical communication and expose mental or emotional states which affect musical decisions and the effectiveness of the collaboration. We developed a collaborative improvising AI drummer that communicates its confidence through an emoticon-based visualisation. The AI was trained on musical performance data, as well as real-time skin conductance, of musicians improvising with professional drummers, exposing both musical and extra-musical cues to inform its generative process. Uni- and bi-directional extra-musical communication with real and false values were tested by experienced improvising musicians. Each condition was evaluated using the FSS-2 questionnaire, as a proxy for musical engagement. The results show a positive correlation between extra-musical communication of machine internal state and human musical engagement.

Details

Title: In a Silent Way: Communication Between Al and Improvising Musicians Beyond Sound
Authors: Jon McCormack (Author) - Monash University
Toby Gifford (Author) - Monash University
Patrick E Hutchings (Author) - Monash University
Maria Teresa Llano (Author) - Goldsmiths University of London
Matthew Yee-King (Author) - Goldsmiths University of London
Mark D'inverno (Author) - Goldsmiths University of London
Publication details: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp.1-11
Conference details: CHI Conference on Human Factors in Computing Systems, 2019 (Glasgow, United Kingdom, 04-May-2019 - 09-May-2019)
Publisher: Association for Computing Machinary
DOI: 10.1145/3290605.3300268; 10.1145/3290605
Organisation Unit: School of Business and Creative Industries
Language: English
Record Identifier: 99713397402621
Output Type: Conference paper

Metrics

48 Record Views