“Actors Challenge”: Collecting Data to Study Prosodic Patterns and Their Mappings to Meanings Across Languages

Sia V. Sepanta


Abstract
In this paper we describe “Actors Challenge”: a web-based interactive game designed to collect massively multi-speaker, multi-lingual oral data on the connection between prosody and various aspects of meaning. Game participants take on the two roles of auditioners and casting directors. Auditioners are asked to record certain target phrases modulated according to the emotional or attitudinal profiles that correspond to contexts or stage cues given to them. They then switch roles and become Casting Directors. Now they have to listen to other participants’ recordings, guess the corresponding context/stage cue that the auditioner tried to convey, and evaluate how good the performance was. By having the players alternate between these two roles we obtain both data creation and data validation from the same set of participants. We expect that the final dataset of labeled recordings will be valuable for a range of applications: training multilingual Speech Emotion Recognition classifiers; discovering correlations and variations in prosodic patterns among unrelated languages; examining correlations between prosodic patterns and emotion recognizability; probing the possibility that some prosodic patterns are universal.
Anthology ID:
2024.games-1.1
Volume:
Proceedings of the 10th Workshop on Games and Natural Language Processing @ LREC-COLING 2024
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Chris Madge, Jon Chamberlain, Karen Fort, Udo Kruschwitz, Stephanie Lukin
Venues:
games | WS
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
1–5
Language:
URL:
https://aclanthology.org/2024.games-1.1
DOI:
Bibkey:
Cite (ACL):
Sia V. Sepanta. 2024. “Actors Challenge”: Collecting Data to Study Prosodic Patterns and Their Mappings to Meanings Across Languages. In Proceedings of the 10th Workshop on Games and Natural Language Processing @ LREC-COLING 2024, pages 1–5, Torino, Italia. ELRA and ICCL.
Cite (Informal):
“Actors Challenge”: Collecting Data to Study Prosodic Patterns and Their Mappings to Meanings Across Languages (Sepanta, games-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.games-1.1.pdf