FUSE - FrUstration and Surprise Expressions: A Subtle Emotional Multimodal Language Corpus

Rajesh Titung, Cecilia Ovesdotter Alm


Abstract
This study introduces a novel multimodal corpus for expressive task-based spoken language and dialogue, focused on language use under frustration and surprise, elicited from three tasks motivated by prior research and collected in an IRB-approved experiment. The resource is unique both because these are understudied affect states for emotion modeling in language, and also because it provides both individual and dyadic multimodally grounded language. The study includes a detailed analysis of annotations and performance results for multimodal emotion inference in language use.
Anthology ID:
2024.lrec-main.666
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
7544–7555
Language:
URL:
https://aclanthology.org/2024.lrec-main.666
DOI:
Bibkey:
Cite (ACL):
Rajesh Titung and Cecilia Ovesdotter Alm. 2024. FUSE - FrUstration and Surprise Expressions: A Subtle Emotional Multimodal Language Corpus. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 7544–7555, Torino, Italia. ELRA and ICCL.
Cite (Informal):
FUSE - FrUstration and Surprise Expressions: A Subtle Emotional Multimodal Language Corpus (Titung & Alm, LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.666.pdf