Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue

Aron Molnar, Jaap Jumelet, Mario Giulianelli, Arabella Sinclair


Abstract
Language models are often used as the backbone of modern dialogue systems. These models are pre-trained on large amounts of written fluent language. Repetition is typically penalised when evaluating language model generations. However, it is a key component of dialogue. Humans use local and partner specific repetitions; these are preferred by human users and lead to more successful communication in dialogue. In this study, we evaluate (a) whether language models produce human-like levels of repetition in dialogue, and (b) what are the processing mechanisms related to lexical re-use they use during comprehension. We believe that such joint analysis of model production and comprehension behaviour can inform the development of cognitively inspired dialogue generation systems.
Anthology ID:
2023.conll-1.18
Volume:
Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL)
Month:
December
Year:
2023
Address:
Singapore
Editors:
Jing Jiang, David Reitter, Shumin Deng
Venue:
CoNLL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
254–273
Language:
URL:
https://aclanthology.org/2023.conll-1.18
DOI:
10.18653/v1/2023.conll-1.18
Bibkey:
Cite (ACL):
Aron Molnar, Jaap Jumelet, Mario Giulianelli, and Arabella Sinclair. 2023. Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue. In Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL), pages 254–273, Singapore. Association for Computational Linguistics.
Cite (Informal):
Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue (Molnar et al., CoNLL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.conll-1.18.pdf