Don’t Invite BERT to Drink a Bottle: Modeling the Interpretation of Metonymies Using BERT and Distributional Representations

Paolo Pedinotti, Alessandro Lenci


Abstract
In this work, we carry out two experiments in order to assess the ability of BERT to capture the meaning shift associated with metonymic expressions. We test the model on a new dataset that is representative of the most common types of metonymy. We compare BERT with the Structured Distributional Model (SDM), a model for the representation of words in context which is based on the notion of Generalized Event Knowledge. The results reveal that, while BERT ability to deal with metonymy is quite limited, SDM is good at predicting the meaning of metonymic expressions, providing support for an account of metonymy based on event knowledge.
Anthology ID:
2020.coling-main.602
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
6831–6837
Language:
URL:
https://aclanthology.org/2020.coling-main.602
DOI:
10.18653/v1/2020.coling-main.602
Bibkey:
Cite (ACL):
Paolo Pedinotti and Alessandro Lenci. 2020. Don’t Invite BERT to Drink a Bottle: Modeling the Interpretation of Metonymies Using BERT and Distributional Representations. In Proceedings of the 28th International Conference on Computational Linguistics, pages 6831–6837, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
Don’t Invite BERT to Drink a Bottle: Modeling the Interpretation of Metonymies Using BERT and Distributional Representations (Pedinotti & Lenci, COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-main.602.pdf