The Past, Present, and Future of Typological Databases in NLP

Emi Baylor, Esther Ploeger, Johannes Bjerva


Abstract
Typological information has the potential to be beneficial in the development of NLP models, particularly for low-resource languages. Unfortunately, current large-scale typological databases, notably WALS and Grambank, are inconsistent both with each other and with other sources of typological information, such as linguistic grammars. Some of these inconsistencies stem from coding errors or linguistic variation, but many of the disagreements are due to the discrete categorical nature of these databases. We shed light on this issue by systematically exploring disagreements across typological databases and resources, and their uses in NLP, covering the past and present. We next investigate the future of such work, offering an argument that a continuous view of typological features is clearly beneficial, echoing recommendations from linguistics. We propose that such a view of typology has significant potential in the future, including in language modeling in low-resource scenarios.
Anthology ID:
2023.findings-emnlp.82
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1163–1169
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.82
DOI:
10.18653/v1/2023.findings-emnlp.82
Bibkey:
Cite (ACL):
Emi Baylor, Esther Ploeger, and Johannes Bjerva. 2023. The Past, Present, and Future of Typological Databases in NLP. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 1163–1169, Singapore. Association for Computational Linguistics.
Cite (Informal):
The Past, Present, and Future of Typological Databases in NLP (Baylor et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.82.pdf