Do not Trust the Experts - How the Lack of Standard Complicates NLP for Historical Irish

Oksana Dereza, Theodorus Fransen, John P. Mccrae


Abstract
In this paper, we describe how we unearthed some fundamental problems while building an analogy dataset modelled on BATS (Gladkova et al., 2016) to evaluate historical Irish embeddings on their ability to detect orthographic, morphological and semantic similarity.performance of our models in the analogy task was extremely poor regardless of the architecture, hyperparameters and evaluation metrics, while the qualitative evaluation revealed positive tendencies. argue that low agreement between field experts on fundamental lexical and orthographic issues, and the lack of a unified editorial standard in available resources make it impossible to build reliable evaluation datasets for computational models and obtain interpretable results. We emphasise the need for such a standard, particularly for NLP applications, and prompt Celticists and historical linguists to engage in further discussion. We would also like to draw NLP scholars’ attention to the role of data and its (extra)linguistic properties in testing new models, technologies and evaluation scenarios.
Anthology ID:
2023.insights-1.10
Volume:
Proceedings of the Fourth Workshop on Insights from Negative Results in NLP
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Shabnam Tafreshi, Arjun Akula, João Sedoc, Aleksandr Drozd, Anna Rogers, Anna Rumshisky
Venues:
insights | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
82–87
Language:
URL:
https://aclanthology.org/2023.insights-1.10
DOI:
10.18653/v1/2023.insights-1.10
Bibkey:
Cite (ACL):
Oksana Dereza, Theodorus Fransen, and John P. Mccrae. 2023. Do not Trust the Experts - How the Lack of Standard Complicates NLP for Historical Irish. In Proceedings of the Fourth Workshop on Insights from Negative Results in NLP, pages 82–87, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Do not Trust the Experts - How the Lack of Standard Complicates NLP for Historical Irish (Dereza et al., insights-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.insights-1.10.pdf
Video:
 https://aclanthology.org/2023.insights-1.10.mp4