Frédéric Kaplan
Also published as: Frederic Kaplan
2024
Post-Correction of Historical Text Transcripts with Large Language Models: An Exploratory Study
Emanuela Boros
|
Maud Ehrmann
|
Matteo Romanello
|
Sven Najem-Meyer
|
Frédéric Kaplan
Proceedings of the 8th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature (LaTeCH-CLfL 2024)
The quality of automatic transcription of heritage documents, whether from printed, manuscripts or audio sources, has a decisive impact on the ability to search and process historical texts. Although significant progress has been made in text recognition (OCR, HTR, ASR), textual materials derived from library and archive collections remain largely erroneous and noisy. Effective post-transcription correction methods are therefore necessary and have been intensively researched for many years. As large language models (LLMs) have recently shown exceptional performances in a variety of text-related tasks, we investigate their ability to amend poor historical transcriptions. We evaluate fourteen foundation language models against various post-correction benchmarks comprising different languages, time periods and document types, as well as different transcription quality and origins. We compare the performance of different model sizes and different prompts of increasing complexity in zero and few-shot settings. Our evaluation shows that LLMs are anything but efficient at this task. Quantitative and qualitative analyses of results allow us to share valuable insights for future work on post-correcting historical texts with LLMs.
1998
Spontaneous Lexicon Change
Luc Steels
|
Frederic Kaplan
COLING 1998 Volume 2: The 17th International Conference on Computational Linguistics
Spontaneous Lexicon Change
Luc Steels
|
Frederic Kaplan
36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, Volume 2
Search