MAUPQA: Massive Automatically-created Polish Question Answering Dataset

Piotr Rybak


Abstract
Recently, open-domain question answering systems have begun to rely heavily on annotated datasets to train neural passage retrievers. However, manually annotating such datasets is both difficult and time-consuming, which limits their availability for less popular languages. In this work, we experiment with several methods for automatically collecting weakly labeled datasets and show how they affect the performance of the neural passage retrieval models. As a result of our work, we publish the MAUPQA dataset, consisting of nearly 400,000 question-passage pairs for Polish, as well as the HerBERT-QA neural retriever.
Anthology ID:
2023.bsnlp-1.2
Volume:
Proceedings of the 9th Workshop on Slavic Natural Language Processing 2023 (SlavicNLP 2023)
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Jakub Piskorski, Michał Marcińczuk, Preslav Nakov, Maciej Ogrodniczuk, Senja Pollak, Pavel Přibáň, Piotr Rybak, Josef Steinberger, Roman Yangarber
Venue:
BSNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11–16
Language:
URL:
https://aclanthology.org/2023.bsnlp-1.2
DOI:
10.18653/v1/2023.bsnlp-1.2
Bibkey:
Cite (ACL):
Piotr Rybak. 2023. MAUPQA: Massive Automatically-created Polish Question Answering Dataset. In Proceedings of the 9th Workshop on Slavic Natural Language Processing 2023 (SlavicNLP 2023), pages 11–16, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
MAUPQA: Massive Automatically-created Polish Question Answering Dataset (Rybak, BSNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.bsnlp-1.2.pdf
Video:
 https://aclanthology.org/2023.bsnlp-1.2.mp4