Unsupervised Dense Retrieval for Scientific Articles

Dan Li, Vikrant Yadav, Zubair Afzal, George Tsatsaronis


Abstract
In this work, we build a dense retrieval based semantic search engine on scientific articles from Elsevier. The major challenge is that there is no labeled data for training and testing. We apply a state-of-the-art unsupervised dense retrieval model called Generative Pseudo Labeling that generates high-quality pseudo training labels. Furthermore, since the articles are unbalanced across different domains, we select passages from multiple domains to form balanced training data. For the evaluation, we create two test sets: one manually annotated and one automatically created from the meta-information of our data. We compare the semantic search engine with the currently deployed lexical search engine on the two test sets. The results of the experiment show that the semantic search engine trained with pseudo training labels can significantly improve search performance.
Anthology ID:
2022.emnlp-industry.32
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
December
Year:
2022
Address:
Abu Dhabi, UAE
Editors:
Yunyao Li, Angeliki Lazaridou
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
313–321
Language:
URL:
https://aclanthology.org/2022.emnlp-industry.32
DOI:
10.18653/v1/2022.emnlp-industry.32
Bibkey:
Cite (ACL):
Dan Li, Vikrant Yadav, Zubair Afzal, and George Tsatsaronis. 2022. Unsupervised Dense Retrieval for Scientific Articles. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 313–321, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Unsupervised Dense Retrieval for Scientific Articles (Li et al., EMNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.emnlp-industry.32.pdf