Evaluating Machine Translation in Cross-lingual E-Commerce Search

Hang Zhang, Liling Tan, Amita Misra


Abstract
Multilingual query localization is integral to modern e-commerce. While machine translation is widely used to translate e-commerce queries, evaluation of query translation in the context of the down-stream search task is overlooked. This study proposes a search ranking-based evaluation framework with an edit-distance based search metric to evaluate machine translation impact on cross-lingual information retrieval for e-commerce search query translation, The framework demonstrate evaluation of machine translation for e-commerce search at scale and the proposed metric is strongly associated with traditional machine translation and traditional search relevance-based metrics.
Anthology ID:
2022.amta-research.25
Volume:
Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
Month:
September
Year:
2022
Address:
Orlando, USA
Editors:
Kevin Duh, Francisco Guzmán
Venue:
AMTA
SIG:
Publisher:
Association for Machine Translation in the Americas
Note:
Pages:
322–334
Language:
URL:
https://aclanthology.org/2022.amta-research.25
DOI:
Bibkey:
Cite (ACL):
Hang Zhang, Liling Tan, and Amita Misra. 2022. Evaluating Machine Translation in Cross-lingual E-Commerce Search. In Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track), pages 322–334, Orlando, USA. Association for Machine Translation in the Americas.
Cite (Informal):
Evaluating Machine Translation in Cross-lingual E-Commerce Search (Zhang et al., AMTA 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.amta-research.25.pdf