<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="han-etal-2022-simqa">
    <titleInfo>
        <title>SimQA: Detecting Simultaneous MT Errors through Word-by-Word Question Answering</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">HyoJung</namePart>
        <namePart type="family">Han</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Marine</namePart>
        <namePart type="family">Carpuat</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Jordan</namePart>
        <namePart type="family">Boyd-Graber</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Yoav</namePart>
            <namePart type="family">Goldberg</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Zornitsa</namePart>
            <namePart type="family">Kozareva</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yue</namePart>
            <namePart type="family">Zhang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Abu Dhabi, United Arab Emirates</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Detractors of neural machine translation admit that while its translations are fluent, it sometimes gets key facts wrong. This is particularly important in simultaneous interpretation where translations have to be provided as fast as possible: before a sentence is complete. Yet, evaluations of simultaneous machine translation (SimulMT) fail to capture if systems correctly translate the most salient elements of a question: people, places, and dates. To address this problem, we introduce a downstream word-by-word question answering evaluation task (SimQA): given a source language question, translate the question word by word into the target language, and answer as soon as possible. SimQA jointly measures whether the SimulMT models translate the question quickly and accurately, and can reveal shortcomings in existing neural systems—hallucinating or omitting facts.</abstract>
    <identifier type="citekey">han-etal-2022-simqa</identifier>
    <identifier type="doi">10.18653/v1/2022.emnlp-main.378</identifier>
    <location>
        <url>https://aclanthology.org/2022.emnlp-main.378/</url>
    </location>
    <part>
        <date>2022-12</date>
        <extent unit="page">
            <start>5598</start>
            <end>5616</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T SimQA: Detecting Simultaneous MT Errors through Word-by-Word Question Answering
%A Han, HyoJung
%A Carpuat, Marine
%A Boyd-Graber, Jordan
%Y Goldberg, Yoav
%Y Kozareva, Zornitsa
%Y Zhang, Yue
%S Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
%D 2022
%8 December
%I Association for Computational Linguistics
%C Abu Dhabi, United Arab Emirates
%F han-etal-2022-simqa
%X Detractors of neural machine translation admit that while its translations are fluent, it sometimes gets key facts wrong. This is particularly important in simultaneous interpretation where translations have to be provided as fast as possible: before a sentence is complete. Yet, evaluations of simultaneous machine translation (SimulMT) fail to capture if systems correctly translate the most salient elements of a question: people, places, and dates. To address this problem, we introduce a downstream word-by-word question answering evaluation task (SimQA): given a source language question, translate the question word by word into the target language, and answer as soon as possible. SimQA jointly measures whether the SimulMT models translate the question quickly and accurately, and can reveal shortcomings in existing neural systems—hallucinating or omitting facts.
%R 10.18653/v1/2022.emnlp-main.378
%U https://aclanthology.org/2022.emnlp-main.378/
%U https://doi.org/10.18653/v1/2022.emnlp-main.378
%P 5598-5616

Markdown (Informal)

[SimQA: Detecting Simultaneous MT Errors through Word-by-Word Question Answering](https://aclanthology.org/2022.emnlp-main.378/) (Han et al., EMNLP 2022)

• SimQA: Detecting Simultaneous MT Errors through Word-by-Word Question Answering (Han et al., EMNLP 2022)

ACL

• HyoJung Han, Marine Carpuat, and Jordan Boyd-Graber. 2022. SimQA: Detecting Simultaneous MT Errors through Word-by-Word Question Answering. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 5598–5616, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.