<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="a-augenstein-2020-2kenize">
    <titleInfo>
        <title>2kenize: Tying Subword Sequences for Chinese Script Conversion</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Pranav</namePart>
        <namePart type="family">A</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Isabelle</namePart>
        <namePart type="family">Augenstein</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Dan</namePart>
            <namePart type="family">Jurafsky</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Joyce</namePart>
            <namePart type="family">Chai</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Natalie</namePart>
            <namePart type="family">Schluter</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Joel</namePart>
            <namePart type="family">Tetreault</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Simplified Chinese to Traditional Chinese character conversion is a common preprocessing step in Chinese NLP. Despite this, current approaches have insufficient performance because they do not take into account that a simplified Chinese character can correspond to multiple traditional characters. Here, we propose a model that can disambiguate between mappings and convert between the two scripts. The model is based on subword segmentation, two language models, as well as a method for mapping between subword sequences. We further construct benchmark datasets for topic classification and script conversion. Our proposed method outperforms previous Chinese Character conversion approaches by 6 points in accuracy. These results are further confirmed in a downstream application, where 2kenize is used to convert pretraining dataset for topic classification. An error analysis reveals that our method‘s particular strengths are in dealing with code mixing and named entities.</abstract>
    <identifier type="citekey">a-augenstein-2020-2kenize</identifier>
    <identifier type="doi">10.18653/v1/2020.acl-main.648</identifier>
    <location>
        <url>https://aclanthology.org/2020.acl-main.648/</url>
    </location>
    <part>
        <date>2020-07</date>
        <extent unit="page">
            <start>7257</start>
            <end>7272</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T 2kenize: Tying Subword Sequences for Chinese Script Conversion
%A A, Pranav
%A Augenstein, Isabelle
%Y Jurafsky, Dan
%Y Chai, Joyce
%Y Schluter, Natalie
%Y Tetreault, Joel
%S Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
%D 2020
%8 July
%I Association for Computational Linguistics
%C Online
%F a-augenstein-2020-2kenize
%X Simplified Chinese to Traditional Chinese character conversion is a common preprocessing step in Chinese NLP. Despite this, current approaches have insufficient performance because they do not take into account that a simplified Chinese character can correspond to multiple traditional characters. Here, we propose a model that can disambiguate between mappings and convert between the two scripts. The model is based on subword segmentation, two language models, as well as a method for mapping between subword sequences. We further construct benchmark datasets for topic classification and script conversion. Our proposed method outperforms previous Chinese Character conversion approaches by 6 points in accuracy. These results are further confirmed in a downstream application, where 2kenize is used to convert pretraining dataset for topic classification. An error analysis reveals that our method‘s particular strengths are in dealing with code mixing and named entities.
%R 10.18653/v1/2020.acl-main.648
%U https://aclanthology.org/2020.acl-main.648/
%U https://doi.org/10.18653/v1/2020.acl-main.648
%P 7257-7272

Markdown (Informal)

[2kenize: Tying Subword Sequences for Chinese Script Conversion](https://aclanthology.org/2020.acl-main.648/) (A & Augenstein, ACL 2020)

• 2kenize: Tying Subword Sequences for Chinese Script Conversion (A & Augenstein, ACL 2020)

ACL

• Pranav A and Isabelle Augenstein. 2020. 2kenize: Tying Subword Sequences for Chinese Script Conversion. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7257–7272, Online. Association for Computational Linguistics.