<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="moon-etal-2020-beep">
    <titleInfo>
        <title>BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Jihyung</namePart>
        <namePart type="family">Moon</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Won</namePart>
        <namePart type="given">Ik</namePart>
        <namePart type="family">Cho</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Junbum</namePart>
        <namePart type="family">Lee</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Lun-Wei</namePart>
            <namePart type="family">Ku</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Cheng-Te</namePart>
            <namePart type="family">Li</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Toxic comments in online platforms are an unavoidable social issue under the cloak of anonymity. Hate speech detection has been actively done for languages such as English, German, or Italian, where manually labeled corpus has been released. In this work, we first present 9.4K manually labeled entertainment news comments for identifying Korean toxic speech, collected from a widely used online news platform in Korea. The comments are annotated regarding social bias and hate speech since both aspects are correlated. The inter-annotator agreement Krippendorff’s alpha score is 0.492 and 0.496, respectively. We provide benchmarks using CharCNN, BiLSTM, and BERT, where BERT achieves the highest score on all tasks. The models generally display better performance on bias identification, since the hate speech detection is a more subjective issue. Additionally, when BERT is trained with bias label for hate speech detection, the prediction score increases, implying that bias and hate are intertwined. We make our dataset publicly available and open competitions with the corpus and benchmarks.</abstract>
    <identifier type="citekey">moon-etal-2020-beep</identifier>
    <identifier type="doi">10.18653/v1/2020.socialnlp-1.4</identifier>
    <location>
        <url>https://aclanthology.org/2020.socialnlp-1.4</url>
    </location>
    <part>
        <date>2020-07</date>
        <extent unit="page">
            <start>25</start>
            <end>31</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection
%A Moon, Jihyung
%A Cho, Won Ik
%A Lee, Junbum
%Y Ku, Lun-Wei
%Y Li, Cheng-Te
%S Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media
%D 2020
%8 July
%I Association for Computational Linguistics
%C Online
%F moon-etal-2020-beep
%X Toxic comments in online platforms are an unavoidable social issue under the cloak of anonymity. Hate speech detection has been actively done for languages such as English, German, or Italian, where manually labeled corpus has been released. In this work, we first present 9.4K manually labeled entertainment news comments for identifying Korean toxic speech, collected from a widely used online news platform in Korea. The comments are annotated regarding social bias and hate speech since both aspects are correlated. The inter-annotator agreement Krippendorff’s alpha score is 0.492 and 0.496, respectively. We provide benchmarks using CharCNN, BiLSTM, and BERT, where BERT achieves the highest score on all tasks. The models generally display better performance on bias identification, since the hate speech detection is a more subjective issue. Additionally, when BERT is trained with bias label for hate speech detection, the prediction score increases, implying that bias and hate are intertwined. We make our dataset publicly available and open competitions with the corpus and benchmarks.
%R 10.18653/v1/2020.socialnlp-1.4
%U https://aclanthology.org/2020.socialnlp-1.4
%U https://doi.org/10.18653/v1/2020.socialnlp-1.4
%P 25-31

Markdown (Informal)

[BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection](https://aclanthology.org/2020.socialnlp-1.4) (Moon et al., SocialNLP 2020)

• BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection (Moon et al., SocialNLP 2020)

ACL

• Jihyung Moon, Won Ik Cho, and Junbum Lee. 2020. BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection. In Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media, pages 25–31, Online. Association for Computational Linguistics.