<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="laverghetta-jr-licato-2022-developmental">
    <titleInfo>
        <title>Developmental Negation Processing in Transformer Language Models</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Antonio</namePart>
        <namePart type="family">Laverghetta Jr.</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">John</namePart>
        <namePart type="family">Licato</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Smaranda</namePart>
            <namePart type="family">Muresan</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Preslav</namePart>
            <namePart type="family">Nakov</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Aline</namePart>
            <namePart type="family">Villavicencio</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Dublin, Ireland</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Reasoning using negation is known to be difficult for transformer-based language models. While previous studies have used the tools of psycholinguistics to probe a transformer’s ability to reason over negation, none have focused on the types of negation studied in developmental psychology. We explore how well transformers can process such categories of negation, by framing the problem as a natural language inference (NLI) task. We curate a set of diagnostic questions for our target categories from popular NLI datasets and evaluate how well a suite of models reason over them. We find that models perform consistently better only on certain categories, suggesting clear distinctions in how they are processed.</abstract>
    <identifier type="citekey">laverghetta-jr-licato-2022-developmental</identifier>
    <identifier type="doi">10.18653/v1/2022.acl-short.60</identifier>
    <location>
        <url>https://aclanthology.org/2022.acl-short.60</url>
    </location>
    <part>
        <date>2022-05</date>
        <extent unit="page">
            <start>545</start>
            <end>551</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Developmental Negation Processing in Transformer Language Models
%A Laverghetta Jr., Antonio
%A Licato, John
%Y Muresan, Smaranda
%Y Nakov, Preslav
%Y Villavicencio, Aline
%S Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
%D 2022
%8 May
%I Association for Computational Linguistics
%C Dublin, Ireland
%F laverghetta-jr-licato-2022-developmental
%X Reasoning using negation is known to be difficult for transformer-based language models. While previous studies have used the tools of psycholinguistics to probe a transformer’s ability to reason over negation, none have focused on the types of negation studied in developmental psychology. We explore how well transformers can process such categories of negation, by framing the problem as a natural language inference (NLI) task. We curate a set of diagnostic questions for our target categories from popular NLI datasets and evaluate how well a suite of models reason over them. We find that models perform consistently better only on certain categories, suggesting clear distinctions in how they are processed.
%R 10.18653/v1/2022.acl-short.60
%U https://aclanthology.org/2022.acl-short.60
%U https://doi.org/10.18653/v1/2022.acl-short.60
%P 545-551

Markdown (Informal)

[Developmental Negation Processing in Transformer Language Models](https://aclanthology.org/2022.acl-short.60) (Laverghetta Jr. & Licato, ACL 2022)

• Developmental Negation Processing in Transformer Language Models (Laverghetta Jr. & Licato, ACL 2022)

ACL

• Antonio Laverghetta Jr. and John Licato. 2022. Developmental Negation Processing in Transformer Language Models. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 545–551, Dublin, Ireland. Association for Computational Linguistics.