<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="mahamood-2023-reproduction">
    <titleInfo>
        <title>Reproduction of Human Evaluations in: “It’s not Rocket Science: Interpreting Figurative Language in Narratives”</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Saad</namePart>
        <namePart type="family">Mahamood</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 3rd Workshop on Human Evaluation of NLP Systems</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Anya</namePart>
            <namePart type="family">Belz</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Maja</namePart>
            <namePart type="family">Popović</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ehud</namePart>
            <namePart type="family">Reiter</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Craig</namePart>
            <namePart type="family">Thomson</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">João</namePart>
            <namePart type="family">Sedoc</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>INCOMA Ltd., Shoumen, Bulgaria</publisher>
            <place>
                <placeTerm type="text">Varna, Bulgaria</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We describe in this paper an attempt to reproduce some of the human of evaluation results from the paper “It’s not Rocket Science: Interpreting Figurative Language in Narratives”. In particular, we describe the methodology used to reproduce the chosen human evaluation, the challenges faced, and the results that were gathered. We will also make some recommendations on the learnings obtained from this reproduction attempt and what improvements are needed to enable more robust reproductions of future NLP human evaluations.</abstract>
    <identifier type="citekey">mahamood-2023-reproduction</identifier>
    <location>
        <url>https://aclanthology.org/2023.humeval-1.16</url>
    </location>
    <part>
        <date>2023-09</date>
        <extent unit="page">
            <start>204</start>
            <end>209</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Reproduction of Human Evaluations in: “It’s not Rocket Science: Interpreting Figurative Language in Narratives”
%A Mahamood, Saad
%Y Belz, Anya
%Y Popović, Maja
%Y Reiter, Ehud
%Y Thomson, Craig
%Y Sedoc, João
%S Proceedings of the 3rd Workshop on Human Evaluation of NLP Systems
%D 2023
%8 September
%I INCOMA Ltd., Shoumen, Bulgaria
%C Varna, Bulgaria
%F mahamood-2023-reproduction
%X We describe in this paper an attempt to reproduce some of the human of evaluation results from the paper “It’s not Rocket Science: Interpreting Figurative Language in Narratives”. In particular, we describe the methodology used to reproduce the chosen human evaluation, the challenges faced, and the results that were gathered. We will also make some recommendations on the learnings obtained from this reproduction attempt and what improvements are needed to enable more robust reproductions of future NLP human evaluations.
%U https://aclanthology.org/2023.humeval-1.16
%P 204-209

Markdown (Informal)

[Reproduction of Human Evaluations in: “It’s not Rocket Science: Interpreting Figurative Language in Narratives”](https://aclanthology.org/2023.humeval-1.16) (Mahamood, HumEval-WS 2023)

• Reproduction of Human Evaluations in: “It’s not Rocket Science: Interpreting Figurative Language in Narratives” (Mahamood, HumEval-WS 2023)

ACL

• Saad Mahamood. 2023. Reproduction of Human Evaluations in: “It’s not Rocket Science: Interpreting Figurative Language in Narratives”. In Proceedings of the 3rd Workshop on Human Evaluation of NLP Systems, pages 204–209, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.