<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="borisova-etal-2024-surveying">
    <titleInfo>
        <title>Surveying the FAIRness of Annotation Tools: Difficult to find, difficult to reuse</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Ekaterina</namePart>
        <namePart type="family">Borisova</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Raia</namePart>
        <namePart type="family">Abu Ahmad</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Leyla</namePart>
        <namePart type="family">Garcia-Castro</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Ricardo</namePart>
        <namePart type="family">Usbeck</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Georg</namePart>
        <namePart type="family">Rehm</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-03</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of The 18th Linguistic Annotation Workshop (LAW-XVIII)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Sophie</namePart>
            <namePart type="family">Henning</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Manfred</namePart>
            <namePart type="family">Stede</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">St. Julians, Malta</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In the realm of Machine Learning and Deep Learning, there is a need for high-quality annotated data to train and evaluate supervised models. An extensive number of annotation tools have been developed to facilitate the data labelling process. However, finding the right tool is a demanding task involving thorough searching and testing. Hence, to effectively navigate the multitude of tools, it becomes essential to ensure their findability, accessibility, interoperability, and reusability (FAIR). This survey addresses the FAIRness of existing annotation software by evaluating 50 different tools against the FAIR principles for research software (FAIR4RS). The study indicates that while being accessible and interoperable, annotation tools are difficult to find and reuse. In addition, there is a need to establish community standards for annotation software development, documentation, and distribution.</abstract>
    <identifier type="citekey">borisova-etal-2024-surveying</identifier>
    <location>
        <url>https://aclanthology.org/2024.law-1.4</url>
    </location>
    <part>
        <date>2024-03</date>
        <extent unit="page">
            <start>29</start>
            <end>45</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Surveying the FAIRness of Annotation Tools: Difficult to find, difficult to reuse
%A Borisova, Ekaterina
%A Abu Ahmad, Raia
%A Garcia-Castro, Leyla
%A Usbeck, Ricardo
%A Rehm, Georg
%Y Henning, Sophie
%Y Stede, Manfred
%S Proceedings of The 18th Linguistic Annotation Workshop (LAW-XVIII)
%D 2024
%8 March
%I Association for Computational Linguistics
%C St. Julians, Malta
%F borisova-etal-2024-surveying
%X In the realm of Machine Learning and Deep Learning, there is a need for high-quality annotated data to train and evaluate supervised models. An extensive number of annotation tools have been developed to facilitate the data labelling process. However, finding the right tool is a demanding task involving thorough searching and testing. Hence, to effectively navigate the multitude of tools, it becomes essential to ensure their findability, accessibility, interoperability, and reusability (FAIR). This survey addresses the FAIRness of existing annotation software by evaluating 50 different tools against the FAIR principles for research software (FAIR4RS). The study indicates that while being accessible and interoperable, annotation tools are difficult to find and reuse. In addition, there is a need to establish community standards for annotation software development, documentation, and distribution.
%U https://aclanthology.org/2024.law-1.4
%P 29-45

Markdown (Informal)

[Surveying the FAIRness of Annotation Tools: Difficult to find, difficult to reuse](https://aclanthology.org/2024.law-1.4) (Borisova et al., LAW-WS 2024)

• Surveying the FAIRness of Annotation Tools: Difficult to find, difficult to reuse (Borisova et al., LAW-WS 2024)

ACL

• Ekaterina Borisova, Raia Abu Ahmad, Leyla Garcia-Castro, Ricardo Usbeck, and Georg Rehm. 2024. Surveying the FAIRness of Annotation Tools: Difficult to find, difficult to reuse. In Proceedings of The 18th Linguistic Annotation Workshop (LAW-XVIII), pages 29–45, St. Julians, Malta. Association for Computational Linguistics.