<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="premasiri-etal-2023-model">
    <titleInfo>
        <title>Can Model Fusing Help Transformers in Long Document Classification? An Empirical Study</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Damith</namePart>
        <namePart type="family">Premasiri</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Tharindu</namePart>
        <namePart type="family">Ranasinghe</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Ruslan</namePart>
        <namePart type="family">Mitkov</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Ruslan</namePart>
            <namePart type="family">Mitkov</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Galia</namePart>
            <namePart type="family">Angelova</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>INCOMA Ltd., Shoumen, Bulgaria</publisher>
            <place>
                <placeTerm type="text">Varna, Bulgaria</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Text classification is an area of research which has been studied over the years in Natural Language Processing (NLP). Adapting NLP to multiple domains has introduced many new challenges for text classification and one of them is long document classification. While state-of-the-art transformer models provide excellent results in text classification, most of them have limitations in the maximum sequence length of the input sequence. The majority of the transformer models are limited to 512 tokens, and therefore, they struggle with long document classification problems. In this research, we explore on employing Model Fusing for long document classification while comparing the results with well-known BERT and Longformer architectures.</abstract>
    <identifier type="citekey">premasiri-etal-2023-model</identifier>
    <location>
        <url>https://aclanthology.org/2023.ranlp-1.94</url>
    </location>
    <part>
        <date>2023-09</date>
        <extent unit="page">
            <start>871</start>
            <end>878</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Can Model Fusing Help Transformers in Long Document Classification? An Empirical Study
%A Premasiri, Damith
%A Ranasinghe, Tharindu
%A Mitkov, Ruslan
%Y Mitkov, Ruslan
%Y Angelova, Galia
%S Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
%D 2023
%8 September
%I INCOMA Ltd., Shoumen, Bulgaria
%C Varna, Bulgaria
%F premasiri-etal-2023-model
%X Text classification is an area of research which has been studied over the years in Natural Language Processing (NLP). Adapting NLP to multiple domains has introduced many new challenges for text classification and one of them is long document classification. While state-of-the-art transformer models provide excellent results in text classification, most of them have limitations in the maximum sequence length of the input sequence. The majority of the transformer models are limited to 512 tokens, and therefore, they struggle with long document classification problems. In this research, we explore on employing Model Fusing for long document classification while comparing the results with well-known BERT and Longformer architectures.
%U https://aclanthology.org/2023.ranlp-1.94
%P 871-878

Markdown (Informal)

[Can Model Fusing Help Transformers in Long Document Classification? An Empirical Study](https://aclanthology.org/2023.ranlp-1.94) (Premasiri et al., RANLP 2023)

• Can Model Fusing Help Transformers in Long Document Classification? An Empirical Study (Premasiri et al., RANLP 2023)

ACL

• Damith Premasiri, Tharindu Ranasinghe, and Ruslan Mitkov. 2023. Can Model Fusing Help Transformers in Long Document Classification? An Empirical Study. In Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing, pages 871–878, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.