HAMiSoN-Generative at ClimateActivism 2024: Stance Detection using generative large language models

Jesus M. Fraile-Hernandez, Anselmo Peñas


Abstract
CASE in EACL 2024 proposes the shared task on Hate Speech and Stance Detection during Climate Activism. In our participation in the stance detection task, we have tested different approaches using LLMs for this classification task. We have tested a generative model using the classical seq2seq structure. Subsequently, we have considerably improved the results by replacing the last layer of these LLMs with a classifier layer. We have also studied how the performance is affected by the amount of data used in training. For this purpose, a partition of the dataset has been used and external data from posture detection tasks has been added.
Anthology ID:
2024.case-1.10
Volume:
Proceedings of the 7th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2024)
Month:
March
Year:
2024
Address:
St. Julians, Malta
Editors:
Ali Hürriyetoğlu, Hristo Tanev, Surendrabikram Thapa, Gökçe Uludoğan
Venues:
CASE | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
79–84
Language:
URL:
https://aclanthology.org/2024.case-1.10
DOI:
Bibkey:
Cite (ACL):
Jesus M. Fraile-Hernandez and Anselmo Peñas. 2024. HAMiSoN-Generative at ClimateActivism 2024: Stance Detection using generative large language models. In Proceedings of the 7th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2024), pages 79–84, St. Julians, Malta. Association for Computational Linguistics.
Cite (Informal):
HAMiSoN-Generative at ClimateActivism 2024: Stance Detection using generative large language models (Fraile-Hernandez & Peñas, CASE-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.case-1.10.pdf
Supplementary material:
 2024.case-1.10.SupplementaryMaterial.txt
Video:
 https://aclanthology.org/2024.case-1.10.mp4