Hate Speech Criteria: A Modular Approach to Task-Specific Hate Speech Definitions

Urja Khurana, Ivar Vermeulen, Eric Nalisnick, Marloes Van Noorloos, Antske Fokkens


Abstract
The subjectivity of automatic hate speech detection makes it a complex task, reflected in different and incomplete definitions in NLP. We present hate speech criteria, developed with insights from a law and social science expert, that help researchers create more explicit definitions and annotation guidelines on five aspects: (1) target groups and (2) dominance, (3) perpetrator characteristics, (4) explicit presence of negative interactions, and the (5) type of consequences/effects. Definitions can be structured so that they cover a more broad or more narrow phenomenon and conscious choices can be made on specifying criteria or leaving them open. We argue that the goal and exact task developers have in mind should determine how the scope of hate speech is defined. We provide an overview of the properties of datasets from hatespeechdata.com that may help select the most suitable dataset for a specific scenario.
Anthology ID:
2022.woah-1.17
Volume:
Proceedings of the Sixth Workshop on Online Abuse and Harms (WOAH)
Month:
July
Year:
2022
Address:
Seattle, Washington (Hybrid)
Editors:
Kanika Narang, Aida Mostafazadeh Davani, Lambert Mathias, Bertie Vidgen, Zeerak Talat
Venue:
WOAH
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
176–191
Language:
URL:
https://aclanthology.org/2022.woah-1.17
DOI:
10.18653/v1/2022.woah-1.17
Bibkey:
Cite (ACL):
Urja Khurana, Ivar Vermeulen, Eric Nalisnick, Marloes Van Noorloos, and Antske Fokkens. 2022. Hate Speech Criteria: A Modular Approach to Task-Specific Hate Speech Definitions. In Proceedings of the Sixth Workshop on Online Abuse and Harms (WOAH), pages 176–191, Seattle, Washington (Hybrid). Association for Computational Linguistics.
Cite (Informal):
Hate Speech Criteria: A Modular Approach to Task-Specific Hate Speech Definitions (Khurana et al., WOAH 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.woah-1.17.pdf
Video:
 https://aclanthology.org/2022.woah-1.17.mp4
Data
Hate Speech