[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

Unraveling the Dynamics of Semi-Supervised Hate Speech Detection: The Impact of Unlabeled Data Characteristics and Pseudo-Labeling Strategies

Florian Ludwig, Klara Dolos, Ana Alves-Pinto, Torsten Zesch


Abstract
Despite advances in machine learning based hate speech detection, the need for larges amounts of labeled training data for state-of-the-art approaches remains a challenge for their application. Semi-supervised learning addresses this problem by leveraging unlabeled data and thus reducing the amount of annotated data required. Underlying this approach is the assumption that labeled and unlabeled data follow similar distributions. This assumption however may not always hold, with consequences for real world applications. We address this problem by investigating the dynamics of pseudo-labeling, a commonly employed form of semi-supervised learning, in the context of hate speech detection. Concretely we analysed the influence of data characteristics and of two strategies for selecting pseudo-labeled samples: threshold- and ratio-based. The results show that the influence of data characteristics on the pseudo-labeling performances depends on other factors, such as pseudo-label selection strategies or model biases. Furthermore, the effectiveness of pseudo-labeling in classification performance is determined by the interaction between the number, hate ratio and accuracy of the selected pseudo-labels. Analysis of the results suggests an advantage of the threshold-based approach when labeled and unlabeled data arise from the same domain, whilst the ratio-based approach may be recommended in the opposite situation.
Anthology ID:
2024.findings-eacl.133
Volume:
Findings of the Association for Computational Linguistics: EACL 2024
Month:
March
Year:
2024
Address:
St. Julian’s, Malta
Editors:
Yvette Graham, Matthew Purver
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1974–1986
Language:
URL:
https://aclanthology.org/2024.findings-eacl.133
DOI:
Bibkey:
Cite (ACL):
Florian Ludwig, Klara Dolos, Ana Alves-Pinto, and Torsten Zesch. 2024. Unraveling the Dynamics of Semi-Supervised Hate Speech Detection: The Impact of Unlabeled Data Characteristics and Pseudo-Labeling Strategies. In Findings of the Association for Computational Linguistics: EACL 2024, pages 1974–1986, St. Julian’s, Malta. Association for Computational Linguistics.
Cite (Informal):
Unraveling the Dynamics of Semi-Supervised Hate Speech Detection: The Impact of Unlabeled Data Characteristics and Pseudo-Labeling Strategies (Ludwig et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-eacl.133.pdf
Software:
 2024.findings-eacl.133.software.zip