German Voter Personas Can Radicalize LLM Chatbots via the Echo Chamber Effect

Maximilian Bleick, Nils Feldhus, Aljoscha Burchardt, Sebastian Möller


Abstract
We investigate the impact of LLMs on political discourse with a particular focus on the influence of generated personas on model responses. We find an echo chamber effect from LLM chatbots when provided with German-language biographical information of politicians and voters in German politics, leading to sycophantic responses and the reinforcement of existing political biases. Findings reveal that personas of certain political party, such as those of the ‘Alternative für Deutschland’ party, exert a stronger influence on LLMs, potentially amplifying extremist views. Unlike prior studies, we cannot corroborate a tendency for larger models to exert stronger sycophantic behaviour. We propose that further development should aim at reducing sycophantic behaviour in LLMs across all sizes and diversifying language capabilities in LLMs to enhance inclusivity.
Anthology ID:
2024.inlg-main.13
Volume:
Proceedings of the 17th International Natural Language Generation Conference
Month:
September
Year:
2024
Address:
Tokyo, Japan
Editors:
Saad Mahamood, Nguyen Le Minh, Daphne Ippolito
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
153–164
Language:
URL:
https://aclanthology.org/2024.inlg-main.13
DOI:
Bibkey:
Cite (ACL):
Maximilian Bleick, Nils Feldhus, Aljoscha Burchardt, and Sebastian Möller. 2024. German Voter Personas Can Radicalize LLM Chatbots via the Echo Chamber Effect. In Proceedings of the 17th International Natural Language Generation Conference, pages 153–164, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
German Voter Personas Can Radicalize LLM Chatbots via the Echo Chamber Effect (Bleick et al., INLG 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.inlg-main.13.pdf