Exploring Two Decades of Parliamentary Speeches on the Use of Narratives
Paper · 2026 · Matti Wiegmann, Jürgen Neyer and Benno Stein
Summary
Political scientists want to track how support for broad narratives changes over time. These narratives are seldom named explicitly, so keyword or metadata counts fail, and close reading cannot scale to decades of debate. The authors instead have an LLM judge, passage by passage, whether a text backs a given narrative, then count positive judgements per month to build a time series. They apply this to two rival views of European sovereignty: supranationalism (EU institutions should hold power) and nationalism (member states should). The data are 137,844 European Parliament speeches from 2006 onward, split into paragraphs and grouped by topic with BERTopic. On an expert-annotated test set, the prompt-based classifier reaches about 0.85 balanced accuracy with Qwen3-32B and roughly 0.75 with Qwen3-8B. The per-topic curves differ meaningfully over time and line up with real-world events. However, some topics are skewed toward one narrative, and sparsely discussed topics yield noisy signals. Developed jointly with political scientists, the pipeline is a practical starting point for diachronic discourse research.
Key points
- Corpus: 137,844 EP speeches collected by Husmann and Wiegmann (2025), divided into 474,545 paragraphs. The paper gives the end year inconsistently as 2022 and 2023.
- Test set: 400 keyword-sampled paragraphs (200 per narrative) were labelled by two political science graduate students. Krippendorff's α was 0.67–0.79, and the 367 unanimous cases were kept.
- Prompt and models:
- The prompt combines expert-written narrative definitions, filtering steps for off-topic passages, a chain-of-thought explanation, and four ICL examples.
- Five models were compared: Llama-8B, Phi-4-4B, Qwen3-8B, Qwen3-32B and GPT-5.1-mini.
- Balanced accuracy was the metric, since the test set is small and imbalanced.
- Topic modelling: BERTopic with all-mpnet-base-v2, UMAP (10 components, 20 neighbours) and HDBSCAN (minimum cluster size 100).
- Temporal aggregation:
- The core signal is monthly positive counts per narrative and the share of supranational positives among all positives.
- Only months with ≥10 positives are counted, and a B-spline smooths the ratio.
- Density and prevalence scores help judge how reliable each topic's signal is.
Institutions
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 18,614 worksArtificial Intelligence · 17,965 worksArts and Humanities · 17,450 worksLanguage and Linguistics · 17,296 worksSocial Sciences · 1,954 worksGeneral Social Sciences · 254 works
Cite
Cite as Matti Wiegmann, Jürgen Neyer and Benno Stein. 2026. Exploring Two Decades of Parliamentary Speeches on the Use of Narratives. Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026).
@inproceedings{wiegmann2026exploring,
title = {{Exploring Two Decades of Parliamentary Speeches on the Use of Narratives}},
author = {Matti Wiegmann, Jürgen Neyer and Benno Stein},
booktitle = {Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026)},
year = {2026},
doi = {10.63317/4vdcyy75sgyv},
url = {https://doi.org/10.63317/4vdcyy75sgyv}
}References
- Jean-François Lyotard. 1994. The postmodern condition. The postmodern turn: new perspectives on modern theory, pages 27–38. find
- H. Porter Abbott. 2008. The Cambridge Introduction to Narrative. Cambridge University Press. find
- G Federico Mancini. 1998. Europe: the case for statehood. Eur. LJ, 4:29. find
- Paul Bleakley. 2021. Panic, pizza and mainstreaming the alt-right: A social media analysis of pizzagate and the rise of the qanon conspiracy. Current Sociology, 71:509 – 525. find
- J. D. Moffitt, Catherine King, and Kathleen M. Carley. 2021. Hunting conspiracy theories during the covid-19 pandemic. Social Media + Society, 7. find
- Christian Bueger. 2013. Practice, pirates and coast guards: the grand narrative of somali piracy. Third World Quarterly, 34(10):1811–1827. find
- Andrew Moravcsik. 2013. The choice for Europe: Social purpose and state power from Messina to Maastricht. Routledge. find
- Catherine E. De Vries. 2023. How foundational narratives shape european union politics. JCMS: Journal of Common Market Studies, 61(4):867– 881. find
- Andrew Piper, Richard Jean So, and David Bamman. 2021. Narrative theory for computational narrative understanding. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021, pages 298–311… find
- Neele Falk and Gabriella Lapesa. 2023. Storyarg: a corpus of narratives and personal experiences in argumentative texts. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2350–2372. find
- Mark A. Pollack. 2003. The engines of European integration: Delegation, agency, and agenda setting in the EU. OUP Oxford. find
- Gérard Genette. 1980. Narrative discourse: An essay in method, volume 3. Cornell University Press. find
- Berthold Rittberger. 2003. The creation and empowerment of the european parliament. JCMS: Journal of Common Market Studies, 41(2):203– 225. find
- Anneke de Graaf, José Sanders, and Hans Hoeken. 2016. Characteristics of narrative interventions and health effects: A review of the content, form, and context of narratives in health-related narrative persuasion research. Review of communication research, 4:88–131. find
- Shaul Shenhav. 2015. Analyzing social narratives. Routledge. find
- Alec Stone Sweet and Wayne Sandholtz. 1997. European integration and supranational governance. Journal of European public policy, 4(3):297–317. find
- Maarten Grootendorst. 2022. Bertopic: Neural topic modeling with a class-based tf-idf procedure. arXiv preprint arXiv:2203.05794.
- Jonas Tallberg. 2008. Bargaining power in the european council. JCMS: journal of common market studies, 46(3):685–708. find
- Sven Husmann and Matti Wiegmann. 2025. European parliament speeches 2002-2022. find
- Yael R Kaplan, Tamir Sheafer, and Shaul R Shenhav. 2022. Do we have something in common? understanding national identities through a meta-narrative analysis. Nations and Nationalism, 28(4):1152–1172. find
- Timothy R. Tangherlini, Shadi Shahsavari, Behnam Shahbazi, Ehsan Ebrahimzadeh, and Vwani P. Roychowdhury. 2020. An automated pipeline for the discovery of conspiracy and conspiracy theory narrative frameworks: Bridgegate, pizzagate and storytelling on the web. PLoS ONE, 15. find
- Damir Korenčić, Berta Chulvi, Xavier Bonet Casals, Alejandro Toselli, Mariona Taulé, and Paolo Rosso. 2024. What distinguishes conspiracy from critical narratives? a computational analysis of oppositional discourse. Expert Systems, 41(11):e13671. find
- Wanying Zhao, Fiona Guo, Kristina Lerman, and Yong-Yeol Ahn. 2023. Discovering collective narratives shifts in online discussions. In International Conference on Web and Social Media. find
- Yuanyuan Lei and Ruihong Huang. 2023. Identifying conspiracy theories news based on event relation graph. ArXiv, abs/2310.18545. find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/wiegmann-2026-exploring-two-decades-parliamentary-speeches/