Abstract
Presidential debates are one of the most salient moments of a presidential campaign, where candidates are challenged to discuss the main contemporary and historical issues in a country. These debates represent a natural ground for argumentative analysis, which has been always employed to investigate political discourse structure in philosophy and linguistics. In this paper, we take the challenge to analyse these debates from the topic modeling and framing perspective, to enrich the investigation of these data. Our contribution is threefold: first, we apply transformer-based language models (i.e., BERT and RoBERTa) to the classification of generic frames showing that these models improve the results presented in the literature for frame identification; second, we investigate the task of topic modelling in political arguments from the U.S. presidential campaign debates, applying an unsupervised machine learning approach; and finally, we discuss various visualisations of the identified topics and frames from these U.S. presidential election debates to allow a further interpretation of such data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
C stands for cluster.
- 4.
For more details, see https://github.com/dallascard/media_frames_corpus.
References
Ajjour, Y., Alshomary, M., Wachsmuth, H., Stein, B.: Modeling frames in argumentation. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 2922–2932. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/D19-1290, https://www.aclweb.org/anthology/D19-1290
Artstein, R., Poesio, M.: Inter-coder agreement for computational linguistics. Comput. Linguist. 34(4), 555–596 (2008). https://doi.org/10.1162/coli.07-034-R2, https://direct.mit.edu/coli/article/34/4/555-596/1999
Boydstun, A.E., Glazier, R.A., Pietryka, M.T.: Playing to the crowd: agenda control in presidential debates. Polit. Commun. 30(2), 254–277 (2013). https://doi.org/10.1162/coli.07-034-R2, https://www.tandfonline.com/doi/abs/10.1080/10584609.2012.737423
Boydstun, A.E., Gross, J.H., Resnik, P., Smith, N.A.: Identifying media frames and frame dynamics within and across policy issues. In: New Directions in Analyzing Text as Data Workshop, London (2013)
Card, D., Boydstun, A.E., Gross, J.H., Resnik, P., Smith, N.A.: The media frames corpus: annotations of frames across issues. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 438–444. Association for Computational Linguistics (2015). https://doi.org/10.3115/v1/P15-2072, https://www.aclweb.org/anthology/P15-2072
Chakrabarty, T., Hidey, C., Muresan, S.: ENTRUST: argument reframing with language models and entailment. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 4958–4971. Association for Computational Linguistics (2021). https://doi.org/10.18653/v1/2021.naacl-main.394, https://aclanthology.org/2021.naacl-main.394
Chen, W.F., Al Khatib, K., Stein, B., Wachsmuth, H.: Controlled neural sentence-level reframing of news articles. In: Findings of the Association for Computational Linguistics: EMNLP 2021, pp. 2683–2693. Association for Computational Linguistics (2021). https://aclanthology.org/2021.findings-emnlp.228
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of NAACL-HLT 2019, pp. 4171–4186 (2019). https://doi.org/10.18653/v1/n19-1423
Dumani, L., Wiesenfeldt, T., Schenkel, R.: Fine and coarse granular argument classification before clustering. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, CIKM 2021, pp. 422–432. Association for Computing Machinery (2021). https://doi.org/10.1145/3459637.3482431
Entman, R.M.: Framing: toward clarification of a fractured paradigm. J. Commun. 43(4), 51–58 (1993). https://doi.org/10.1111/j.1460-2466.1993.tb01304.x, https://academic.oup.com/joc/article/43/4/51-58/4160153
George Lakoff: The ALL NEW Don’t Think of an Elephant!: Know Your Values and Frame the Debate. Chelsea Green Publishing (2014). google-Books-ID: FSqPBAAAQBAJ
Goffredo, P., Haddadan, S., Vorakitphan, V., Cabrio, E., Villata, S.: Fallacious argument classification in political debates. In: Raedt, L.D. (ed.) Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022, Vienna, Austria, 23–29 July 2022, pp. 4143–4149. ijcai.org (2022). https://doi.org/10.24963/ijcai.2022/575
Grootendorst, M., Reimers, N.: MaartenGr/BERTopic: v0.9.3 - quickfix. Zenodo (2021). https://doi.org/10.5281/zenodo.5574296
Haddadan, S., Cabrio, E., Villata, S.: Yes, we can! mining arguments in 50 years of US presidential campaign debates. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 4684–4690. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/P19-1463, https://www.aclweb.org/anthology/P19-1463
Hartmann, M., Jansen, T., Augenstein, I., Søgaard, A.: Issue framing in online discussion fora. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 1401–1407. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/N19-1142, https://aclanthology.org/N19-1142
Liu, Y., et al.: Roberta: a robustly optimized bert pretraining approach. CoRR abs/1907.11692 (2019). https://arxiv.org/abs/1907.11692
Loper, E., Bird, S.: NLTK: the natural language toolkit (2002). arXiv:cs/0205028, https://arxiv.org/abs/cs/0205028
McInnes, L., Healy, J., Astels, S.: HDBSCAN: hierarchical density based clustering. J. Open Source Softw. 2(11), 205 (2017). https://doi.org/10.21105/joss.00205, https://joss.theoj.org/papers/10.21105/joss.00205
McInnes, L., Healy, J., Melville, J.: UMAP: uniform manifold approximation and projection for dimension reduction (2020). arXiv:1802.03426 [cs, stat], https://arxiv.org/abs/1802.03426
Naderi, N., Hirst, G.: Classifying frames at the sentence level in news articles. In: Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017, pp. 536–542. INCOMA Ltd. (2017–09). https://doi.org/10.26615/978-954-452-049-6_070
Nguyen, V.A., Boyd-Graber, J., Resnik, P., Miler, K.: Tea party in the house: a hierarchical ideal point topic model and its application to republican legislators in the 112th congress. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 1438–1448. Association for Computational Linguistics (2015). https://doi.org/10.3115/v1/P15-1139, https://aclweb.org/anthology/P15-1139
Reimers, N., Gurevych, I.: Sentence-BERT: sentence embeddings using Siamese BERT-networks. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 3982–3992. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/D19-1410, https://www.aclweb.org/anthology/D19-1410
Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 815–823. IEEE (2015). https://doi.org/10.1109/CVPR.2015.7298682, https://ieeexplore.ieee.org/document/7298682/
Swanson, R., Ecker, B., Walker, M.: Argument mining: extracting arguments from online dialogue. In: Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pp. 217–226. Association for Computational Linguistics (2015). https://doi.org/10.18653/v1/W15-4631, https://aclanthology.org/W15-4631
Tsur, O., Calacci, D., Lazer, D.: A frame of mind: using statistical models for detection of framing and agenda setting campaigns. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 1629–1638. Association for Computational Linguistics (2015). https://doi.org/10.3115/v1/P15-1157, https://aclweb.org/anthology/P15-1157
Xia, L., Luo, D., Zhang, C., Wu, Z.: A survey of topic models in text classification. In: 2019 2nd International Conference on Artificial Intelligence and Big Data (ICAIBD), pp. 244–250 (2019). https://doi.org/10.1109/ICAIBD.2019.8836970
Acknowledgments
This work was partly supported by the French government, through the 3IA Côte d’Azur Investments in the Future project managed by the National Research Agency (ANR) with the reference number ANR-19-P3IA-0002. This work was partly supported also by EU Horizon 2020 project AI4Media, under contract no. 951911 (https://ai4media.eu/), and MIREL (http://www.mirelproject.eu/), under contract no. 690974. Shohreh Haddadan hereby acknowledges that this research is supported by the Luxembourg National Research Fund (FNR) (10929115).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Haddadan, S., Cabrio, E., Soto, A.J., Villata, S. (2023). Topic Modelling and Frame Identification for Political Arguments. In: Dovier, A., Montanari, A., Orlandini, A. (eds) AIxIA 2022 – Advances in Artificial Intelligence. AIxIA 2022. Lecture Notes in Computer Science(), vol 13796. Springer, Cham. https://doi.org/10.1007/978-3-031-27181-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-031-27181-6_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-27180-9
Online ISBN: 978-3-031-27181-6
eBook Packages: Computer ScienceComputer Science (R0)