The Face of Populism: Examining Differences in Facial Emotional Expressions of Political Leaders Using Machine Learning

Read original: arXiv:2304.09914 - Published 8/9/2024 by Sara Major, Aleksandar Tomav{s}evi'c
Total Score

0

💬

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper investigates the differences in emotional expressions of political leaders across 15 countries.
  • The researchers used deep learning to analyze the facial expressions in 220 YouTube videos of political leaders.
  • They examined the presence of 6 emotional states (anger, disgust, fear, happiness, sadness, and surprise) and a neutral expression in each video frame.
  • The deep learning model showed 53-60% agreement with human labels on a sample of manually coded images.
  • The study found statistically significant differences in the average score of negative emotions between groups of leaders with varying degrees of populist rhetoric.

Plain English Explanation

The study looked at how political leaders express emotions when speaking publicly. The researchers used a deep learning approach to analyze the facial expressions of 220 YouTube videos of leaders from 15 different countries. They measured the relative presence of 6 emotions (anger, disgust, fear, happiness, sadness, and surprise) as well as a neutral expression in each video frame.

By comparing the results to a sample of manually coded images, the researchers found that their deep learning model was able to detect these emotional expressions with 53-60% accuracy. This suggests the model was reasonably effective, though not perfect, at capturing the emotional content of the leaders' facial expressions.

The key finding was that there were statistically significant differences in the average levels of negative emotions between political leaders who used more populist rhetoric versus those who did not. This indicates that the emotional expressions of populist leaders may be distinctive compared to other politicians.

Technical Explanation

The researchers used a deep learning approach to analyze the facial expressions of 220 YouTube videos of political leaders from 15 different countries. They extracted the facial features from each video frame and then classified the relative presence of 6 emotional states (anger, disgust, fear, happiness, sadness, and surprise) as well as a neutral expression.

By comparing the model's predictions to a sample of manually coded images, the researchers found that their deep learning approach achieved 53-60% agreement with human labels. This suggests the model was able to capture the emotional content of the leaders' facial expressions with moderate accuracy.

The key finding was that there were statistically significant differences in the average scores of negative emotions (anger, disgust, fear, sadness) between groups of leaders characterized as having high versus low degrees of populist rhetoric. This indicates that the emotional expressions of populist leaders may be distinct from those of other politicians.

Critical Analysis

The paper provides a rigorous empirical analysis of the emotional expressions of political leaders, but it also has some limitations. The sample size of 220 videos, while substantial, may not be fully representative of the diversity of political leaders globally. Additionally, the manual coding used to validate the deep learning model was based on a relatively small subset of the data, which could affect the generalizability of the results.

It would be interesting to see the researchers expand their analysis to a larger and more diverse set of political leaders, as well as explore the potential causal mechanisms underlying the observed differences in emotional expressions. For example, are the emotional differences a reflection of the leaders' underlying personality traits, the specific political context, or a combination of factors?

Overall, the study makes an important contribution to our understanding of the nonverbal communication of political leaders, with potential implications for the study of political bias in emotion inference models and the identification of emotions on social media during electoral processes.

Conclusion

This paper presents an empirical investigation of the differences in emotional expressions between political leaders with varying degrees of populist rhetoric. Using a deep learning approach to analyze facial expressions in YouTube videos, the researchers found statistically significant differences in the average levels of negative emotions between the two groups of leaders.

These findings have potential implications for our understanding of the nonverbal communication strategies employed by populist leaders and how they may differ from other politicians. The study also highlights the need for further research to explore the underlying factors that contribute to these emotional differences and their broader implications for political discourse and decision-making.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

💬

Total Score

0

The Face of Populism: Examining Differences in Facial Emotional Expressions of Political Leaders Using Machine Learning

Sara Major, Aleksandar Tomav{s}evi'c

Populist rhetoric employed on online media is characterized as deeply impassioned and often imbued with strong emotions. The aim of this paper is to empirically investigate the differences in affective nonverbal communication of political leaders. We use a deep-learning approach to process a sample of 220 YouTube videos of political leaders from 15 different countries, analyze their facial expressions of emotion and then examine differences in average emotion scores representing the relative presence of 6 emotional states (anger, disgust, fear, happiness, sadness, and surprise) and a neutral expression for each frame of the YouTube video. Based on a sample of manually coded images, we find that this deep-learning approach has 53-60% agreement with human labels. We observe statistically significant differences in the average score of negative emotions between groups of leaders with varying degrees of populist rhetoric.

Read more

8/9/2024

Classifying populist language in American presidential and governor speeches using automatic text analysis
Total Score

0

Classifying populist language in American presidential and governor speeches using automatic text analysis

Olaf van der Veen, Semir Dzebo, Levi Littvay, Kirk Hawkins, Oren Dar

Populism is a concept that is often used but notoriously difficult to measure. Common qualitative measurements like holistic grading or content analysis require great amounts of time and labour, making it difficult to quickly scope out which politicians should be classified as populist and which should not, while quantitative methods show mixed results when it comes to classifying populist rhetoric. In this paper, we develop a pipeline to train and validate an automated classification model to estimate the use of populist language. We train models based on sentences that were identified as populist and pluralist in 300 US governors' speeches from 2010 to 2018 and in 45 speeches of presidential candidates in 2016. We find that these models classify most speeches correctly, including 84% of governor speeches and 89% of presidential speeches. These results extend to different time periods (with 92% accuracy on more recent American governors), different amounts of data (with as few as 70 training sentences per category achieving similar results), and when classifying politicians instead of individual speeches. This pipeline is thus an effective tool that can optimise the systematic and swift classification of the use of populist language in politicians' speeches.

Read more

8/28/2024

Uncovering Political Bias in Emotion Inference Models: Implications for sentiment analysis in social science research
Total Score

0

Uncovering Political Bias in Emotion Inference Models: Implications for sentiment analysis in social science research

Hubert Plisiecki, Pawe{l} Lenartowicz, Maria Flakus, Artur Pokropek

This paper investigates the presence of political bias in emotion inference models used for sentiment analysis (SA) in social science research. Machine learning models often reflect biases in their training data, impacting the validity of their outcomes. While previous research has highlighted gender and race biases, our study focuses on political bias - an underexplored yet pervasive issue that can skew the interpretation of text data across a wide array of studies. We conducted a bias audit on a Polish sentiment analysis model developed in our lab. By analyzing valence predictions for names and sentences involving Polish politicians, we uncovered systematic differences influenced by political affiliations. Our findings indicate that annotations by human raters propagate political biases into the model's predictions. To mitigate this, we pruned the training dataset of texts mentioning these politicians and observed a reduction in bias, though not its complete elimination. Given the significant implications of political bias in SA, our study emphasizes caution in employing these models for social science research. We recommend a critical examination of SA results and propose using lexicon-based systems as a more ideologically neutral alternative. This paper underscores the necessity for ongoing scrutiny and methodological adjustments to ensure the reliability and impartiality of the use of machine learning in academic and applied contexts.

Read more

7/22/2024

Faces of the Mind: Unveiling Mental Health States Through Facial Expressions in 11,427 Adolescents
Total Score

0

Faces of the Mind: Unveiling Mental Health States Through Facial Expressions in 11,427 Adolescents

Xiao Xu, Keyin Zhou, Yan Zhang, Yang Wang, Fei Wang, Xizhe Zhang

Mood disorders, including depression and anxiety, often manifest through facial expressions. While previous research has explored the connection between facial features and emotions, machine learning algorithms for estimating mood disorder severity have been hindered by small datasets and limited real-world application. To address this gap, we analyzed facial videos of 11,427 participants, a dataset two orders of magnitude larger than previous studies. This comprehensive collection includes standardized facial expression videos from reading tasks, along with a detailed psychological scale that measures depression, anxiety, and stress. By examining the relationships among these emotional states and employing clustering analysis, we identified distinct subgroups embodying different emotional profiles. We then trained tree-based classifiers and deep learning models to estimate emotional states from facial features. Results indicate that models previously effective on small datasets experienced decreased performance when applied to our large dataset, highlighting the importance of data scale and mitigating overfitting in practical settings. Notably, our study identified subtle shifts in pupil dynamics and gaze orientation as potential markers of mood disorders, providing valuable information on the interaction between facial expressions and mental health. This research marks the first large-scale and comprehensive investigation of facial expressions in the context of mental health, laying the groundwork for future data-driven advancements in this field.

Read more

5/31/2024