Using Persuasive Writing Strategies to Explain and Detect Health Misinformation

Read original: arXiv:2211.05985 - Published 4/11/2024 by Danial Kamali, Joseph Romain, Huiyi Liu, Wei Peng, Jingbo Meng, Parisa Kordjamshidi

📉

Overview

The research paper focuses on developing techniques to automatically identify misinformation by analyzing the persuasive strategies used in textual documents.
The researchers propose a novel annotation scheme to capture common persuasive writing tactics and provide a dataset on health misinformation annotated using this scheme.
The paper evaluates the effectiveness of using persuasive strategies as an additional source of information to enhance the accuracy and explainability of misinformation detection models.

Plain English Explanation

The spread of misinformation is a significant problem in today's society. This research aims to help address this issue by developing methods to automatically detect misinformation. The key idea is to analyze the persuasive techniques used in the text, as these can be a signal of misinformation.

The researchers have created a new way to annotate, or label, text based on the different persuasive tactics employed, such as appealing to emotions or using logical fallacies. They have also provided a dataset of health-related misinformation that has been annotated using this new system.

By using this information about persuasive strategies as an additional input, the researchers have found that misinformation detection models can become more accurate and easier to understand. The persuasive tactics can provide valuable insights, allowing both models and humans to make more informed judgments about the trustworthiness of information.

Technical Explanation

The research paper introduces a novel annotation scheme that captures common persuasive writing tactics, such as appealing to emotions or using logical fallacies. The researchers then provide a dataset of health-related misinformation that has been thoroughly annotated by experts using this proposed scheme.

The researchers evaluate the effectiveness of using these persuasive strategies as an additional source of information to enhance the performance of misinformation detection models. They fine-tune and prompt-engineer pre-trained language models from the BERT and GPT families, leveraging the persuasive strategy annotations as intermediate labels.

The results show that incorporating the persuasive strategy information improves the accuracy of misinformation detection and also enhances the explainability of the models. The identified persuasive tactics can serve as valuable insights, enabling both models and humans to make more informed decisions about the trustworthiness of the information.

Critical Analysis

The research paper provides a comprehensive and well-designed approach to leveraging persuasive strategies for misinformation detection. However, there are a few areas that could be explored further:

The dataset is focused on health-related misinformation, so it would be valuable to assess the generalizability of the proposed techniques to other domains, such as political or social misinformation.
The paper does not discuss the potential biases or limitations of the expert annotations used to create the dataset. It would be important to understand how these may impact the model's performance and interpretability.
The researchers could investigate incorporating other contextual signals, such as user-level or platform-level features, to further enhance the misinformation detection capabilities.
The user-centered perspective on misinformation interventions could be a valuable addition to this research, exploring how the identified persuasive strategies may impact the end-user's interpretation and trust in the information.

Conclusion

This research paper presents a promising approach to leveraging persuasive strategies for the automatic identification of misinformation. By creating a novel annotation scheme and a dataset of annotated health-related misinformation, the researchers have laid the groundwork for developing more accurate and explainable misinformation detection models.

The key insight is that the persuasive tactics employed in the text can serve as valuable signals for detecting misinformation. Incorporating this information can enhance the performance of misinformation detection models and provide useful explanations to both machines and humans, enabling more informed decisions about the trustworthiness of information.

Overall, this research contributes to the ongoing efforts to combat the spread of misinformation in society, which is a critical challenge with significant implications for individual decision-making and societal well-being.

This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

📉

Using Persuasive Writing Strategies to Explain and Detect Health Misinformation

Danial Kamali, Joseph Romain, Huiyi Liu, Wei Peng, Jingbo Meng, Parisa Kordjamshidi

Nowadays, the spread of misinformation is a prominent problem in society. Our research focuses on aiding the automatic identification of misinformation by analyzing the persuasive strategies employed in textual documents. We introduce a novel annotation scheme encompassing common persuasive writing tactics to achieve our objective. Additionally, we provide a dataset on health misinformation, thoroughly annotated by experts utilizing our proposed scheme. Our contribution includes proposing a new task of annotating pieces of text with their persuasive writing strategy types. We evaluate fine-tuning and prompt-engineering techniques with pre-trained language models of the BERT family and the generative large language models of the GPT family using persuasive strategies as an additional source of information. We evaluate the effects of employing persuasive strategies as intermediate labels in the context of misinformation detection. Our results show that those strategies enhance accuracy and improve the explainability of misinformation detection models. The persuasive strategies can serve as valuable insights and explanations, enabling other models or even humans to make more informed decisions regarding the trustworthiness of the information.

4/11/2024

💬

Investigating Persuasion Techniques in Arabic: An Empirical Study Leveraging Large Language Models

Abdurahmman Alzahrani, Eyad Babkier, Faisal Yanbaawi, Firas Yanbaawi, Hassan Alhuzali

In the current era of digital communication and widespread use of social media, it is crucial to develop an understanding of persuasive techniques employed in written text. This knowledge is essential for effectively discerning accurate information and making informed decisions. To address this need, this paper presents a comprehensive empirical study focused on identifying persuasive techniques in Arabic social media content. To achieve this objective, we utilize Pre-trained Language Models (PLMs) and leverage the ArAlEval dataset, which encompasses two tasks: binary classification to determine the presence or absence of persuasion techniques, and multi-label classification to identify the specific types of techniques employed in the text. Our study explores three different learning approaches by harnessing the power of PLMs: feature extraction, fine-tuning, and prompt engineering techniques. Through extensive experimentation, we find that the fine-tuning approach yields the highest results on the aforementioned dataset, achieving an f1-micro score of 0.865 and an f1-weighted score of 0.861. Furthermore, our analysis sheds light on an interesting finding. While the performance of the GPT model is relatively lower compared to the other approaches, we have observed that by employing few-shot learning techniques, we can enhance its results by up to 20%. This offers promising directions for future research and exploration in this topicfootnote{Upon Acceptance, the source code will be released on GitHub.}.

5/22/2024

Why Misinformation is Created? Detecting them by Integrating Intent Features

Bing Wang, Ximing Li, Changchun Li, Bo Fu, Songwen Pei, Shengsheng Wang

Various social media platforms, e.g., Twitter and Reddit, allow people to disseminate a plethora of information more efficiently and conveniently. However, they are inevitably full of misinformation, causing damage to diverse aspects of our daily lives. To reduce the negative impact, timely identification of misinformation, namely Misinformation Detection (MD), has become an active research topic receiving widespread attention. As a complex phenomenon, the veracity of an article is influenced by various aspects. In this paper, we are inspired by the opposition of intents between misinformation and real information. Accordingly, we propose to reason the intent of articles and form the corresponding intent features to promote the veracity discrimination of article features. To achieve this, we build a hierarchy of a set of intents for both misinformation and real information by referring to the existing psychological theories, and we apply it to reason the intent of articles by progressively generating binary answers with an encoder-decoder structure. We form the corresponding intent features and integrate it with the token features to achieve more discriminative article features for MD. Upon these ideas, we suggest a novel MD method, namely Detecting Misinformation by Integrating Intent featuRes (DM-INTER). To evaluate the performance of DM-INTER, we conduct extensive experiments on benchmark MD datasets. The experimental results validate that DM-INTER can outperform the existing baseline MD methods.

7/30/2024

Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrieval

Kazuaki Furumai, Roberto Legaspi, Julio Vizcarra, Yudai Yamazaki, Yasutaka Nishimura, Sina J. Semnani, Kazushi Ikeda, Weiyan Shi, Monica S. Lam

Persuasion plays a pivotal role in a wide range of applications from health intervention to the promotion of social good. Persuasive chatbots can accelerate the positive effects of persuasion in such applications. Existing methods rely on fine-tuning persuasive chatbots with task-specific training data which is costly, if not infeasible, to collect. To address this issue, we propose a method to leverage the generalizability and inherent persuasive abilities of large language models (LLMs) in creating effective and truthful persuasive chatbot for any given domain in a zero-shot manner. Unlike previous studies which used pre-defined persuasion strategies, our method first uses an LLM to generate responses, then extracts the strategies used on the fly, and replaces any unsubstantiated claims in the response with retrieved facts supporting the strategies. We applied our chatbot, PersuaBot, to three significantly different domains needing persuasion skills: donation solicitation, recommendations, and health intervention. Our experiments on simulated and human conversations show that our zero-shot approach is more persuasive than prior work, while achieving factual accuracy surpassing state-of-the-art knowledge-oriented chatbots. Our study demonstrated that when persuasive chatbots are employed responsibly for social good, it is an enabler of positive individual and social change.

7/8/2024