Reducing Privacy Risks in Online Self-Disclosures with Language Models

Overview

• This paper explores the privacy risks associated with self-disclosure on social media and proposes methods to detect and abstract such disclosures to protect user privacy.

• The researchers develop a taxonomy of 19 self-disclosure categories, curate a large dataset of annotated disclosure spans, and fine-tune a language model to detect these disclosures with over 65% accuracy.

• The paper also introduces the task of self-disclosure abstraction, where disclosures are rephrased into less specific terms while maintaining their utility, and explores various fine-tuning strategies to achieve this.

• Additionally, the researchers present a task of rating the importance of disclosures for context understanding, with their fine-tuned model achieving 80% accuracy, on-par with GPT-3.5.

Plain English Explanation

• People often share personal information, or "self-disclose," on social media, which can be rewarding but also poses privacy risks.

• The researchers in this paper wanted to find ways to identify self-disclosures and rephrase them in less specific ways to help protect people's privacy, while still keeping the overall meaning.

• They created a detailed list of 19 different types of self-disclosure, like age, location, or relationships, and gathered a large dataset of examples. Then, they trained a machine learning model to automatically detect these disclosures in text with good accuracy.

• To abstract the disclosures, the researchers tried different techniques to rephrase them in more general terms, like changing "I'm 16F" to "I'm a teenage girl." They found ways to do this that still preserved the overall meaning.

• Finally, the researchers developed a system to rate how important each disclosure is for understanding the context. This can help people decide which disclosures are most important to keep and which ones might be good to rephrase.

Technical Explanation

• The researchers first developed a comprehensive taxonomy of 19 self-disclosure categories, ranging from demographic information to opinions and emotions. They then curated a large dataset of over 4,800 annotated disclosure spans from online text to serve as a benchmark.

• Using this dataset, the researchers fine-tuned a pre-trained language model to detect self-disclosures, achieving an F1-score of over 65% on partial span matching. An HCI user study found that 82% of participants viewed the model positively, highlighting its real-world applicability.

• Motivated by the user feedback, the researchers introduced the task of self-disclosure abstraction. They explored various fine-tuning strategies to generate more general paraphrases of disclosures, such as changing "I'm 16F" to "I'm a teenage girl," while preserving the overall utility.

• To help users decide which disclosures to abstract, the researchers also presented a task of rating the importance of disclosures for context understanding. Their fine-tuned model achieved 80% accuracy on this task, on-par with GPT-3.5.

Critical Analysis

• The paper provides a comprehensive and well-designed solution for detecting and abstracting self-disclosures to mitigate privacy risks. However, the researchers acknowledge that their approach may not capture all nuances of self-disclosure, and there could be cases where the abstraction process inadvertently removes important contextual information.

• Additionally, the user study was relatively small, and it would be valuable to conduct a larger-scale evaluation to better understand the real-world applicability and user acceptance of the proposed system.

• While the researchers have provided ethical guidelines for the release of their corpus and models, there may be concerns about the potential misuse of such technologies, especially in sensitive domains. Ongoing monitoring and responsible deployment strategies will be crucial.

• It would also be interesting to see further research on the long-term impacts of self-disclosure abstraction on social interactions and whether it can effectively balance privacy protection and the need for authentic self-expression.

Conclusion

• This paper presents a comprehensive framework for detecting and abstracting self-disclosures on social media, aiming to protect user privacy while preserving the overall utility of the information shared.

• The researchers' development of a self-disclosure taxonomy, a large annotated dataset, and fine-tuned language models for detection and abstraction are significant contributions to the field of online privacy protection.

• While the proposed solutions show promise, ongoing research and careful implementation will be needed to address potential limitations and ensure the responsible use of these technologies to empower users and maintain the benefits of social media interaction.