Violation of my body: Perceptions of AI-generated non-consensual (intimate) imagery
0
Sign in to get full access
Overview
• This paper explores people's perceptions of AI-generated non-consensual (intimate) imagery, which can be a form of digital sexual violence.
• The researchers conducted interviews to understand how people view and respond to this emerging issue, and to identify potential mitigation strategies.
Plain English Explanation
• The paper looks at how people feel about AI-generated images that show someone's private or intimate body parts without their consent. This can be a type of digital abuse or harm.
• The researchers talked to people to learn more about their thoughts and reactions to this problem. They also wanted to find ways to potentially address or prevent this issue.
Technical Explanation
• The researchers conducted semi-structured interviews with 24 participants to understand their perceptions of AI-generated non-consensual (intimate) imagery.
• The interviews covered topics like participants' emotional responses, perceived harms, and views on potential mitigation strategies.
• Thematic analysis was used to identify key themes in the interview data, such as a "violation of bodily autonomy" and concerns about the widespread distribution and permanence of this type of content.
• Participants expressed strong negative reactions, viewing this as a severe violation that could have profound psychological, social, and professional consequences for victims.
• Proposed mitigation strategies included improved detection and takedown, better education and awareness, and legal/policy changes to address this emerging threat.
Critical Analysis
• The small sample size and qualitative nature of the study limit the generalizability of the findings, though the rich interview data provides valuable insights.
• The paper does not delve into the technical details of AI-generation or the specific methods used, focusing more on the human perceptions and experiences.
• Further research could explore the perspectives of different stakeholder groups, such as policymakers, technology companies, and the general public, to build a more comprehensive understanding of this issue.
• Longitudinal studies tracking changes in perceptions and responses over time would also be valuable as this technology continues to evolve.
Conclusion
• This study highlights the significant harm and sense of violation that people feel in response to AI-generated non-consensual (intimate) imagery, underscoring the need for multifaceted efforts to address this emerging form of digital abuse.
• The findings can inform the development of technical, educational, and policy-based solutions to prevent and mitigate the impact of this technology on individuals and society.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Violation of my body: Perceptions of AI-generated non-consensual (intimate) imagery
Natalie Grace Brigham, Miranda Wei, Tadayoshi Kohno, Elissa M. Redmiles
AI technology has enabled the creation of deepfakes: hyper-realistic synthetic media. We surveyed 315 individuals in the U.S. on their views regarding the hypothetical non-consensual creation of deepfakes depicting them, including deepfakes portraying sexual acts. Respondents indicated strong opposition to creating and, even more so, sharing non-consensually created synthetic content, especially if that content depicts a sexual act. However, seeking out such content appeared more acceptable to some respondents. Attitudes around acceptability varied further based on the hypothetical creator's relationship to the participant, the respondent's gender and their attitudes towards sexual consent. This study provides initial insight into public perspectives of a growing threat and highlights the need for further research to inform social norms as well as ongoing policy conversations and technical developments in generative AI.
Read more6/18/2024
➖
0
Did They F***ing Consent to That?: Safer Digital Intimacy via Proactive Protection Against Image-Based Sexual Abuse
Lucy Qin, Vaughn Hamilton, Sharon Wang, Yigit Aydinalp, Marin Scarlett, Elissa M. Redmiles
As many as 8 in 10 adults share intimate content such as nude or lewd images. Sharing such content has significant benefits for relationship intimacy and body image, and can offer employment. However, stigmatizing attitudes and a lack of technological mitigations put those sharing such content at risk of sexual violence. An estimated 1 in 3 people have been subjected to image-based sexual abuse (IBSA), a spectrum of violence that includes the nonconsensual distribution or threat of distribution of consensually-created intimate content (also called NDII). In this work, we conducted a rigorous empirical interview study of 52 European creators of intimate content to examine the threats they face and how they defend against them, situated in the context of their different use cases for intimate content sharing and their choice of technologies for storing and sharing such content. Synthesizing our results with the limited body of prior work on technological prevention of NDII, we offer concrete next steps for both platforms and security & privacy researchers to work toward safer intimate content sharing through proactive protection. Content Warning: This work discusses sexual violence, specifically, the harms of image-based sexual abuse (particularly in Sections 2 and 6).
Read more6/17/2024
🔎
0
As Good As A Coin Toss: Human detection of AI-generated images, videos, audio, and audiovisual stimuli
Di Cooke, Abigail Edwards, Sophia Barkoff, Kathryn Kelly
As synthetic media becomes progressively more realistic and barriers to using it continue to lower, the technology has been increasingly utilized for malicious purposes, from financial fraud to nonconsensual pornography. Today, the principal defense against being misled by synthetic media relies on the ability of the human observer to visually and auditorily discern between real and fake. However, it remains unclear just how vulnerable people actually are to deceptive synthetic media in the course of their day to day lives. We conducted a perceptual study with 1276 participants to assess how accurate people were at distinguishing synthetic images, audio only, video only, and audiovisual stimuli from authentic. To reflect the circumstances under which people would likely encounter synthetic media in the wild, testing conditions and stimuli emulated a typical online platform, while all synthetic media used in the survey was sourced from publicly accessible generative AI technology. We find that overall, participants struggled to meaningfully discern between synthetic and authentic content. We also find that detection performance worsens when the stimuli contains synthetic content as compared to authentic content, images featuring human faces as compared to non face objects, a single modality as compared to multimodal stimuli, mixed authenticity as compared to being fully synthetic for audiovisual stimuli, and features foreign languages as compared to languages the observer is fluent in. Finally, we also find that prior knowledge of synthetic media does not meaningfully impact their detection performance. Collectively, these results indicate that people are highly susceptible to being tricked by synthetic media in their daily lives and that human perceptual detection capabilities can no longer be relied upon as an effective counterdefense.
Read more4/5/2024
0
Behind the Deepfake: 8% Create; 90% Concerned. Surveying public exposure to and perceptions of deepfakes in the UK
Tvesha Sippy, Florence Enock, Jonathan Bright, Helen Z. Margetts
This article examines public exposure to and perceptions of deepfakes based on insights from a nationally representative survey of 1403 UK adults. The survey is one of the first of its kind since recent improvements in deepfake technology and widespread adoption of political deepfakes. The findings reveal three key insights. First, on average, 15% of people report exposure to harmful deepfakes, including deepfake pornography, deepfake frauds/scams and other potentially harmful deepfakes such as those that spread health/religious misinformation/propaganda. In terms of common targets, exposure to deepfakes featuring celebrities was 50.2%, whereas those featuring politicians was 34.1%. And 5.7% of respondents recall exposure to a selection of high profile political deepfakes in the UK. Second, while exposure to harmful deepfakes was relatively low, awareness of and fears about deepfakes were high (and women were significantly more likely to report experiencing such fears than men). As with fears, general concerns about the spread of deepfakes were also high; 90.4% of the respondents were either very concerned or somewhat concerned about this issue. Most respondents (at least 91.8%) were concerned that deepfakes could add to online child sexual abuse material, increase distrust in information and manipulate public opinion. Third, while awareness about deepfakes was high, usage of deepfake tools was relatively low (8%). Most respondents were not confident about their detection abilities and were trustful of audiovisual content online. Our work highlights how the problem of deepfakes has become embedded in public consciousness in just a few years; it also highlights the need for media literacy programmes and other policy interventions to address the spread of harmful deepfakes.
Read more7/9/2024