The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses

2405.02711

YC

0

Reddit

0

Published 5/7/2024 by Jordyn Young, Laala M Jawara, Diep N Nguyen, Brian Daly, Jina Huh-Yoo, Afsaneh Razi

🤖

Abstract

Generative Artificial Intelligence (AI) is integrated into everyday technology, including news, education, and social media. AI has further pervaded private conversations as conversational partners, auto-completion, and response suggestions. As social media becomes young people's main method of peer support exchange, we need to understand when and how AI can facilitate and assist in such exchanges in a beneficial, safe, and socially appropriate way. We asked 622 young people to complete an online survey and evaluate blinded human- and AI-generated responses to help-seeking messages. We found that participants preferred the AI-generated response to situations about relationships, self-expression, and physical health. However, when addressing a sensitive topic, like suicidal thoughts, young people preferred the human response. We also discuss the role of training in online peer support exchange and its implications for supporting young people's well-being. Disclaimer: This paper includes sensitive topics, including suicide ideation. Reader discretion is advised.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • Examines the use of generative AI in everyday technology, including social media, and its impact on young people's peer support exchanges
  • Compares young people's perceptions of human- and AI-generated responses to help-seeking messages across different topics
  • Discusses the role of training in online peer support and its implications for supporting young mental well-being

Plain English Explanation

Generative Artificial Intelligence (AI) is becoming more common in our daily lives, from news and education to social media. AI is also being used in private conversations, such as autocomplete and response suggestions. As young people increasingly rely on social media for peer support, it's important to understand when and how AI can be helpful, safe, and socially appropriate in these exchanges.

The researchers asked 622 young people to evaluate responses to help-seeking messages, some written by humans and some generated by AI. They found that young people preferred the AI-generated responses for topics like relationships, self-expression, and physical health. However, for sensitive topics like suicidal thoughts, they preferred the human responses.

The study also discusses the importance of training AI systems to provide appropriate and supportive responses in online peer support settings. This has implications for supporting young people's well-being through the use of AI-based tools.

Technical Explanation

The researchers conducted an online survey with 622 young people to investigate their perceptions of human- and AI-generated responses to help-seeking messages. Participants were shown blinded responses and asked to evaluate them across different topics, including relationships, self-expression, physical health, and sensitive topics like suicidal thoughts.

The results showed that young people generally preferred the AI-generated responses for topics like relationships, self-expression, and physical health. However, for sensitive topics like suicidal thoughts, they preferred the human-generated responses. The researchers discuss the importance of training AI systems to provide appropriate and supportive responses in online peer support settings, and the implications for supporting young people's well-being through the use of AI-based tools.

Critical Analysis

The study provides valuable insights into young people's perceptions of human- and AI-generated responses in the context of online peer support. However, it's important to note that the study was limited to a specific sample of 622 young people, and the results may not be generalizable to all young people or contexts.

Additionally, the study did not delve deeply into the specific factors that influenced young people's preferences, such as the tone, empathy, or perceived understanding of the responses. Further research could explore these nuances and how they impact the effectiveness of AI-based interventions in supporting young people's mental health and well-being.

Conclusion

This study highlights the potential for generative AI to assist in online peer support exchanges, particularly for certain topics. However, it also underscores the need for careful training and oversight to ensure AI-generated responses are appropriate, empathetic, and supportive, especially when addressing sensitive mental health concerns. As the use of AI becomes more prevalent in everyday technology, understanding its role in supporting young people's well-being will be crucial.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

🏅

Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery

Jinkyung Park, Vivek Singh, Pamela Wisniewski

YC

0

Reddit

0

Following the recent release of various Artificial Intelligence (AI) based Conversation Agents (CAs), adolescents are increasingly using CAs for interactive knowledge discovery on sensitive topics, including mental and sexual health topics. Exploring such sensitive topics through online search has been an essential part of adolescent development, and CAs can support their knowledge discovery on such topics through human-like dialogues. Yet, unintended risks have been documented with adolescents' interactions with AI-based CAs, such as being exposed to inappropriate content, false information, and/or being given advice that is detrimental to their mental and physical well-being (e.g., to self-harm). In this position paper, we discuss the current landscape and opportunities for CAs to support adolescents' mental and sexual health knowledge discovery. We also discuss some of the challenges related to ensuring the safety of adolescents when interacting with CAs regarding sexual and mental health topics. We call for a discourse on how to set guardrails for the safe evolution of AI-based CAs for adolescents.

Read more

4/5/2024

Student-AI Interaction: A Case Study of CS1 students

New!Student-AI Interaction: A Case Study of CS1 students

Matin Amoozadeh, Daye Nam, Daniel Prol, Ali Alfageeh, James Prather, Michael Hilton, Sruti Srinivasa Ragavan, Mohammad Amin Alipour

YC

0

Reddit

0

The new capabilities of generative artificial intelligence tools Generative AI, such as ChatGPT, allow users to interact with the system in intuitive ways, such as simple conversations, and receive (mostly) good-quality answers. These systems can support students' learning objectives by providing accessible explanations and examples even with vague queries. At the same time, they can encourage undesired help-seeking behaviors by providing solutions to the students' homework. Therefore, it is important to better understand how students approach such tools and the potential issues such approaches might present for the learners. In this paper, we present a case study for understanding student-AI collaboration to solve programming tasks in the CS1 introductory programming course. To this end, we recruited a gender-balanced majority non-white set of 15 CS1 students at a large public university in the US. We observed them solving programming tasks. We used a mixed-method approach to study their interactions as they tackled Python programming tasks, focusing on when and why they used ChatGPT for problem-solving. We analyze and classify the questions submitted by the 15 participants to ChatGPT. Additionally, we analyzed user interaction patterns, their reactions to ChatGPT's responses, and the potential impacts of Generative AI on their perception of self-efficacy. Our results suggest that in about a third of the cases, the student attempted to complete the task by submitting the full description of the tasks to ChatGPT without making any effort on their own. We also observed that few students verified their solutions. We discuss the results and their potential implications.

Read more

7/2/2024

🤖

Human-Generative AI Collaborative Problem Solving Who Leads and How Students Perceive the Interactions

Gaoxia Zhu, Vidya Sudarshan, Jason Fok Kow, Yew Soon Ong

YC

0

Reddit

0

This research investigates distinct human-generative AI collaboration types and students' interaction experiences when collaborating with generative AI (i.e., ChatGPT) for problem-solving tasks and how these factors relate to students' sense of agency and perceived collaborative problem solving. By analyzing the surveys and reflections of 79 undergraduate students, we identified three human-generative AI collaboration types: even contribution, human leads, and AI leads. Notably, our study shows that 77.21% of students perceived they led or had even contributed to collaborative problem-solving when collaborating with ChatGPT. On the other hand, 15.19% of the human participants indicated that the collaborations were led by ChatGPT, indicating a potential tendency for students to rely on ChatGPT. Furthermore, 67.09% of students perceived their interaction experiences with ChatGPT to be positive or mixed. We also found a positive correlation between positive interaction experience and a sense of positive agency. The results of this study contribute to our understanding of the collaboration between students and generative AI and highlight the need to study further why some students let ChatGPT lead collaborative problem-solving and how to enhance their interaction experience through curriculum and technology design.

Read more

5/24/2024

🤖

Studying Self-Care with Generative AI Tools: Lessons for Design

Tara Capel, Bernd Ploderer, Filip Bircanin, Simon Hanmer, Jamie Yates, Jiaxuan Wang, Kai Ling Khor, Tuck Wah Leong, Greg Wadley, Michelle Newcomb

YC

0

Reddit

0

The rise of generative AI presents new opportunities for the understanding and practice of self-care through its capability to generate varied content, including self-care suggestions via text and images, and engage in dialogue with users over time. However, there are also concerns about accuracy and trustworthiness of self-care advice provided via AI. This paper reports our findings from workshops, diaries, and interviews with five researchers and 24 participants to explore their experiences and use of generative AI for self-care. We analyze our findings to present a framework for the use of generative AI to support five types of self-care, - advice seeking, mentorship, resource creation, social simulation, and therapeutic self-expression - mapped across two dimensions - expertise and modality. We discuss how these practices shift the role of technologies for self-care from merely offering information to offering personalized advice and supporting creativity for reflection, and we offer suggestions for using the framework to investigate new self-care designs.

Read more

5/10/2024