Supporting Physical Activity Behavior Change with LLM-Based Conversational Agents

2405.06061

YC

0

Reddit

0

Published 5/13/2024 by Matthew Jorke, Shardul Sapkota, Lyndsea Warkenthien, Niklas Vainio, Paul Schmiedmayer, Emma Brunskill, James Landay
Supporting Physical Activity Behavior Change with LLM-Based Conversational Agents

Abstract

Physical activity has significant benefits to health, yet large portions of the population remain physically inactive. Mobile health applications show promising potential for low-cost, scalable physical activity promotion, but existing approaches are often insufficiently personalized to a user's context and life circumstances. In this work, we explore the potential for large language model (LLM) based conversational agents to motivate physical activity behavior change. Through formative interviews with 12 health professionals and 10 non-experts, we identify design considerations and opportunities for LLM health coaching. We present GPTCoach, a chatbot that implements an evidence-based health coaching program, uses counseling strategies from motivational interviewing, and can query and visualize health data from a wearable through tool use. We evaluate GPTCoach as a technology probe in a user study with 16 participants. Through quantitive and qualitative analyses, we find promising evidence that GPTCoach can adhere to a health coaching program while adopting a facilitative, supportive, and non-judgmental tone. We find more variable support for GPTCoach's ability to proactively make use of data in ways that foster motivation and empowerment. We conclude with a discussion of our findings, implications for future research, as well as risks and limitations.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper explores the use of large language models (LLMs) in developing conversational agents to support physical activity behavior change.
  • The researchers designed and evaluated a conversational agent that uses LLM technology to engage users in personalized health coaching dialogues.
  • The goal is to leverage the natural language capabilities of LLMs to create an engaging and effective platform for encouraging and supporting physical activity.

Plain English Explanation

The paper looks at how advanced language AI, known as large language models (LLMs), can be used to build helpful digital assistants that encourage people to be more physically active. The researchers created a conversational agent - a kind of digital coach - that can have natural conversations with users about physical activity and provide personalized support and guidance.

The key idea is that by using powerful LLM technology, the digital assistant can engage with users in a very human-like way, understanding their needs and motivations, and providing tailored advice and encouragement. This could be more effective for supporting behavior change around physical activity compared to traditional approaches.

For example, the digital coach might have a conversation with a user about their fitness goals, barriers they face, and strategies to overcome them. The coach can draw on its deep language understanding to ask thoughtful questions, provide relevant information, and offer personalized suggestions - just like a human health coach would. The goal is to create an experience that is more engaging and helpful for the user.

Technical Explanation

The paper describes the design and evaluation of a conversational agent for supporting physical activity behavior change, leveraging the natural language capabilities of large language models (LLMs).

The system architecture incorporates an LLM-based dialogue manager that engages users in personalized health coaching conversations. This dialogue manager is trained on a large corpus of health and fitness-related dialogues to enable fluent, contextual responses. It is coupled with a physical activity tracker and user profile to tailor the conversations to each individual's needs and progress.

The researchers conducted a user study to evaluate the system's effectiveness. Participants interacted with the conversational agent over several weeks and provided feedback on its usefulness, engagement, and impact on their physical activity levels. The results suggest that the LLM-powered approach can foster more engaging and effective health coaching compared to traditional interfaces.

Key insights from the technical evaluation include the ability of the LLM to understand user intents, provide relevant and thoughtful responses, and build rapport over the course of the coaching dialogue. Limitations include the challenge of ensuring the conversational agent provides accurate and trustworthy health information.

Critical Analysis

The paper presents a promising approach to leveraging large language models for supporting physical activity behavior change. The use of an LLM-powered conversational agent aligns well with the personalized, interactive nature of effective health coaching. By harnessing the natural language understanding and generation capabilities of LLMs, the system can engage users in a more human-like, empathetic manner compared to traditional interfaces.

However, the paper also acknowledges some important limitations and areas for further research. Ensuring the accuracy and safety of the health information provided by the conversational agent is a key concern that requires careful model training and validation. Additionally, long-term engagement and the agent's ability to sustain user motivation over time are important areas to explore further.

Towards Enhancing Health Coaching Dialogue in Low-Resource Settings with Large Language Models and Health LLM: Leveraging Large Language Models for Health Prediction and Analytics provide relevant context on using LLMs for health applications. The VoicePilot and LAST JITAI papers also offer insights on leveraging LLMs for physical activity and health-related interfaces.

Conclusion

This paper demonstrates the potential of large language models to power engaging and effective conversational agents for supporting physical activity behavior change. By harnessing the natural language understanding and generation capabilities of LLMs, the system can engage users in personalized health coaching dialogues that are more interactive and tailored to individual needs.

While the results are promising, the research also highlights the importance of ensuring the accuracy and safety of the health information provided by the system, as well as the challenge of sustaining user engagement over the long term. Continued development and evaluation of LLM-based conversational agents for health and wellness applications could lead to more effective and accessible digital health interventions.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

PhysioLLM: Supporting Personalized Health Insights with Wearables and Large Language Models

PhysioLLM: Supporting Personalized Health Insights with Wearables and Large Language Models

Cathy Mengying Fang, Valdemar Danry, Nathan Whitmore, Andria Bao, Andrew Hutchison, Cayden Pierce, Pattie Maes

YC

0

Reddit

0

We present PhysioLLM, an interactive system that leverages large language models (LLMs) to provide personalized health understanding and exploration by integrating physiological data from wearables with contextual information. Unlike commercial health apps for wearables, our system offers a comprehensive statistical analysis component that discovers correlations and trends in user data, allowing users to ask questions in natural language and receive generated personalized insights, and guides them to develop actionable goals. As a case study, we focus on improving sleep quality, given its measurability through physiological data and its importance to general well-being. Through a user study with 24 Fitbit watch users, we demonstrate that PhysioLLM outperforms both the Fitbit App alone and a generic LLM chatbot in facilitating a deeper, personalized understanding of health data and supporting actionable steps toward personal health goals.

Read more

6/28/2024

📈

You tell me: A Dataset of GPT-4-Based Behaviour Change Support Conversations

Selina Meyer, David Elsweiler

YC

0

Reddit

0

Conversational agents are increasingly used to address emotional needs on top of information needs. One use case of increasing interest are counselling-style mental health and behaviour change interventions, with large language model (LLM)-based approaches becoming more popular. Research in this context so far has been largely system-focused, foregoing the aspect of user behaviour and the impact this can have on LLM-generated texts. To address this issue, we share a dataset containing text-based user interactions related to behaviour change with two GPT-4-based conversational agents collected in a preregistered user study. This dataset includes conversation data, user language analysis, perception measures, and user feedback for LLM-generated turns, and can offer valuable insights to inform the design of such systems based on real interactions.

Read more

4/4/2024

Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health

Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health

Bo Wen, Raquel Norel, Julia Liu, Thaddeus Stappenbeck, Farhana Zulkernine, Huamin Chen

YC

0

Reddit

0

The rapid advancements in large language models (LLMs) have opened up new opportunities for transforming patient engagement in healthcare through conversational AI. This paper presents an overview of the current landscape of LLMs in healthcare, specifically focusing on their applications in analyzing and generating conversations for improved patient engagement. We showcase the power of LLMs in handling unstructured conversational data through four case studies: (1) analyzing mental health discussions on Reddit, (2) developing a personalized chatbot for cognitive engagement in seniors, (3) summarizing medical conversation datasets, and (4) designing an AI-powered patient engagement system. These case studies demonstrate how LLMs can effectively extract insights and summarizations from unstructured dialogues and engage patients in guided, goal-oriented conversations. Leveraging LLMs for conversational analysis and generation opens new doors for many patient-centered outcomes research opportunities. However, integrating LLMs into healthcare raises important ethical considerations regarding data privacy, bias, transparency, and regulatory compliance. We discuss best practices and guidelines for the responsible development and deployment of LLMs in healthcare settings. Realizing the full potential of LLMs in digital health will require close collaboration between the AI and healthcare professionals communities to address technical challenges and ensure these powerful tools' safety, efficacy, and equity.

Read more

6/21/2024

💬

Benchmarking Large Language Models on Communicative Medical Coaching: a Novel System and Dataset

Hengguan Huang, Songtao Wang, Hongfu Liu, Hao Wang, Ye Wang

YC

0

Reddit

0

Traditional applications of natural language processing (NLP) in healthcare have predominantly focused on patient-centered services, enhancing patient interactions and care delivery, such as through medical dialogue systems. However, the potential of NLP to benefit inexperienced doctors, particularly in areas such as communicative medical coaching, remains largely unexplored. We introduce ChatCoach, a human-AI cooperative framework designed to assist medical learners in practicing their communication skills during patient consultations. ChatCoach (Our data and code are available online: https://github.com/zerowst/Chatcoach)differentiates itself from conventional dialogue systems by offering a simulated environment where medical learners can practice dialogues with a patient agent, while a coach agent provides immediate, structured feedback. This is facilitated by our proposed Generalized Chain-of-Thought (GCoT) approach, which fosters the generation of structured feedback and enhances the utilization of external knowledge sources. Additionally, we have developed a dataset specifically for evaluating Large Language Models (LLMs) within the ChatCoach framework on communicative medical coaching tasks. Our empirical results validate the effectiveness of ChatCoach.

Read more

6/11/2024