Children's Mental Models of Generative Visual and Text Based AI Models

2405.13081

YC

0

Reddit

0

Published 5/24/2024 by Eliza Kosoy, Soojin Jeong, Anoop Sinha, Alison Gopnik, Tanya Kraljic

🤖

Abstract

In this work we investigate how children ages 5-12 perceive, understand, and use generative AI models such as a text-based LLMs ChatGPT and a visual-based model DALL-E. Generative AI is newly being used widely since chatGPT. Children are also building mental models of generative AI. Those haven't been studied before and it is also the case that the children's models are dynamic as they use the tools, even with just very short usage. Upon surveying and experimentally observing over 40 children ages 5-12, we found that children generally have a very positive outlook towards AI and are excited about the ways AI may benefit and aid them in their everyday lives. In a forced choice, children robustly associated AI with positive adjectives versus negative ones. We also categorize what children are querying AI models for and find that children search for more imaginative things that don't exist when using a visual-based AI and not when using a text-based one. Our follow-up study monitored children's responses and feelings towards AI before and after interacting with GenAI models. We even find that children find AI to be less scary after interacting with it. We hope that these findings will shine a light on children's mental models of AI and provide insight for how to design the best possible tools for children who will inevitably be using AI in their lifetimes. The motivation of this work is to bridge the gap between Human-Computer Interaction (HCI) and Psychology in an effort to study the effects of AI on society. We aim to identify the gaps in humans' mental models of what AI is and how it works. Previous work has investigated how both adults and children perceive various kinds of robots, computers, and other technological concepts. However, there is very little work investigating these concepts for generative AI models and not simply embodied robots or physical technology.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This study investigates how children aged 5-12 perceive, understand, and interact with generative AI models like ChatGPT and DALL-E.
  • Researchers surveyed and observed over 40 children to understand their mental models of AI and how these change with use.
  • The findings suggest children have a very positive outlook on AI and are excited about its potential benefits in their lives.
  • Children's interaction patterns with visual vs. text-based AI models differed, with more imaginative queries in the visual domain.
  • The study aims to bridge the gap between Human-Computer Interaction (HCI) and psychology to better understand the societal impact of AI, especially on younger generations.

Plain English Explanation

This research looked at how children ages 5 to 12 think about and use new AI technologies like ChatGPT and DALL-E. These AI models can generate human-like text or create images based on text prompts.

The researchers wanted to understand what kids think about these AI systems and how their views change as they actually use them. They surveyed and observed over 40 children to see what kind of tasks they try to accomplish with the AI and how they feel about it.

The study found that children generally have a very positive attitude towards AI. They associate it with mostly positive qualities and are excited about the ways AI could help them in their daily lives. When given a choice, children prefer to describe AI using positive words rather than negative ones.

Interestingly, the researchers noticed differences in how children used the text-based ChatGPT versus the visual DALL-E model. With DALL-E, children tended to ask for more imaginative and fantastical things that don't exist in the real world. But with the text-based ChatGPT, their queries were more grounded in reality.

The researchers also found that children's fear or concerns about AI decreased after they had a chance to interact with the models. This suggests their mental models of AI become more nuanced and less scary as they gain firsthand experience.

Overall, this study provides valuable insights into how children are thinking about and engaging with the latest AI technologies. The findings can help shape the development of AI systems that are well-suited for younger users and foster a positive relationship between kids and AI.

Technical Explanation

The researchers conducted a series of studies to investigate children's perceptions, understanding, and use of generative AI models like ChatGPT and DALL-E.

In the first study, they surveyed and observed over 40 children aged 5-12 to assess their mental models of AI. The children were given a forced-choice task to associate AI with positive or negative adjectives. The researchers also analyzed the types of queries children made to text-based and visual AI models.

The findings showed that children generally have a very positive outlook on AI, robustly associating it with positive traits. Children's queries to the visual DALL-E model tended to be more imaginative and fantastical compared to the text-based ChatGPT.

In a follow-up study, the researchers monitored children's responses and feelings towards AI before and after interacting with the generative AI models. Interestingly, children reported feeling less scared of AI after using the systems.

The motivation behind this work is to bridge the gap between Human-Computer Interaction (HCI) and psychology in order to better understand the societal impacts of AI, especially on younger generations. Previous research has investigated perceptions of embodied robots and physical technologies, but there is limited work on children's mental models of disembodied, generative AI systems.

Critical Analysis

The research provides valuable insights into an important and under-studied area – children's perceptions and use of the latest generative AI technologies. By surveying and observing a substantial number of children, the researchers were able to uncover some interesting patterns in how kids think about and interact with AI systems.

One notable strength of the study is the comparison between text-based and visual AI models. The finding that children tend to engage in more imaginative and fantastical queries with the visual DALL-E system highlights key differences in how children utilize these distinct AI capabilities.

However, the study is limited in its scope, focusing only on a relatively narrow age range of 5-12 years old. It would be interesting to see how mental models of AI evolve as children get older and gain more experience with these technologies. Additionally, the study does not delve into potential differences based on factors like gender, socioeconomic status, or prior exposure to technology.

Another area for further research is the long-term impact of children's interactions with generative AI. While the study found that children's fear of AI decreased after using the models, it's unclear if this represents a durable shift in perspective or a more temporary effect. Longitudinal research would be needed to better understand the sustainability of these changes.

Overall, this study represents an important step in understanding the psychosocial impacts of generative AI and how to design AI systems that can effectively and safely support children's education and development. The findings highlight the value of bridging HCI and psychology to ensure generative AI models are developed in a way that benefits, rather than harms, young users.

Conclusion

This study provides important insights into how children aged 5-12 perceive, understand, and interact with state-of-the-art generative AI models like ChatGPT and DALL-E. The key findings suggest that children have a very positive outlook on AI and are excited about its potential to benefit their lives.

Notably, the research uncovered differences in how children engage with text-based versus visual AI systems, with the visual model prompting more imaginative and fantastical queries. The study also found that children's concerns about AI decreased after they had a chance to directly interact with the technology.

These insights can help guide the development of AI systems that are well-suited for younger users and foster a constructive relationship between children and this rapidly advancing technology. As generative AI becomes more ubiquitous, understanding its impacts on the next generation will be critical for maximizing the benefits and mitigating any potential harms.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

🤖

Children's Overtrust and Shifting Perspectives of Generative AI

Jaemarie Solyst, Ellia Yang, Shixian Xie, Jessica Hammer, Amy Ogan, Motahhare Eslami

YC

0

Reddit

0

The capabilities of generative AI (genAI) have dramatically increased in recent times, and there are opportunities for children to leverage new features for personal and school-related endeavors. However, while the future of genAI is taking form, there remain potentially harmful limitations, such as generation of outputs with misinformation and bias. We ran a workshop study focused on ChatGPT to explore middle school girls' (N = 26) attitudes and reasoning about how genAI works. We focused on girls who are often disproportionately impacted by algorithmic bias. We found that: (1) middle school girls were initially overtrusting of genAI, (2) deliberate exposure to the limitations and mistakes of generative AI shifted this overtrust to disillusionment about genAI capabilities, though they were still optimistic for future possibilities of genAI, and (3) their ideas about school policy were nuanced. This work informs how children think about genAI like ChatGPT and its integration in learning settings.

Read more

7/2/2024

🤖

The Psychosocial Impacts of Generative AI Harms

Faye-Marie Vassel, Evan Shieh, Cassidy R. Sugimoto, Thema Monroe-White

YC

0

Reddit

0

The rapid emergence of generative Language Models (LMs) has led to growing concern about the impacts that their unexamined adoption may have on the social well-being of diverse user groups. Meanwhile, LMs are increasingly being adopted in K-20 schools and one-on-one student settings with minimal investigation of potential harms associated with their deployment. Motivated in part by real-world/everyday use cases (e.g., an AI writing assistant) this paper explores the potential psychosocial harms of stories generated by five leading LMs in response to open-ended prompting. We extend findings of stereotyping harms analyzing a total of 150K 100-word stories related to student classroom interactions. Examining patterns in LM-generated character demographics and representational harms (i.e., erasure, subordination, and stereotyping) we highlight particularly egregious vignettes, illustrating the ways LM-generated outputs may influence the experiences of users with marginalized and minoritized identities, and emphasizing the need for a critical understanding of the psychosocial impacts of generative AI tools when deployed and utilized in diverse social contexts.

Read more

5/6/2024

🌐

Generative AI: The power of the new education

Sergio Altares-L'opez, Jos'e M. Bengochea-Guevara, Carlos Ranz, H'ector Montes, Angela Ribeiro

YC

0

Reddit

0

The effective integration of generative artificial intelligence in education is a fundamental aspect to prepare future generations. This study proposes an accelerated learning methodology in artificial intelligence, focused on its generative capacity, as a way to achieve this goal. It recognizes the challenge of getting teachers to engage with new technologies and adapt their methods in all subjects, not just those related to AI. This methodology not only promotes interest in science, technology, engineering and mathematics, but also facilitates student understanding of the ethical uses and risks associated with AI. Students' perceptions of generative AI are examined, addressing their emotions towards its evolution, evaluation of its ethical implications, and everyday use of AI tools. In addition, AI applications commonly used by students and their integration into other disciplines are investigated. The study aims to provide educators with a deeper understanding of students' perceptions of AI and its relevance in society and in their future career paths.

Read more

5/24/2024

🤖

The Potential and Implications of Generative AI on HCI Education

Ahmed Kharrufa, Ian G Johnson

YC

0

Reddit

0

Generative AI (GAI) is impacting teaching and learning directly or indirectly across a range of subjects and disciplines. As educators, we need to understand the potential and limitations of AI in HCI education and ensure our graduating HCI students are aware of the potential and limitations of AI in HCI. In this paper, we report on the main pedagogical insights gained from the inclusion of generative AI into a 10 week undergraduate module. We designed the module to encourage student experimentation with GAI models as part of the design brief requirement and planned practical sessions and discussions. Our insights are based on replies to a survey sent out to the students after completing the module. Our key findings, for HCI educators, report on the use of AI as a persona for developing project ideas and creating resources for design, and AI as a mirror for reflecting students' understanding of key concepts and ideas and highlighting knowledge gaps. We also discuss potential pitfalls that should be considered and the need to assess students' literacies and assumptions of GAIs as pedagogical tools. Finally, we put forward the case for educators to take the opportunities GAI presents as an educational tool and be experimental, creative, and courageous in their practice. We end with a discussion of our findings in relation to the TPACK framework in HCI.

Read more

5/9/2024