Students' Perceived Roles, Opportunities, and Challenges of a Generative AI-powered Teachable Agent: A Case of Middle School Math Class

Overview

• Researchers explored how middle school students perceived the use of Generative AI (GenAI) in a teachable agent (TA) system.
• They studied the expected roles, benefits, and challenges of GenAI-powered TAs in a mathematics classroom.
• The study involved classroom observations, focus-group interviews, and surveys with 108 sixth-grade students.

Plain English Explanation

Researchers wanted to understand how middle school students felt about using an AI-powered "teachable agent" in their math class. A teachable agent is a learning tool that lets students teach an AI system, rather than just being taught by it.

The researchers observed the students in their math classes, interviewed them in small groups, and had them fill out surveys. They wanted to know what roles the students expected the AI-powered teachable agent to play, what benefits they thought it could provide, and what challenges they anticipated.

The students saw the AI-powered teachable agent as a learning companion, someone to help facilitate their learning, and a collaborator in solving problems. They identified both positive and negative aspects of using this technology in their classrooms.

The researchers hope this study will help guide the design of educational AI systems and how they are used alongside teachers to support student learning.

Technical Explanation

The study explored middle school students' perceptions of using Generative AI (GenAI) in a teachable agent (TA) system. Teachable agents allow students to teach an AI system, rather than just being taught by it.

Through classroom observation, focus-group interviews, and open-ended surveys with 108 sixth-grade students, the researchers explored the students' expected roles, benefits, and challenges of using a GenAI-powered TA in a mathematics classroom.

The students saw the GenAI-powered TA as a learning companion, a facilitator, and a collaborative problem-solver. They expressed both positive and negative perceptions of this technology in their learning environment.

Critical Analysis

The study provides valuable insights into how students perceive the use of Generative AI in a teachable agent system. However, the research was limited to a specific grade level and subject area, so the findings may not fully generalize to other educational contexts.

Additionally, the study relied on self-reported data from students, which could be influenced by social desirability bias or other factors. Further research involving longitudinal observations or performance-based assessments could provide more objective measures of the impact of GenAI-powered TAs on student learning.

It would also be interesting to explore the perspectives of teachers and compare them to the students' views to gain a more comprehensive understanding of the challenges and opportunities presented by this educational technology.

Conclusion

This study offers important insights into students' perceptions of Generative AI in the context of a teachable agent system. The findings suggest that students see the potential benefits of this technology, such as having a learning companion and collaborative problem-solver, but also anticipate challenges that will need to be addressed.

The implications of this research can inform the design of educational AI-assisted instruction and the broader integration of Generative AI in the classroom. By understanding students' perspectives, educators and researchers can work to develop AI systems that effectively support and empower learners.