Student Reflections on Self-Initiated GenAI Use in HCI Education

2405.01467

YC

0

Reddit

0

Published 5/3/2024 by Hauke Sandhaus, Maria Teresa Parreira, Wendy Ju

👀

Abstract

This study explores students' self-initiated use of Generative Artificial Intelligence (GenAI) tools in an interactive systems design class. Through 12 group interviews, students revealed the dual nature of GenAI in (1) stimulating creativity and (2) speeding up design iterations, alongside concerns over its potential to cause shallow learning and reliance. GenAI's benefits were pronounced in the execution phase of design, aiding rapid prototyping and ideation, while its use in initial insight generation posed risks to depth and reflective practice. This reflection highlights the complex role of GenAI in Human-Computer Interaction education, emphasizing the need for balanced integration to leverage its advantages without compromising fundamental learning outcomes.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This study explores how students in an interactive systems design class used Generative Artificial Intelligence (GenAI) tools on their own initiative.
  • Through 12 group interviews, the researchers found that GenAI had both benefits and drawbacks for the students:
    • Benefits included stimulating creativity and speeding up design iterations.
    • Concerns included the potential for shallow learning and over-reliance on GenAI.
  • The paper discusses the complex role of GenAI in Human-Computer Interaction education, emphasizing the need to balance its advantages and disadvantages.

Plain English Explanation

The researchers wanted to understand how students used Generative Artificial Intelligence (GenAI) tools on their own in an interactive systems design class. They interviewed 12 groups of students to get their perspective.

The students said GenAI had both positive and negative effects. On the plus side, it helped spark their creativity and allowed them to quickly try out different design ideas. This was especially useful in the later stages of the design process, when they were working on prototypes and refining their ideas.

However, the students also had some concerns. They worried that over-relying on GenAI could lead to shallow learning, where they don't really understand the fundamentals. There was a risk of becoming too dependent on the technology and not developing their own critical thinking skills.

Overall, the researchers concluded that GenAI plays a complex role in Human-Computer Interaction (HCI) education. The challenge is to find the right balance - using GenAI to leverage its benefits, while still ensuring students master the core concepts and skills. This will require careful integration of the technology into the curriculum.

Technical Explanation

The study used a qualitative research approach, conducting 12 group interviews with students in an interactive systems design course. The researchers wanted to understand how the students self-initiated the use of Generative Artificial Intelligence (GenAI) tools in their design process.

Through the interviews, the researchers identified two key ways GenAI impacted the students' work:

  1. Stimulating creativity: GenAI tools helped the students generate new ideas and explore different design concepts more quickly. This was particularly beneficial in the execution phase of the design process.

  2. Speeding up design iterations: GenAI enabled the students to rapidly prototype and test ideas, leading to faster design cycles.

However, the students also expressed concerns about the potential drawbacks of using GenAI:

  • Shallow learning: There were worries that over-reliance on GenAI could lead to superficial understanding, rather than deep engagement with the core principles of design.
  • Overdependence: Some students felt that becoming too accustomed to the capabilities of GenAI tools could make them overly dependent on the technology.

The researchers conclude that GenAI plays a complex role in HCI education, offering both advantages and disadvantages. They emphasize the need for balanced integration of the technology to leverage its benefits without compromising fundamental learning outcomes.

Critical Analysis

The paper provides valuable insights into how students are utilizing Generative AI tools in their design work, but it also highlights some potential concerns that warrant further exploration.

One limitation of the study is the relatively small sample size of 12 group interviews. While the qualitative approach provides rich, contextual data, a larger-scale study could help validate the findings and uncover additional nuances in how students interact with GenAI.

Additionally, the paper does not delve deeply into the specific GenAI tools used by the students or how their capabilities and limitations may have influenced the observed outcomes. A more detailed examination of the technologies employed could shed light on the optimal ways to integrate them into the HCI curriculum.

The researchers acknowledge the need for "balanced integration" of GenAI, but more guidance on what that looks like in practice would be helpful. Exploring effective teaching strategies and assessment methods to ensure students develop a strong conceptual foundation, while still leveraging the advantages of GenAI, could be a fruitful area for future research.

Overall, this study raises important questions about the role of Generative AI in HCI education and the need to carefully navigate its implementation to support meaningful learning.

Conclusion

This study provides valuable insights into how students in an interactive systems design class are using Generative Artificial Intelligence (GenAI) tools on their own initiative. The researchers found that GenAI can stimulate creativity and speed up design iterations, but also carries the risks of shallow learning and over-reliance.

The paper highlights the complex and nuanced role of GenAI in Human-Computer Interaction (HCI) education, emphasizing the need for balanced integration to leverage its advantages without compromising fundamental learning outcomes. As Generative AI continues to evolve and impact various domains, understanding its implications for HCI education will be crucial for ensuring students develop the necessary skills and critical thinking abilities to thrive in an increasingly AI-driven world.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

🤖

The Potential and Implications of Generative AI on HCI Education

Ahmed Kharrufa, Ian G Johnson

YC

0

Reddit

0

Generative AI (GAI) is impacting teaching and learning directly or indirectly across a range of subjects and disciplines. As educators, we need to understand the potential and limitations of AI in HCI education and ensure our graduating HCI students are aware of the potential and limitations of AI in HCI. In this paper, we report on the main pedagogical insights gained from the inclusion of generative AI into a 10 week undergraduate module. We designed the module to encourage student experimentation with GAI models as part of the design brief requirement and planned practical sessions and discussions. Our insights are based on replies to a survey sent out to the students after completing the module. Our key findings, for HCI educators, report on the use of AI as a persona for developing project ideas and creating resources for design, and AI as a mirror for reflecting students' understanding of key concepts and ideas and highlighting knowledge gaps. We also discuss potential pitfalls that should be considered and the need to assess students' literacies and assumptions of GAIs as pedagogical tools. Finally, we put forward the case for educators to take the opportunities GAI presents as an educational tool and be experimental, creative, and courageous in their practice. We end with a discussion of our findings in relation to the TPACK framework in HCI.

Read more

5/9/2024

🤖

A Systematic Review of Generative AI for Teaching and Learning Practice

Bayode Ogunleye, Kudirat Ibilola Zakariyyah, Oluwaseun Ajao, Olakunle Olayinka, Hemlata Sharma

YC

0

Reddit

0

The use of generative artificial intelligence (GenAI) in academia is a subjective and hotly debated topic. Currently, there are no agreed guidelines towards the usage of GenAI systems in higher education (HE) and, thus, it is still unclear how to make effective use of the technology for teaching and learning practice. This paper provides an overview of the current state of research on GenAI for teaching and learning in HE. To this end, this study conducted a systematic review of relevant studies indexed by Scopus, using the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. The search criteria revealed a total of 625 research papers, of which 355 met the final inclusion criteria. The findings from the review showed the current state and the future trends in documents, citations, document sources/authors, keywords, and co-authorship. The research gaps identified suggest that while some authors have looked at understanding the detection of AI-generated text, it may be beneficial to understand how GenAI can be incorporated into supporting the educational curriculum for assessments, teaching, and learning delivery. Furthermore, there is a need for additional interdisciplinary, multidimensional studies in HE through collaboration. This will strengthen the awareness and understanding of students, tutors, and other stakeholders, which will be instrumental in formulating guidelines, frameworks, and policies for GenAI usage.

Read more

6/17/2024

🤔

Understanding Student and Academic Staff Perceptions of AI Use in Assessment and Feedback

Jasper Roe (James Cook University Singapore), Mike Perkins (British University Vietnam), Daniel Ruelle (VinUniversity)

YC

0

Reddit

0

The rise of Artificial Intelligence (AI) and Generative Artificial Intelligence (GenAI) in higher education necessitates assessment reform. This study addresses a critical gap by exploring student and academic staff experiences with AI and GenAI tools, focusing on their familiarity and comfort with current and potential future applications in learning and assessment. An online survey collected data from 35 academic staff and 282 students across two universities in Vietnam and one in Singapore, examining GenAI familiarity, perceptions of its use in assessment marking and feedback, knowledge checking and participation, and experiences of GenAI text detection. Descriptive statistics and reflexive thematic analysis revealed a generally low familiarity with GenAI among both groups. GenAI feedback was viewed negatively; however, it was viewed more positively when combined with instructor feedback. Academic staff were more accepting of GenAI text detection tools and grade adjustments based on detection results compared to students. Qualitative analysis identified three themes: unclear understanding of text detection tools, variability in experiences with GenAI detectors, and mixed feelings about GenAI's future impact on educational assessment. These findings have major implications regarding the development of policies and practices for GenAI-enabled assessment and feedback in higher education.

Read more

6/26/2024

🤖

The collective use and evaluation of generative AI tools in digital humanities research: Survey-based results

Meredith Dedema, Rongqian Ma

YC

0

Reddit

0

The advent of generative artificial intelligence (GenAI) technologies has revolutionized research, with significant implications for Digital Humanities (DH), a field inherently intertwined with technological progress. This article investigates how digital humanities scholars adopt, practice, as well as critically evaluate, GenAI technologies such as ChatGPT in the research process. Drawing on 76 responses collected from an international survey study, we explored digital humanities scholars' rationale for GenAI adoption in research, identified specific use cases and practices of using GenAI to support various DH research tasks, and analyzed scholars' collective perceptions of GenAI's benefits, risks, and impact on DH research. The survey results suggest that DH research communities hold divisive sentiments towards the value of GenAI in DH scholarship, whereas the actual usage diversifies among individuals and across research tasks. Our survey-based analysis has the potential to serve as a basis for further empirical research on the impact of GenAI on the evolution of DH scholarship.

Read more

4/22/2024