I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education
0
🐍
Sign in to get full access
Overview
- The paper examines how the use of Large Language Models (LLMs) by university students impacts the trust and collaboration between lecturers and students.
- It explores the concepts of Informational Justice, Procedural Justice, Team Trust, and Expected Team Performance, and how they are affected by students' use of LLMs.
- The study uses a quantitative survey and Structural Equation Modelling (PLS-SEM) to analyze the relationships between these constructs.
Plain English Explanation
The paper looks at the impact of students using Large Language Models (LLMs) like OpenAI's ChatGPT on the trust and collaboration between lecturers and students. The researchers wanted to understand how this technology affects things like fairness, transparency, and trust in the learning environment.
The key idea is that when students use LLMs to complete assignments or research, it can be hard for lecturers to tell if the work is genuinely the student's or generated by the AI. This can undermine the trust between lecturers and students, which is important for effective collaboration, especially on research projects.
The researchers used a survey and statistical modeling techniques to examine how factors like Informational Justice (the fairness of information sharing) and Procedural Justice (the fairness of the process) influence the level of Team Trust and Expected Team Performance in the lecturer-student relationship.
Technical Explanation
The study used a quantitative construct-based survey to collect data from 23 valid respondents at Ndejje University. The researchers then applied Structural Equation Modelling (PLS-SEM) techniques to analyze the potential relationships between the key constructs.
The findings indicate that lecturers are less concerned about the fairness of LLM use per se, but are more focused on the transparency of how students utilize these tools. This transparency aspect was found to have a significant positive influence on Team Trust between lecturers and students.
The paper contributes to the broader discussion on integrating and regulating the use of LLMs and similar AI models in educational settings. The authors propose that guidelines should support the use of LLMs while enforcing transparency in the lecturer-student collaboration to foster Team Trust and Performance.
Critical Analysis
The study has a relatively small sample size of 23 respondents, which limits the generalizability of the findings. The researchers acknowledge this as a limitation and suggest that future studies should explore the topic with larger and more diverse samples.
Additionally, the paper does not delve into potential strategies or best practices for lecturers to effectively assess and verify student work when LLMs are involved. This is an area that could benefit from further research and guidance for educators.
While the study highlights the importance of transparency in the use of LLMs, it does not provide detailed insights into what specific transparency measures or policies could be implemented to address the trust issues between lecturers and students. More research is needed to develop a comprehensive framework for the ethical and effective integration of LLMs in higher education.
Conclusion
This study sheds light on the critical role of trust in the lecturer-student relationship, particularly in the context of the increasing use of Large Language Models by university students. The findings suggest that transparency in the use of these AI tools is a key factor in maintaining Team Trust and Expected Team Performance.
The paper contributes valuable insights for the development of guidelines and policies that can support the ethical and effective integration of LLMs in higher education. By fostering transparency and trust, universities can create collaborative learning environments that enable students to harness the benefits of these advanced technologies while preserving the integrity of the educational process.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🐍
0
I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education
Simon Kloker, Matthew Bazanya, Twaha Kateete
Trust plays a pivotal role in Lecturer-Student-Collaboration, encompassing teaching and research aspects. The advent of Large Language Models (LLMs) in platforms like Open AI's ChatGPT, coupled with their cost-effectiveness and high-quality results, has led to their rapid adoption among university students. However, discerning genuine student input from LLM-generated output poses a challenge for lecturers. This dilemma jeopardizes the trust relationship between lecturers and students, potentially impacting university downstream activities, particularly collaborative research initiatives. Despite attempts to establish guidelines for student LLM use, a clear framework mutually beneficial for lecturers and students in higher education remains elusive. This study addresses the research question: How does the use of LLMs by students impact Informational and Procedural Justice, influencing Team Trust and Expected Team Performance? Methodically, we applied a quantitative construct-based survey, evaluated using techniques of Structural Equation Modelling (PLS- SEM) to examine potential relationships among these constructs. Our findings based on 23 valid respondents from Ndejje University indicate that lecturers are less concerned about the fairness of LLM use per se but are more focused on the transparency of student utilization, which significantly influences Team Trust positively. This research contributes to the global discourse on integrating and regulating LLMs and subsequent models in education. We propose that guidelines should support LLM use while enforcing transparency in Lecturer-Student- Collaboration to foster Team Trust and Performance. The study contributes valuable insights for shaping policies enabling ethical and transparent LLMs usage in education to ensure effectiveness of collaborative learning environments.
Read more6/24/2024
0
Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception
Harsh Kumar, Ilya Musabirov, Mohi Reza, Jiakai Shi, Xinyuan Wang, Joseph Jay Williams, Anastasia Kuzminykh, Michael Liut
Personalized chatbot-based teaching assistants can be crucial in addressing increasing classroom sizes, especially where direct teacher presence is limited. Large language models (LLMs) offer a promising avenue, with increasing research exploring their educational utility. However, the challenge lies not only in establishing the efficacy of LLMs but also in discerning the nuances of interaction between learners and these models, which impact learners' engagement and results. We conducted a formative study in an undergraduate computer science classroom (N=145) and a controlled experiment on Prolific (N=356) to explore the impact of four pedagogically informed guidance strategies on the learners' performance, confidence and trust in LLMs. Direct LLM answers marginally improved performance, while refining student solutions fostered trust. Structured guidance reduced random queries as well as instances of students copy-pasting assignment questions to the LLM. Our work highlights the role that teachers can play in shaping LLM-supported learning environments.
Read more8/21/2024
0
New!Quantitative Insights into Language Model Usage and Trust in Academia: An Empirical Study
Minseok Jung, Aurora Zhang, Junho Lee, Paul Pu Liang
Language models (LMs) are revolutionizing knowledge retrieval and processing in academia. However, concerns regarding their misuse and erroneous outputs, such as hallucinations and fabrications, are reasons for distrust in LMs within academic communities. Consequently, there is a pressing need to deepen the understanding of how actual practitioners use and trust these models. There is a notable gap in quantitative evidence regarding the extent of LM usage, user trust in their outputs, and issues to prioritize for real-world development. This study addresses these gaps by providing data and analysis of LM usage and trust. Specifically, our study surveyed 125 individuals at a private school and secured 88 data points after pre-processing. Through both quantitative analysis and qualitative evidence, we found a significant variation in trust levels, which are strongly related to usage time and frequency. Additionally, we discover through a polling process that fact-checking is the most critical issue limiting usage. These findings inform several actionable insights: distrust can be overcome by providing exposure to the models, policies should be developed that prioritize fact-checking, and user trust can be enhanced by increasing engagement. By addressing these critical gaps, this research not only adds to the understanding of user experiences and trust in LMs but also informs the development of more effective LMs.
Read more9/17/2024
💬
0
Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics
Virginia Grande, Natalie Kiesler, Maria Andreina Francisco R
The advent of Large Language Models (LLMs) started a serious discussion among educators on how LLMs would affect, e.g., curricula, assessments, and students' competencies. Generative AI and LLMs also raised ethical questions and concerns for computing educators and professionals. This experience report presents an assignment within a course on professional competencies, including some related to ethics, that computing master's students need in their careers. For the assignment, student groups discussed the ethical process by Lennerfors et al. by analyzing a case: a fictional researcher considers whether to attend the real CHI 2024 conference in Hawaii. The tasks were (1) to participate in in-class discussions on the case, (2) to use an LLM of their choice as a discussion partner for said case, and (3) to document both discussions, reflecting on their use of the LLM. Students reported positive experiences with the LLM as a way to increase their knowledge and understanding, although some identified limitations. The LLM provided a wider set of options for action in the studied case, including unfeasible ones. The LLM would not select a course of action, so students had to choose themselves, which they saw as coherent. From the educators' perspective, there is a need for more instruction for students using LLMs: some students did not perceive the tools as such but rather as an authoritative knowledge base. Therefore, this work has implications for educators considering the use of LLMs as discussion partners or tools to practice critical thinking, especially in computing ethics education.
Read more6/19/2024