A Perspective Study on Chinese Social Media regarding LLM for Education and Beyond
2306.04325
0
0
🏋️
Abstract
The application of AI-powered tools has piqued the interest of many fields, particularly in the academic community. This study uses ChatGPT, currently the most powerful and popular AI tool, as a representative example to analyze how the Chinese public perceives the potential of large language models (LLMs) for educational and general purposes. Although facing accessibility challenges, we found that the number of discussions on ChatGPT per month is 16 times that of Ernie Bot developed by Baidu, the most popular alternative product to ChatGPT in the mainland, making ChatGPT a more suitable subject for our analysis. The study also serves as the first effort to investigate the changes in public opinion as AI technologies become more advanced and intelligent. The analysis reveals that, upon first encounters with advanced AI that was not yet highly capable, some social media users believed that AI advancements would benefit education and society, while others feared that advanced AI, like ChatGPT, would make humans feel inferior and lead to problems such as cheating and a decline in moral principles. The majority of users remained neutral. Interestingly, with the rapid development and improvement of AI capabilities, public attitudes have tended to shift in a positive direction. We present a thorough analysis of the trending shift and a roadmap to ensure the ethical application of ChatGPT-like models in education and beyond.
Create account to get full access
Overview
- This study examines how the Chinese public perceives the potential of large language models (LLMs), using ChatGPT as a representative example.
- It explores the public's attitudes towards advanced AI technologies, particularly in the context of education and general applications.
- The study serves as the first effort to investigate the changes in public opinion as AI technologies become more advanced and intelligent.
Plain English Explanation
The paper explores how people in China are reacting to the rise of powerful AI language models, like ChatGPT. The researchers focused on ChatGPT because it is currently the most popular and capable AI tool of its kind, even more so than similar products developed in China, such as Ernie Bot.
The study looked at what people on social media think about using advanced AI systems like ChatGPT for things like education and everyday tasks. At first, some people were excited about the potential benefits, while others worried that AI would make humans feel inferior and lead to problems like cheating or a decline in moral standards. Over time, as the AI capabilities have improved, public attitudes have generally become more positive.
The researchers provide a detailed analysis of this shift in public opinion and offer suggestions to ensure these powerful AI models, like ChatGPT, are used ethically in education and other areas.
Technical Explanation
The researchers used social media data to analyze public perceptions of ChatGPT, which they chose as a representative example of advanced LLMs. They found that the monthly discussion volume on ChatGPT was 16 times higher than for Ernie Bot, the most popular alternative in mainland China, making ChatGPT a more suitable subject for their analysis.
The study examined how public attitudes changed as ChatGPT and similar AI technologies became more sophisticated. Initially, some social media users believed AI advancements would benefit education and society, while others feared AI would make humans feel inferior and lead to issues like cheating and moral decline. However, the researchers observed a positive shift in public opinion as the AI capabilities rapidly improved.
The paper presents a thorough analysis of this trending shift in public perception and proposes a roadmap to ensure the ethical application of ChatGPT-like models in education and beyond, drawing on the insights from prior research on the use of AI in education.
Critical Analysis
The study provides valuable insights into the evolving public perceptions of advanced AI technologies, particularly in the context of educational applications. However, the paper does not delve into the potential limitations or biases inherent in social media data, which could influence the findings.
Additionally, the researchers focus primarily on the Chinese public's views, so the global perspective may not be fully represented. Further research could explore how perceptions vary across different cultural and sociopolitical contexts.
Conclusion
This study offers a nuanced understanding of how the public's perception of advanced AI models, like ChatGPT, has evolved over time. The researchers provide a comprehensive analysis of the shifting attitudes and propose a framework to ensure the ethical integration of these powerful technologies in education and other domains. As AI capabilities continue to advance, ongoing public discourse and critical evaluation will be crucial to shape the responsible development and deployment of these transformative tools.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🤿
Potential Societal Biases of ChatGPT in Higher Education: A Scoping Review
Ming Li, Ariunaa Enkhtur, Beverley Anne Yamamoto, Fei Cheng
0
0
Purpose:Generative Artificial Intelligence (GAI) models, such as ChatGPT, may inherit or amplify societal biases due to their training on extensive datasets. With the increasing usage of GAI by students, faculty, and staff in higher education institutions (HEIs), it is urgent to examine the ethical issues and potential biases associated with these technologies. Design/Approach/Methods:This scoping review aims to elucidate how biases related to GAI in HEIs have been researched and discussed in recent academic publications. We categorized the potential societal biases that GAI might cause in the field of higher education. Our review includes articles written in English, Chinese, and Japanese across four main databases, focusing on GAI usage in higher education and bias. Findings:Our findings reveal that while there is meaningful scholarly discussion around bias and discrimination concerning LLMs in the AI field, most articles addressing higher education approach the issue superficially. Few articles identify specific types of bias under different circumstances, and there is a notable lack of empirical research. Most papers in our review focus primarily on educational and research fields related to medicine and engineering, with some addressing English education. However, there is almost no discussion regarding the humanities and social sciences. Additionally, a significant portion of the current discourse is in English and primarily addresses English-speaking contexts. Originality/Value:To the best of our knowledge, our study is the first to summarize the potential societal biases in higher education. This review highlights the need for more in-depth studies and empirical work to understand the specific biases that GAI might introduce or amplify in educational settings, guiding the development of more ethical AI applications in higher education.
6/26/2024
🌐
ChatGPT Is Here to Help, Not to Replace Anybody -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses
Bruno Pereira Cipriano, Pedro Alves
0
0
Large Language Models (LLMs) like GPT and Bard are capable of producing code based on textual descriptions, with remarkable efficacy. Such technology will have profound implications for computing education, raising concerns about cheating, excessive dependence, and a decline in computational thinking skills, among others. There has been extensive research on how teachers should handle this challenge but it is also important to understand how students feel about this paradigm shift. In this research, 52 first-year CS students were surveyed in order to assess their views on technologies with code-generation capabilities, both from academic and professional perspectives. Our findings indicate that while students generally favor the academic use of GPT, they don't over rely on it, only mildly asking for its help. Although most students benefit from GPT, some struggle to use it effectively, urging the need for specific GPT training. Opinions on GPT's impact on their professional lives vary, but there is a consensus on its importance in academic practice.
4/29/2024
↗️
Unveiling the Competitive Dynamics: A Comparative Evaluation of American and Chinese LLMs
Zhenhui Jiang, Jiaxin Li, Yang Liu
0
0
The strategic significance of Large Language Models (LLMs) in economic expansion, innovation, societal development, and national security has been increasingly recognized since the advent of ChatGPT. This study provides a comprehensive comparative evaluation of American and Chinese LLMs in both English and Chinese contexts. We proposed a comprehensive evaluation framework that encompasses natural language proficiency, disciplinary expertise, and safety and responsibility, and systematically assessed 16 prominent models from the US and China under various operational tasks and scenarios. Our key findings show that GPT 4-Turbo is at the forefront in English contexts, whereas Ernie-Bot 4 stands out in Chinese contexts. The study also highlights disparities in LLM performance across languages and tasks, stressing the necessity for linguistically and culturally nuanced model development. The complementary strengths of American and Chinese LLMs point to the value of Sino-US collaboration in advancing LLM technology. The research presents the current LLM competition landscape and offers valuable insights for policymakers and businesses regarding strategic LLM investments and development. Future work will expand on this framework to include emerging LLM multimodal capabilities and business application assessments.
5/22/2024
💬
Experiences from Integrating Large Language Model Chatbots into the Classroom
Arto Hellas, Juho Leinonen, Leo Leppanen
0
0
In the present study, we provided students an unfiltered access to a state-of-the-art large language model (LLM) chatbot. The chatbot was intentionally designed to mimic proprietary commercial chatbots such as ChatGPT where the chatbot has not been tailored for the educational context; the underlying engine was OpenAI GPT-4. The chatbot was integrated into online learning materials of three courses. One of the courses focused on software engineering with LLMs, while the two other courses were not directly related to LLMs. Our results suggest that only a minority of students engage with the chatbot in the courses that do not relate to LLMs. At the same time, unsurprisingly, nearly all students in the LLM-focused course leveraged the chatbot. In all courses, the majority of the LLM usage came from a few superusers, whereas the majority of the students did not heavily use the chatbot even though it was readily available and effectively provided a free access to the OpenAI GPT-4 model. We also observe that in addition to students using the chatbot for course-specific purposes, many use the chatbot for their own purposes. These results suggest that the worst fears of educators -- all students overrelying on LLMs -- did not materialize even when the chatbot access was unfiltered. We finally discuss potential reasons for the low usage, suggesting the need for more tailored and scaffolded LLM experiences targeted for specific types of student use cases.
6/10/2024