The collective use and evaluation of generative AI tools in digital humanities research: Survey-based results
2404.12458
0
0
🤖
Abstract
The advent of generative artificial intelligence (GenAI) technologies has revolutionized research, with significant implications for Digital Humanities (DH), a field inherently intertwined with technological progress. This article investigates how digital humanities scholars adopt, practice, as well as critically evaluate, GenAI technologies such as ChatGPT in the research process. Drawing on 76 responses collected from an international survey study, we explored digital humanities scholars' rationale for GenAI adoption in research, identified specific use cases and practices of using GenAI to support various DH research tasks, and analyzed scholars' collective perceptions of GenAI's benefits, risks, and impact on DH research. The survey results suggest that DH research communities hold divisive sentiments towards the value of GenAI in DH scholarship, whereas the actual usage diversifies among individuals and across research tasks. Our survey-based analysis has the potential to serve as a basis for further empirical research on the impact of GenAI on the evolution of DH scholarship.
Create account to get full access
Overview
- This paper investigates how digital humanities (DH) scholars are adopting, using, and evaluating generative artificial intelligence (GenAI) technologies like ChatGPT in their research.
- The researchers conducted an international survey study with 76 DH scholars to understand their rationale for using GenAI, specific use cases, and perceptions of the benefits, risks, and impact on DH research.
- The findings suggest DH communities have divided views on the value of GenAI, while individual usage varies across different research tasks.
Plain English Explanation
The rise of generative AI technologies has significantly impacted various fields, including digital humanities (DH). DH is a discipline that intersects with technological advancements, so it's crucial to understand how scholars in this area are adopting and evaluating these new AI tools.
This study aimed to explore how DH researchers are using ChatGPT and other generative AI systems in their work. The researchers surveyed 76 DH scholars from around the world to understand their reasons for using these technologies, the specific ways they apply them in their research, and their overall perceptions of the benefits, risks, and impacts on DH scholarship.
The survey results revealed that the DH community holds diverse views on the value of generative AI in their field. While some researchers have enthusiastically incorporated these tools into their work, others remain more skeptical. The actual usage of generative AI also varies significantly across different research tasks and individual scholars.
Technical Explanation
The researchers conducted an international survey study with 76 digital humanities (DH) scholars to investigate their adoption, practices, and perceptions of generative artificial intelligence (GenAI) technologies, such as ChatGPT, in the research process.
The survey explored three key areas:
- The rationale and motivations behind DH scholars' adoption of GenAI in their research
- The specific use cases and practices of using GenAI to support various DH research tasks
- The scholars' collective perceptions of the benefits, risks, and overall impact of GenAI on DH research
The survey results suggest that the DH research community holds divisive sentiments towards the value of GenAI in DH scholarship. While some scholars have enthusiastically embraced these technologies, others remain more skeptical. The actual usage of GenAI also diversifies among individuals and across different research tasks.
The findings from this survey-based analysis provide a foundation for further empirical research on the evolving impact of generative AI on the field of digital humanities.
Critical Analysis
The paper offers valuable insights into the current state of GenAI adoption and perceptions within the digital humanities (DH) research community. However, there are a few limitations and areas for further exploration:
-
The survey sample, while international in scope, is relatively small (76 respondents). A larger, more representative sample could provide more robust and generalizable findings.
-
The paper does not delve deeply into the specific use cases and practices of GenAI in DH research. More detailed case studies or interviews could shed light on the nuanced ways scholars are integrating these technologies into their work.
-
The study focuses on the current state of GenAI usage and perceptions, but does not fully address the potential long-term implications and transformative impact on the evolution of DH scholarship. Further research is needed to understand the trajectory of generative AI's influence on the field.
-
The paper does not mention any potential biases or limitations of the generative AI systems used by the DH scholars, which could be an important consideration when evaluating their impact.
Overall, this study provides a valuable snapshot of the current landscape, but additional research is needed to fully explore the complex relationship between DH and the rapidly evolving field of generative AI.
Conclusion
This paper sheds light on how digital humanities (DH) scholars are navigating the adoption and use of generative artificial intelligence (GenAI) technologies in their research. The survey-based findings reveal a divided landscape, where some researchers have enthusiastically embraced these tools, while others remain more skeptical about their value and impact on DH scholarship.
The study provides a foundation for further empirical research on the evolving role of generative AI in the field of digital humanities. As these technologies continue to advance and influence various academic disciplines, it will be crucial for DH scholars to critically evaluate their benefits, risks, and long-term implications for the future of their field.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🤖
From ChatGPT, DALL-E 3 to Sora: How has Generative AI Changed Digital Humanities Research and Services?
Jiangfeng Liu, Ziyi Wang, Jing Xie, Lei Pei
0
0
Generative large-scale language models create the fifth paradigm of scientific research, organically combine data science and computational intelligence, transform the research paradigm of natural language processing and multimodal information processing, promote the new trend of AI-enabled social science research, and provide new ideas for digital humanities research and application. This article profoundly explores the application of large-scale language models in digital humanities research, revealing their significant potential in ancient book protection, intelligent processing, and academic innovation. The article first outlines the importance of ancient book resources and the necessity of digital preservation, followed by a detailed introduction to developing large-scale language models, such as ChatGPT, and their applications in document management, content understanding, and cross-cultural research. Through specific cases, the article demonstrates how AI can assist in the organization, classification, and content generation of ancient books. Then, it explores the prospects of AI applications in artistic innovation and cultural heritage preservation. Finally, the article explores the challenges and opportunities in the interaction of technology, information, and society in the digital humanities triggered by AI technologies.
4/30/2024
👀
Student Reflections on Self-Initiated GenAI Use in HCI Education
Hauke Sandhaus, Maria Teresa Parreira, Wendy Ju
0
0
This study explores students' self-initiated use of Generative Artificial Intelligence (GenAI) tools in an interactive systems design class. Through 12 group interviews, students revealed the dual nature of GenAI in (1) stimulating creativity and (2) speeding up design iterations, alongside concerns over its potential to cause shallow learning and reliance. GenAI's benefits were pronounced in the execution phase of design, aiding rapid prototyping and ideation, while its use in initial insight generation posed risks to depth and reflective practice. This reflection highlights the complex role of GenAI in Human-Computer Interaction education, emphasizing the need for balanced integration to leverage its advantages without compromising fundamental learning outcomes.
5/3/2024
🤖
A Systematic Review of Generative AI for Teaching and Learning Practice
Bayode Ogunleye, Kudirat Ibilola Zakariyyah, Oluwaseun Ajao, Olakunle Olayinka, Hemlata Sharma
0
0
The use of generative artificial intelligence (GenAI) in academia is a subjective and hotly debated topic. Currently, there are no agreed guidelines towards the usage of GenAI systems in higher education (HE) and, thus, it is still unclear how to make effective use of the technology for teaching and learning practice. This paper provides an overview of the current state of research on GenAI for teaching and learning in HE. To this end, this study conducted a systematic review of relevant studies indexed by Scopus, using the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. The search criteria revealed a total of 625 research papers, of which 355 met the final inclusion criteria. The findings from the review showed the current state and the future trends in documents, citations, document sources/authors, keywords, and co-authorship. The research gaps identified suggest that while some authors have looked at understanding the detection of AI-generated text, it may be beneficial to understand how GenAI can be incorporated into supporting the educational curriculum for assessments, teaching, and learning delivery. Furthermore, there is a need for additional interdisciplinary, multidimensional studies in HE through collaboration. This will strengthen the awareness and understanding of students, tutors, and other stakeholders, which will be instrumental in formulating guidelines, frameworks, and policies for GenAI usage.
6/17/2024
Generative AI and Teachers -- For Us or Against Us? A Case Study
Jenny Pettersson, Elias Hult, Tim Eriksson, Tosin Adewumi
0
0
We present insightful results of a survey on the adoption of generative artificial intelligence (GenAI) by university teachers in their teaching activities. The transformation of education by GenAI, particularly large language models (LLMs), has been presenting both opportunities and challenges, including cheating by students. We prepared the online survey according to best practices and the questions were created by the authors, who have pedagogy experience. The survey contained 12 questions and a pilot study was first conducted. The survey was then sent to all teachers in multiple departments across different campuses of the university of interest in Sweden: Lule{aa} University of Technology. The survey was available in both Swedish and English. The results show that 35 teachers (more than half) use GenAI out of 67 respondents. Preparation is the teaching activity with the most frequency that GenAI is used for and ChatGPT is the most commonly used GenAI. 59% say it has impacted their teaching, however, 55% say there should be legislation around the use of GenAI, especially as inaccuracies and cheating are the biggest concerns.
4/5/2024