Design Implications for a Social and Collaborative Understanding of online Information Assessment Practices, Challenges and Heuristics

2405.00519

YC

0

Reddit

0

Published 5/2/2024 by Vasilis Vlachokyriakos, Ian G. Johnson, Robert Anderson, Caroline Claisse, Viana Zhang, Pamela Briggs

🤔

Abstract

The broader adoption of social media platforms (e.g., TikTok), combined with recent developments in Generative AI (GAI) technologies has had a transformative effect on many peoples' ability to confidently assess the veracity and meaning of information online. In this paper, building on recent related work that surfaced the social ways that young people evaluate information online, we explore the decision-making practices, challenges and heuristics involved in young adults' assessments of information online. To do so, we designed and conducted a novel digital diary study, followed by data-informed interviews with young adults. Our findings uncover the information practices of young adults including the social and emotional motivations for ignoring, avoiding, and engaging with online information and the ways this is entangled with collaborative arrangements with algorithms as agents. In our discussion we bring these findings in close dialogue with work on information sensibility and contribute rich insights into young peoples' information sensibility practices embedded within social worlds. Finally, we surface how such practices are attuned to prioritise wellbeing over convenience or other commonly associated sufficing heuristics.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper explores how young adults assess the credibility and meaning of information they encounter online, particularly in the context of social media and generative AI technology.
  • The researchers conducted a digital diary study and interviews to understand the decision-making practices, challenges, and heuristics used by young adults when evaluating online information.
  • The findings reveal the social and emotional factors that influence how young adults engage with online information, as well as the ways they collaborate with algorithms in this process.
  • The research contributes insights into the concept of "information sensibility" - how young people prioritize their wellbeing over other considerations when assessing online information.

Plain English Explanation

With the rise of social media platforms like TikTok and advancements in generative AI technology, many people are finding it increasingly difficult to determine the accuracy and meaning of information they see online. This paper explores how young adults navigate this challenge.

The researchers conducted a unique study where young people kept digital diaries and were then interviewed about their experiences. This allowed the researchers to understand the decision-making process young adults use when evaluating online information, including the social and emotional factors that influence their choices.

The study found that young people's information assessment is often driven by a desire to prioritize their wellbeing over other concerns like convenience or efficiency. They may choose to ignore, avoid, or engage with online information based on how it makes them feel, rather than solely on its factual accuracy.

Additionally, the research revealed that young adults' information assessment involves a collaborative relationship with the algorithms that curate and recommend online content. These algorithms play a significant role in shaping the information young people encounter and how they interpret it.

Overall, the paper provides important insights into the complex and nuanced ways young adults evaluate information in our digital age, highlighting the need to consider factors beyond just the objective truthfulness of online content.

Technical Explanation

The researchers designed and conducted a novel digital diary study, followed by data-informed interviews, to explore the decision-making practices, challenges, and heuristics involved in young adults' assessments of information online. This built on previous related work that examined the social aspects of how young people evaluate online information, such as the role of personal opinions and experiences and the potential for AI to support information literacy development.

The digital diary study allowed the researchers to capture young adults' real-time experiences and thought processes as they encountered and evaluated online information. The subsequent interviews then provided deeper insights into the social and emotional factors that shape their information assessment practices.

The findings reveal that young adults' information practices are heavily influenced by their desire to prioritize their wellbeing over other considerations like convenience or efficiency. They use a range of heuristics and collaborative arrangements with algorithms to navigate the abundance of online information, often choosing to ignore, avoid, or engage with content based on how it makes them feel, rather than solely on its factual accuracy.

The researchers situate these findings within the broader concept of "information sensibility" - the ways in which people develop and apply their sensitivity to information in social contexts. They contribute rich insights into how young people's information sensibility practices are embedded within their social worlds and attuned to maintaining their wellbeing.

Critical Analysis

The paper provides a valuable and nuanced exploration of how young adults assess information in the digital age, highlighting the important role of social and emotional factors in this process. By using a novel digital diary methodology, the researchers were able to capture real-time experiences and decision-making that would have been difficult to access through other methods.

However, the study does have some limitations. The sample size, while appropriate for a qualitative study, may not be representative of all young adults. Additionally, the research was conducted in a specific cultural context, and the findings may not fully generalize to other regions or demographics.

Further research could explore how information assessment practices may vary across different age groups, socioeconomic backgrounds, or cultural contexts. It would also be valuable to investigate the long-term impacts of young adults' information sensibility practices on their overall media consumption, decision-making, and wellbeing.

Despite these potential limitations, the paper makes a significant contribution to our understanding of how young people navigate the challenges of evaluating information in the digital age. The insights provided offer important implications for educators, policymakers, and technology designers who aim to support the development of information literacy and the responsible use of generative AI tools in the digital landscape.

Conclusion

This paper offers valuable insights into the complex and nuanced ways young adults assess the credibility and meaning of information they encounter online. By exploring the social and emotional factors that influence their decision-making, the research reveals how young people's information practices are often oriented towards maintaining their wellbeing, rather than solely prioritizing convenience or efficiency.

The findings highlight the importance of considering the broader social context and collaborative arrangements with algorithms when understanding how young people navigate the challenges of the digital age. These insights have important implications for supporting the development of information literacy and responsible technology use among the younger generation.

Overall, this paper contributes to our understanding of the evolving information landscape and the need to develop more holistic approaches to addressing the challenges it presents for young people's media engagement and decision-making.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

🤖

New contexts, old heuristics: How young people in India and the US trust online content in the age of generative AI

Rachel Xu, Nhu Le, Rebekah Park, Laura Murray, Vishnupriya Das, Devika Kumar, Beth Goldberg

YC

0

Reddit

0

We conducted an in-person ethnography in India and the US to investigate how young people (18-24) trusted online content, with a focus on generative AI (GenAI). We had four key findings about how young people use GenAI and determine what to trust online. First, when online, we found participants fluidly shifted between mindsets and emotional states, which we term information modes. Second, these information modes shaped how and why participants trust GenAI and how they applied literacy skills. In the modes where they spent most of their time, they eschewed literacy skills. Third, with the advent of GenAI, participants imported existing trust heuristics from familiar online contexts into their interactions with GenAI. Fourth, although study participants had reservations about GenAI, they saw it as a requisite tool to adopt to keep up with the times. Participants valued efficiency above all else, and used GenAI to further their goals quickly at the expense of accuracy. Our findings suggest that young people spend the majority of their time online not concerned with truth because they are seeking only to pass the time. As a result, literacy interventions should be designed to intervene at the right time, to match users' distinct information modes, and to work with their existing fact-checking practices.

Read more

5/7/2024

👁️

Online search is more likely to lead students to validate true news than to refute false ones

Azza Bouleimen, Luca Luceri, Felipe Cardoso, Luca Botturi, Martin Hermida, Loredana Addimando, Chiara Beretta, Marzia Galloni, Silvia Giordano

YC

0

Reddit

0

With the spread of high-speed Internet and portable smart devices, the way people access and consume information has drastically changed. However, this presents many challenges, including information overload, personal data leakage, and misinformation diffusion. Across the spectrum of risks that Internet users face nowadays, this work focuses on understanding how young people perceive and deal with false information. Within an experimental campaign involving 183 students, we presented six different news items to the participants and invited them to browse the Internet to assess the veracity of the presented information. Our results suggest that online search is more likely to lead students to validate true news than to refute false ones. We found that students change their opinion about a specific piece of information more often than their global idea about a broader topic. Also, our experiment reflected that most participants rely on online sources to obtain information and access the news, and those getting information from books and Internet browsing are the most accurate in assessing the veracity of a news item. This work provides a principled understanding of how young people perceive and distinguish true and false pieces of information, identifying strengths and weaknesses amidst young subjects and contributing to building tailored digital information literacy strategies for youth.

Read more

5/8/2024

Sociotechnical Implications of Generative Artificial Intelligence for Information Access

Sociotechnical Implications of Generative Artificial Intelligence for Information Access

Bhaskar Mitra, Henriette Cramer, Olya Gurevich

YC

0

Reddit

0

Robust access to trustworthy information is a critical need for society with implications for knowledge production, public health education, and promoting informed citizenry in democratic societies. Generative AI technologies may enable new ways to access information and improve effectiveness of existing information retrieval systems but we are only starting to understand and grapple with their long-term social implications. In this chapter, we present an overview of some of the systemic consequences and risks of employing generative AI in the context of information access. We also provide recommendations for evaluation and mitigation, and discuss challenges for future research.

Read more

5/21/2024

🤖

Crafting Tomorrow's Evaluations: Assessment Design Strategies in the Era of Generative AI

Rajan Kadel, Bhupesh Kumar Mishra, Samar Shailendra, Samia Abid, Maneeha Rani, Shiva Prasad Mahato

YC

0

Reddit

0

GenAI has gained the attention of a myriad of users in almost every profession. Its advancement has had an intense impact on education, significantly disrupting the assessment design and evaluation methodologies. Despite the potential benefits and possibilities of GenAI in the education sector, there are several concerns primarily centred around academic integrity, authenticity, equity of access, assessment evaluation methodology, and feedback. Consequently, academia is encountering challenges in assessment design that are essential to retaining academic integrity in the age of GenAI. In this article, we discuss the challenges, and opportunities that need to be addressed for the assessment design and evaluation. The article also highlights the importance of clear policy about the usage of GenAI in completing assessment tasks, and also in design approaches to ensure academic integrity and subject learning. Additionally, this article also provides assessment categorisation based on the use of GenAI to cultivate knowledge among students and academic professionals. It also provides information on the skills necessary to formulate and articulate problems and evaluate the task, enabling students and academics to effectively utilise GenAI tools.

Read more

5/6/2024