Engaging with Children's Artwork in Mixed Visual-Ability Families
0
Sign in to get full access
Overview
- This paper explores how mixed-ability families can engage with children's artwork, particularly for families with members who are blind or have low vision.
- The researchers investigate how AI-powered tools and techniques can be used to make children's artwork more accessible and facilitate shared experiences for families with diverse visual abilities.
- The study aims to inform the design of future tools and interfaces to support meaningful engagement with children's artwork in mixed-ability settings.
Plain English Explanation
The paper looks at how families with both sighted and visually impaired members can interact with and appreciate children's artwork. The researchers explore how AI technology can be used to make children's drawings and paintings more accessible for everyone in the family.
For example, an AI system could analyze a child's artwork and describe the key elements, like the colors, shapes, and content, in a way that a blind parent could understand. This could allow the whole family to discuss and appreciate the artwork together, even if some members can't see it directly.
The goal is to find ways for mixed-ability families to have shared experiences engaging with their children's creations. The researchers want to inform the design of future tools and interfaces that can better support this kind of inclusive, multi-sensory interaction with children's art.
Technical Explanation
The paper presents a qualitative study exploring the experiences of mixed-ability families engaging with children's artwork. The researchers conducted in-depth interviews with 12 families, including both sighted and visually impaired members, to understand their current practices, challenges, and desires around interacting with children's art.
The interviews revealed that while families use a variety of strategies, like verbal description and physical touch, they face significant barriers to truly shared experiences. The researchers then conceptualized a set of design principles to guide the development of AI-powered tools that could make children's artwork more accessible and facilitate more meaningful, multi-sensory engagement.
The proposed design framework includes techniques like generating audio or haptic representations of visual artwork, as well as incorporating computer vision to automatically describe key visual elements. The researchers also highlight the importance of allowing families to customize the tools to their specific needs and preferences.
Critical Analysis
The paper provides valuable insights into an important but understudied area of accessibility and inclusive design. By focusing on the nuanced experiences of mixed-ability families, the researchers uncovered a range of challenges and opportunities that are often overlooked in more general accessibility research.
However, the study is limited by its relatively small sample size and geographic scope, which may not capture the full diversity of family structures and visual abilities. Additionally, the paper does not provide much detail on the specific implementation or evaluation of the proposed design framework, leaving questions about its feasibility and effectiveness.
Further research is needed to build on these insights and develop and test practical, user-centered tools that can truly enhance the shared experience of engaging with children's artwork in mixed-ability households.
Conclusion
This paper highlights the importance of considering the unique needs and experiences of mixed-ability families, particularly when it comes to engaging with children's creative outputs. The researchers' exploration of AI-powered tools to make artwork more accessible represents a promising avenue for supporting inclusive, multi-sensory experiences within these families.
While more work is needed to refine and validate the proposed design principles, this study lays valuable groundwork for the development of future technologies and interfaces that can foster deeper connections and shared understandings within diverse families.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Engaging with Children's Artwork in Mixed Visual-Ability Families
Arnavi Chheda-Kothary, Jacob O. Wobbrock, Jon E. Froehlich
We present two studies exploring how blind or low-vision (BLV) family members engage with their sighted children's artwork, strategies to support understanding and interpretation, and the potential role of technology, such as AI, therein. Our first study involved 14 BLV individuals, and the second included five groups of BLV individuals with their children. Through semi-structured interviews with AI descriptions of children's artwork and multi-sensory design probes, we found that BLV family members value artwork engagement as a bonding opportunity, preferring the child's storytelling and interpretation over other nonvisual representations. Additionally, despite some inaccuracies, BLV family members felt that AI-generated descriptions could facilitate dialogue with their children and aid self-guided art discovery. We close with specific design considerations for supporting artwork engagement in mixed visual-ability families, including enabling artwork access through various methods, supporting children's corrections of AI output, and distinctions in context vs. content and interpretation vs. description of children's artwork.
Read more7/31/2024
🤖
0
Exploring Use and Perceptions of Generative AI Art Tools by Blind Artists
Gayatri Raman, Erin Brady
The paper explores the intersection of AI art and blindness, as existing AI research has primarily focused on AI art's reception and impact, on sighted artists and consumers. To address this gap, the researcher interviewed six blind artists from various visual art mediums and levels of blindness about the generative AI image platform Midjourney. The participants shared text prompts and discussed their reactions to the generated images with the sighted researcher. The findings highlight blind artists' interest in AI images as a collaborative tool but express concerns about cultural perceptions and labeling of AI-generated art. They also underscore unique challenges, such as potential misunderstandings and stereotypes about blindness leading to exclusion. The study advocates for greater inclusion of blind individuals in AI art, emphasizing the need to address their specific needs and experiences in developing AI art technologies.
Read more9/14/2024
🤖
0
Misfitting With AI: How Blind People Verify and Contest AI Errors
Rahaf Alharbi, Pa Lor, Jaylin Herskovitz, Sarita Schoenebeck, Robin Brewer
Blind people use artificial intelligence-enabled visual assistance technologies (AI VAT) to gain visual access in their everyday lives, but these technologies are embedded with errors that may be difficult to verify non-visually. Previous studies have primarily explored sighted users' understanding of AI output and created vision-dependent explainable AI (XAI) features. We extend this body of literature by conducting an in-depth qualitative study with 26 blind people to understand their verification experiences and preferences. We begin by describing errors blind people encounter, highlighting how AI VAT fails to support complex document layouts, diverse languages, and cultural artifacts. We then illuminate how blind people make sense of AI through experimenting with AI VAT, employing non-visual skills, strategically including sighted people, and cross-referencing with other devices. Participants provided detailed opportunities for designing accessible XAI, such as affordances to support contestation. Informed by disability studies framework of misfitting and fitting, we unpacked harmful assumptions with AI VAT, underscoring the importance of celebrating disabled ways of knowing. Lastly, we offer practical takeaways for Responsible AI practice to push the field of accessible XAI forward.
Read more8/14/2024
📈
0
Emerging Practices for Large Multimodal Model (LMM) Assistance for People with Visual Impairments: Implications for Design
Jingyi Xie, Rui Yu, He Zhang, Sooyeon Lee, Syed Masum Billah, John M. Carroll
People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large vision-language model-based AI-powered tools like Be My AI are more capable of understanding users' inquiries in natural language and describing the scene in audible text; however, the extent to which these tools are useful to visually impaired users is currently understudied. This paper aims to fill this gap. Our study with 14 visually impaired users reveals that they are adapting these tools organically -- not only can these tools facilitate complex interactions in household, spatial, and social contexts, but they also act as an extension of users' cognition, as if the cognition were distributed in the visual information. We also found that although the tools are currently not goal-oriented, users accommodate this limitation and embrace the tools' capabilities for broader use. These findings enable us to envision design implications for creating more goal-oriented, real-time processing, and reliable AI-powered assistive technology.
Read more7/15/2024