We are at the mercy of others' opinion: Supporting Blind People in Recreational Window Shopping with AI-infused Technology

Read original: arXiv:2405.06611 - Published 5/13/2024 by Rie Kamikubo, Hernisa Kacorri, Chieko Asakawa
Total Score

0

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Blind people face challenges in engaging with recreational activities in public spaces, often relying on sighted help.
  • Window shopping, a common recreational activity, remains largely inaccessible to the blind community.
  • This paper investigates the information needs, challenges, and current approaches blind people have to recreational window shopping.
  • The goal is to inform the design of existing wayfinding and navigation technology to better support blind shoppers in exploration and serendipitous discovery.

Plain English Explanation

Blind people often struggle to participate in recreational activities in public areas, frequently needing assistance from sighted individuals. One popular activity, window shopping, remains largely inaccessible to the blind community. This research paper explores the specific information needs, challenges, and current approaches that blind people have when it comes to recreational window shopping. The aim is to use these insights to guide the development of existing navigation and wayfinding technologies, making them better suited to support blind shoppers in exploring stores and discovering new things serendipitously.

Technical Explanation

The researchers conducted a formative study involving 18 blind participants, including both focus groups (8 participants) and individual interviews (10 participants). The goal was to understand the requirements for designing technology to assist blind people with recreational window shopping.

The key findings include:

  • Blind participants expressed a desire for push notifications about promotional information and pull notifications about specific shops or brands that might interest them.
  • The information needed about obstacles and points of interest had to be customized based on the type of mobility aid used, as well as the presence of crowds, children, and wheelchair users.
  • The researchers translated these findings into specific information modalities and rendering approaches within two existing AI-powered assistive applications: NavCog, a turn-by-turn navigation app, and Cabot, a navigation robot.

Critical Analysis

The paper provides a thoughtful exploration of the unique challenges faced by blind people when it comes to recreational window shopping. By involving blind participants directly, the researchers were able to uncover nuanced insights about the type of information and presentation that would be most helpful.

However, the study is limited in scope, focusing only on a relatively small number of participants. Expanding the research to include a wider and more diverse sample of blind individuals could yield additional insights and help ensure the findings are representative of the broader blind community.

Additionally, while the proposed technology solutions, NavCog and Cabot, seem promising, their real-world effectiveness and user acceptance would need to be thoroughly evaluated through further user testing and longitudinal studies.

Conclusion

This research highlights the importance of designing inclusive and accessible technologies for recreational activities, such as window shopping, that are often taken for granted by sighted individuals. By understanding the specific needs and challenges of blind people, the findings can inform the development of more effective wayfinding and navigation tools to support blind shoppers in their exploration and discovery of new stores and products. Continued innovation in this area has the potential to significantly enhance the quality of life and independence for the blind community.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Total Score

0

We are at the mercy of others' opinion: Supporting Blind People in Recreational Window Shopping with AI-infused Technology

Rie Kamikubo, Hernisa Kacorri, Chieko Asakawa

Engaging in recreational activities in public spaces poses challenges for blind people, often involving dependency on sighted help. Window shopping is a key recreational activity that remains inaccessible. In this paper, we investigate the information needs, challenges, and current approaches blind people have to recreational window shopping to inform the design of existing wayfinding and navigation technology for supporting blind shoppers in exploration and serendipitous discovery. We conduct a formative study with a total of 18 blind participants that include both focus groups (N=8) and interviews for requirements analysis (N=10). We find that there is a desire for push notifications of promotional information and pull notifications about shops of interest such as the targeted audience of a brand. Information about obstacles and points-of-interest required customization depending on one's mobility aid as well as presence of a crowd, children, and wheelchair users. We translate these findings into specific information modalities and rendering in the context of two existing AI-infused assistive applications: NavCog (a turn-by-turn navigation app) and Cabot (a navigation robot).

Read more

5/13/2024

🤿

Total Score

0

Accessibility evaluation of major assistive mobile applications available for the visually impaired

Saidarshan Bhagat, Padmaja Joshi, Avinash Agarwal, Shubhanshu Gupta

People with visual impairments face numerous challenges in their daily lives, including mobility, access to information, independent living, and employment. Artificial Intelligence (AI) with Computer Vision (CV) has the potential to improve their daily lives, provide them with necessary independence, and it will also spawn new opportunities in education and employment. However, while many such AI/CV-based mobile applications are now available, these apps are still not the preferred choice amongst visually impaired persons and are generally limited to advanced users only, due to certain limitations. This study evaluates the challenges faced by visually impaired persons when using AI/CV-based mobile apps. Four popular AI/CV- based apps, namely Seeing AI, Supersense, Envision and Lookout, are assessed by blind and low-vision users. Hence these mobile applications are evaluated on a set of parameters, including generic parameters based on the Web Content Accessibility Guidelines (WCAG) and specific parameters related to mobile app testing. The evaluation not only focused on the guidelines but also on the feedback that was gathered from these users on parameters covering the apps' accuracy, response time, reliability, accessibility, privacy, energy efficiency and usability. The paper also identifies the areas of improvement in the development and innovation of these assistive apps. This work will help developers create better accessible AI-based apps for the visually impaired.

Read more

7/26/2024

ShelfHelp: Empowering Humans to Perform Vision-Independent Manipulation Tasks with a Socially Assistive Robotic Cane
Total Score

0

ShelfHelp: Empowering Humans to Perform Vision-Independent Manipulation Tasks with a Socially Assistive Robotic Cane

Shivendra Agrawal, Suresh Nayak, Ashutosh Naik, Bradley Hayes

The ability to shop independently, especially in grocery stores, is important for maintaining a high quality of life. This can be particularly challenging for people with visual impairments (PVI). Stores carry thousands of products, with approximately 30,000 new products introduced each year in the US market alone, presenting a challenge even for modern computer vision solutions. Through this work, we present a proof-of-concept socially assistive robotic system we call ShelfHelp, and propose novel technical solutions for enhancing instrumented canes traditionally meant for navigation tasks with additional capability within the domain of shopping. ShelfHelp includes a novel visual product locator algorithm designed for use in grocery stores and a novel planner that autonomously issues verbal manipulation guidance commands to guide the user during product retrieval. Through a human subjects study, we show the system's success in locating and providing effective manipulation guidance to retrieve desired products with novice users. We compare two autonomous verbal guidance modes achieving comparable performance to a human assistance baseline and present encouraging findings that validate our system's efficiency and effectiveness and through positive subjective metrics including competence, intelligence, and ease of use.

Read more

6/3/2024

AccessShare: Co-designing Data Access and Sharing with Blind People
Total Score

0

AccessShare: Co-designing Data Access and Sharing with Blind People

Rie Kamikubo, Farnaz Zamiri Zeraati, Kyungjun Lee, Hernisa Kacorri

Blind people are often called to contribute image data to datasets for AI innovation with the hope for future accessibility and inclusion. Yet, the visual inspection of the contributed images is inaccessible. To this day, we lack mechanisms for data inspection and control that are accessible to the blind community. To address this gap, we engage 10 blind participants in a scenario where they wear smartglasses and collect image data using an AI-infused application in their homes. We also engineer a design probe, a novel data access interface called AccessShare, and conduct a co-design study to discuss participants' needs, preferences, and ideas on consent, data inspection, and control. Our findings reveal the impact of interactive informed consent and the complementary role of data inspection systems such as AccessShare in facilitating communication between data stewards and blind data contributors. We discuss how key insights can guide future informed consent and data control to promote inclusive and responsible data practices in AI.

Read more

7/30/2024