Haptics-based, higher-order Sensory Substitution designed for Object Negotiation in Blindness and Low Vision: Virtual Whiskers
0
🛠️
Sign in to get full access
Overview
- People with blindness and low vision (pBLV) face challenges in navigating their surroundings.
- Mobility aids are crucial for enhancing their independence and safety.
- This paper presents an electronic travel aid called Virtual Whiskers that uses a haptic-based, higher-order sensory substitution approach to help pBLV negotiate obstacles.
Plain English Explanation
Virtual Whiskers is designed to assist people with blindness and low vision in navigating their environment more effectively, efficiently, and safely. It uses a system of vibration units that provide haptic feedback to the user, allowing them to "feel" their surroundings without relying solely on sight.
The device has two navigation modes: open path mode and depth mode. The open path mode detects and delineates a traversable area within the user's field of view, then guides them through it using adaptive vibratory feedback. The depth mode, on the other hand, highlights spatial areas with prominent obstacles via haptic feedback, helping users negotiate those obstacles more easily.
Researchers conducted user testing with 10 participants who had blindness or low vision. The results showed that Virtual Whiskers significantly reduces idle periods and decreases the number of cane contacts, indicating that it is a promising obstacle negotiation strategy for assisting pBLV with navigation.
Technical Explanation
The Virtual Whiskers device is equipped with a plurality of modular vibration units that operate independently to deliver haptic feedback to users. This haptic-based, higher-order sensory substitution approach aims to help pBLV negotiate obstacles more effectively.
The two navigation modes of Virtual Whiskers address obstacle negotiation from different perspectives. The open path mode detects and delineates a traversable area within the analyzed field of view, then guides the user through the traversable direction using adaptive vibratory feedback. The depth mode, on the other hand, assists users in negotiating obstacles by highlighting spatial areas with prominent obstacles via haptic feedback.
During user testing, 10 participants with blindness or low vision were recruited to evaluate the performance of Virtual Whiskers. The results showed that the device significantly reduces idle periods and decreases the number of cane contacts, indicating its potential to assist with pBLV navigation.
Critical Analysis
The paper provides a promising approach to enhancing the navigation capabilities of people with blindness and low vision. However, the study is limited by its small sample size of 10 participants. Further research with a larger and more diverse participant pool would be necessary to validate the findings and assess the device's effectiveness across a broader range of users and scenarios.
Additionally, the paper does not address potential limitations or challenges that may arise in the real-world implementation of Virtual Whiskers, such as issues related to device ergonomics, battery life, or integration with other assistive technologies. Exploring these aspects more thoroughly would help identify and address potential barriers to the widespread adoption of the device.
Conclusion
The Virtual Whiskers electronic travel aid presents a novel haptic-based approach to assisting people with blindness and low vision in navigating their surroundings more effectively, efficiently, and safely. The initial user testing results are promising, suggesting that the device has the potential to significantly improve the mobility and independence of this population. Further research and development, however, will be necessary to refine the technology and address any practical limitations before it can be widely deployed.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🛠️
0
Haptics-based, higher-order Sensory Substitution designed for Object Negotiation in Blindness and Low Vision: Virtual Whiskers
Junchi Feng, Giles Hamilton-Fletcher, Todd E Hudson, Mahya Beheshti, Maurizio Porfiri, John-Ross Rizzo
People with blindness and low vision (pBLV) face challenges in navigating. Mobility aids are crucial for enhancing independence and safety. This paper presents an electronic travel aid that leverages a haptic-based, higher-order sensory substitution approach called Virtual Whiskers, designed to help pBLV negotiate obstacles effectively, efficiently, and safely. Virtual Whiskers is equipped with a plurality of modular vibration units that operate independently to deliver haptic feedback to users. Virtual Whiskers features two navigation modes: open path mode and depth mode, each addressing obstacle negotiation from different perspectives. The open path mode detects and delineate a traversable area within an analyzed field of view. Then, it guides the user through to the traversable direction adaptive vibratory feedback. The depth mode assists users in negotiating obstacles by highlighting spatial areas with prominent obstacles via haptic feedback. We recruited 10 participants with blindness or low vision to participate in user testing for Virtual Whiskers. Results show that the device significantly reduces idle periods and decreases the number of cane contacts. Virtual Whiskers is a promising obstacle negotiation strategy that demonstrating great potential to assist with pBLV navigation.
Read more8/28/2024
0
Navigation and 3D Surface Reconstruction from Passive Whisker Sensing
Michael A. Lin, Hao Li, Chengyi Xing, Mark R. Cutkosky
Whiskers provide a way to sense surfaces in the immediate environment without disturbing it. In this paper we present a method for using highly flexible, curved, passive whiskers mounted along a robot arm to gather sensory data as they brush past objects during normal robot motion. The information is useful both for guiding the robot in cluttered spaces and for reconstructing the exposed faces of objects. Surface reconstruction depends on accurate localization of contact points along each whisker. We present an algorithm based on Bayesian filtering that rapidly converges to within 1,mm of the actual contact locations. The piecewise-continuous history of contact locations from each whisker allows for accurate reconstruction of curves on object surfaces. Employing multiple whiskers and traces, we are able to produce an occupancy map of proximal objects.
Read more6/11/2024
0
See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot
Rayna Hata, Narit Trikasemsak, Andrea Giudice, Stacy A. Doore
While there is no replacement for the learned expertise, devotion, and social benefits of a guide dog, there are cases in which a robot navigation assistant could be helpful for individuals with blindness or low vision (BLV). This study investigated the potential for an industrial agile robot to perform guided navigation tasks. We developed two interface prototypes that allowed for spatial information between a human-robot pair: a voice-based app and a flexible, responsive handle. The participants (n=21) completed simple navigation tasks and a post-study survey about the prototype functionality and their trust in the robot. All participants successfully completed the navigation tasks and demonstrated the interface prototypes were able to pass spatial information between the human and the robot. Future work will include expanding the voice-based app to allow the robot to communicate obstacles to the handler and adding haptic signals to the handle design.
Read more6/10/2024
👀
0
Multi-faceted Sensory Substitution for Curb Alerting: A Pilot Investigation in Persons with Blindness and Low Vision
Ligao Ruan, Giles Hamilton-Fletcher, Mahya Beheshti, Todd E Hudson, Maurizio Porfiri, JR Rizzo
Curbs -- the edge of a raised sidewalk at the point where it meets a street -- crucial in urban environments where they help delineate safe pedestrian zones, from dangerous vehicular lanes. However, curbs themselves are significant navigation hazards, particularly for people who are blind or have low vision (pBLV). The challenges faced by pBLV in detecting and properly orientating themselves for these abrupt elevation changes can lead to falls and serious injuries. Despite recent advancements in assistive technologies, the detection and early warning of curbs remains a largely unsolved challenge. This paper aims to tackle this gap by introducing a novel, multi-faceted sensory substitution approach hosted on a smart wearable; the platform leverages an RGB camera and an embedded system to capture and segment curbs in real time and provide early warning and orientation information. The system utilizes YOLO (You Only Look Once) v8 segmentation model, trained on our custom curb dataset for the camera input. The output of the system consists of adaptive auditory beeps, abstract sonification, and speech, conveying information about the relative distance and orientation of curbs. Through human-subjects experimentation, we demonstrate the effectiveness of the system as compared to the white cane. Results show that our system can provide advanced warning through a larger safety window than the cane, while offering nearly identical curb orientation information.
Read more8/29/2024