AdapTics: A Toolkit for Creative Design and Integration of Real-Time Adaptive Mid-Air Ultrasound Tactons
0
🗣️
Sign in to get full access
Overview
- This paper introduces AdapTics, a toolkit for creating adaptive mid-air ultrasound tactons - dynamic sensations that can adjust in real-time based on user interactions, environmental changes, or other inputs.
- Existing design tools for mid-air haptics primarily support creating static tactile sensations (tactons) that cannot change during use, limiting their expressiveness in interactive scenarios.
- AdapTics provides a graphical interface for rapidly prototyping adaptive tactons, along with a software library and Unity package to enable integration into existing applications.
- A user study with 12 XR and haptic designers found that AdapTics can improve Creativity Support Index ratings for Exploration and Expressiveness.
Plain English Explanation
Mid-air ultrasound haptic technology allows users to feel touch sensations without physically touching anything. This can enhance user interaction and immersion in extended reality (XR) applications. However, existing design tools for this technology mainly create static touch sensations that can't change during use. This limits their ability to provide expressive, responsive feedback in interactive scenarios.
AdapTics introduces a new toolkit that lets designers create dynamic, adaptive touch sensations. These "adaptive tactons" can adjust in real-time based on user movements, environmental changes, or other inputs. The toolkit includes a graphical interface for quickly prototyping these adaptive tactons, along with software libraries to integrate them into existing XR apps.
In a study, designers using AdapTics reported improvements in their ability to explore ideas and express what they wanted through the touch sensations, compared to using traditional tools. This suggests AdapTics can enhance the creativity and expressiveness of mid-air haptic experiences.
Technical Explanation
AdapTics provides a graphical interface and supporting software for creating adaptive mid-air ultrasound tactons - touch sensations that can dynamically adjust based on user interactions, environmental changes, or other inputs. This addresses a limitation of existing mid-air haptic design tools, which primarily support creating static tactons without the ability to change at runtime.
The AdapTics graphical interface allows designers to rapidly prototype adaptive tactons by defining parameters like the sensation's shape, size, position, and intensity, as well as setting rules for how these properties should adapt in response to different inputs. The accompanying software library and Unity package then enable integrating these adaptive tactons into XR applications.
A user study with 12 XR and haptic designers found that AdapTics improved their Creativity Support Index ratings for the "Exploration" and "Expressiveness" factors, compared to using traditional mid-air haptic design tools. This suggests AdapTics can enhance the creative process and expressive capability of mid-air haptic experiences.
Critical Analysis
The paper provides a compelling solution to the limitations of existing mid-air haptic design tools, which have primarily focused on creating static tactile sensations. By introducing the concept of "adaptive tactons" and providing a toolkit to easily create them, AdapTics opens up new possibilities for more dynamic, responsive, and expressive mid-air haptic interactions.
However, the user study was relatively small, with only 12 participants. While the results are promising, further research with a larger and more diverse sample would help validate the toolkit's benefits. Additionally, the paper does not address potential challenges around the technical implementation or scalability of adaptive tactons, such as the computational resources required or the impact on system latency.
Integrating visuo-tactile sensing and haptic feedback for teleoperated, Safe haptic teleoperation with admittance-controlled robots: virtualization, and CellulotactiX: Towards Empowering Collaborative Online Learning through Tactile Feedback demonstrate other innovative haptic technologies that could potentially be integrated with or compared to AdapTics to further enhance mid-air haptic experiences.
Overall, AdapTics represents an important step forward in mid-air haptic design tools, providing a practical solution to enhance the expressiveness and interactivity of touch-based extended reality applications. As the field of mid-air haptics continues to evolve, research like this will be crucial in unlocking the full potential of this technology.
Conclusion
The AdapTics toolkit introduces a new approach to mid-air haptic design, enabling the creation of adaptive tactons that can dynamically adjust based on user interactions and environmental changes. This addresses a key limitation of existing tools, which primarily support static tactile sensations. By improving Creativity Support Index ratings for Exploration and Expressiveness, AdapTics demonstrates its potential to enhance the design and interactivity of mid-air haptic experiences in extended reality applications. As the field of mid-air haptics continues to advance, research like this will play an important role in pushing the boundaries of what is possible with contactless touch feedback.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🗣️
0
AdapTics: A Toolkit for Creative Design and Integration of Real-Time Adaptive Mid-Air Ultrasound Tactons
Kevin John, Yinan Li, Hasti Seifi
Mid-air ultrasound haptic technology can enhance user interaction and immersion in extended reality (XR) applications through contactless touch feedback. Yet, existing design tools for mid-air haptics primarily support creating tactile sensations (i.e., tactons) which cannot change at runtime. These tactons lack expressiveness in interactive scenarios where a continuous closed-loop response to user movement or environmental states is desirable. This paper introduces AdapTics, a toolkit featuring a graphical interface for rapid prototyping of adaptive tactons-dynamic sensations that can adjust at runtime based on user interactions, environmental changes, or other inputs. A software library and a Unity package accompany the graphical interface to enable integration of adaptive tactons in existing applications. We present the design space offered by AdapTics for creating adaptive mid-air ultrasound tactons and show the design tool can improve Creativity Support Index ratings for Exploration and Expressiveness in a user study with 12 XR and haptic designers.
Read more5/1/2024
0
An Interactive Tool for Simulating Mid-Air Ultrasound Tactons on the Skin
Chungman Lim, Hasti Seifi, Gunhyuk Park
Mid-air ultrasound haptic technology offers a myriad of temporal and spatial parameters for contactless haptic design. Yet, predicting how these parameters interact to render an ultrasound signal is difficult before testing them on a mid-air ultrasound haptic device. Thus, haptic designers often use a trial-and-error process with different parameter combinations to obtain desired tactile patterns (i.e., Tactons) for user applications. We propose an interactive tool with five temporal and three spatiotemporal design parameters that can simulate the temporal and spectral properties of stimulation at specific skin points. As a preliminary verification, we measured vibrations induced from the ultrasound Tactons varying on one temporal and two spatiotemporal parameters. The measurements and simulation showed similar results for three different ultrasound rendering techniques, suggesting the efficacy of the simulation tool. We present key insights from the simulation and discuss future directions for enhancing the capabilities of simulations.
Read more5/7/2024
💬
0
Pseudo-Haptics Survey: Human-Computer Interaction in Extended Reality & Teleoperation
Rui Xavier, Jos'e Lu'is Silva, Rodrigo Ventura, Joaquim Jorge
Pseudo-haptic techniques are becoming increasingly popular in human-computer interaction. They replicate haptic sensations by leveraging primarily visual feedback rather than mechanical actuators. These techniques bridge the gap between the real and virtual worlds by exploring the brain's ability to integrate visual and haptic information. One of the many advantages of pseudo-haptic techniques is that they are cost-effective, portable, and flexible. They eliminate the need for direct attachment of haptic devices to the body, which can be heavy and large and require a lot of power and maintenance. Recent research has focused on applying these techniques to extended reality and mid-air interactions. To better understand the potential of pseudo-haptic techniques, the authors developed a novel taxonomy encompassing tactile feedback, kinesthetic feedback, and combined categories in multimodal approaches, ground not covered by previous surveys. This survey highlights multimodal strategies and potential avenues for future studies, particularly regarding integrating these techniques into extended reality and collaborative virtual environments.
Read more6/4/2024
0
Designing Distinguishable Mid-Air Ultrasound Tactons with Temporal Parameters
Chungman Lim, Gunhyuk Park, Hasti Seifi
Mid-air ultrasound technology offers new design opportunities for contactless tactile patterns (i.e., Tactons) in user applications. Yet, few guidelines exist for making ultrasound Tactons easy to distinguish for users. In this paper, we investigated the distinguishability of temporal parameters of ultrasound Tactons in five studies (n=72 participants). Study 1 established the discrimination thresholds for amplitude-modulated (AM) frequencies. In Studies 2-5, we investigated distinguishable ultrasound Tactons by creating four Tacton sets based on mechanical vibrations in the literature and collected similarity ratings for the ultrasound Tactons. We identified a subset of temporal parameters, such as rhythm and low envelope frequency, that could create distinguishable ultrasound Tactons. Also, a strong correlation (mean Spearman's $rho$=0.75) existed between similarity ratings for ultrasound Tactons and similarities of mechanical Tactons from the literature, suggesting vibrotactile designers can transfer their knowledge to ultrasound design. We present design guidelines and future directions for creating distinguishable mid-air ultrasound Tactons.
Read more5/7/2024