Tonal Cognition in Sonification: Exploring the Needs of Practitioners in Sonic Interaction Design
0
Sign in to get full access
Overview
- Explores the needs of practitioners in sonic interaction design and tonal cognition in sonification
- Aims to understand how designers and researchers approach the use of musical concepts and representations in auditory display
- Includes a user study with practitioners to understand their perspectives and needs
Plain English Explanation
The paper examines how designers and researchers working in sonic interaction design and auditory display incorporate musical concepts and representations into their work. This is an important area as sonification - the use of non-speech audio to represent data - can benefit from a deeper understanding of how people perceive and interpret musical elements.
The researchers conducted interviews with practitioners to learn about their experiences and needs when working with tonal and musical aspects in sonification. They wanted to understand how designers and researchers approach these musical elements, what challenges they face, and how their work could be better supported.
The goal was to gain insights that could inform the design of better creativity support tools and improve the overall practice of sonic interaction design.
Technical Explanation
The paper reports on a qualitative user study with 11 practitioners working in the fields of sonic interaction design and auditory display. The researchers conducted semi-structured interviews to explore the practitioners' approaches, challenges, and needs when incorporating tonal and musical concepts into their work on sonification.
Key findings include:
- Practitioners draw on their own musical experience and embodied music cognition to inform their design process
- They face challenges around translating musical ideas into effective auditory displays, as well as communicating these concepts to users
- Practitioners expressed a need for better creativity support tools and methods to assist with the tonal and musical aspects of their work
The paper provides recommendations for how to better support practitioners, such as developing tools that allow for the rapid prototyping and evaluation of tonal cognition in sonification.
Critical Analysis
The paper provides valuable insights into the needs and challenges faced by practitioners working at the intersection of sonic interaction design, auditory display, and sonification. By conducting in-depth interviews, the researchers were able to uncover nuanced perspectives and pain points that may not have been evident from surveys or other methods.
One potential limitation is the relatively small sample size of 11 participants, which may limit the generalizability of the findings. Additionally, the study focused on practitioners, but did not include input from end-users who experience the sonifications. Gathering feedback from both designers and users could provide a more comprehensive understanding of the challenges and needs in this domain.
Further research could explore the development and evaluation of creativity support tools tailored to the specific requirements identified in this study. Longitudinal studies tracking the impact of such tools on practitioners' workflows and the quality of their sonic interactions could also yield valuable insights.
Conclusion
This paper provides important insights into the needs and challenges faced by practitioners working at the intersection of sonic interaction design, auditory display, and sonification. By understanding how designers and researchers approach the use of musical concepts and representations, the findings can inform the development of better creativity support tools and improve the overall practice of tonal cognition in sonification. This research has the potential to enhance the user experience and effectiveness of auditory displays across a variety of applications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Tonal Cognition in Sonification: Exploring the Needs of Practitioners in Sonic Interaction Design
Minsik Choi, Josh Andres, Charles Patrick Martin
Research into tonal music examines the structural relationships among sounds and how they align with our auditory perception. The exploration of integrating tonal cognition into sonic interaction design, particularly for practitioners lacking extensive musical knowledge, and developing an accessible software tool, remains limited. We report on a study of designers to understand the sound creation practices of industry experts and explore how infusing tonal music principles into a sound design tool can better support their craft and enhance the sonic experiences they create. Our study collected qualitative data through semi-structured individual and focus group interviews with six participants. We developed a low-fidelity prototype sound design tool that involves practical methods of functional harmony and interaction design discussed in focus groups. We identified four themes through reflexive thematic analysis: decision-making, domain knowledge and terminology, collaboration, and contexts in sound creation. Finally, we discussed design considerations for an accessible sonic interaction design tool that aligns auditory experience more closely with tonal cognition.
Read more9/2/2024
0
The Ballad of the Bots: Sonification Using Cognitive Metaphor to Support Immersed Teleoperation of Robot Teams
Joe Simmons, Paul Bremner, Thomas J Mitchell, Alison Bown, Verity McIntosh
As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are used to characterise a chamber within a virtual nuclear facility. This study examines the potential utility and impact of sonification as a means of communicating salient operator data in such an environment. However, the question of what sound should be used and how it can be applied in different applications is far from resolved. This paper explores and compares two sonification design approaches. The first is inspired by the theory of cognitive metaphor to create sonifications that align with socially acquired contextual and ecological understanding of the application domain. The second adopts a computationalist approach using auditory mappings that are commonplace in the literature. The results suggest that the computationalist approach outperforms the cognitive metaphor approach in terms of predictability and mental workload. However, qualitative data analysis demonstrates that the cognitive metaphor approach resulted in sounds that were more intuitive, and were better implemented for spatialisation of data sources and data legibility when there was more than one sound source.
Read more7/16/2024
0
Using Tangible Interaction to Design Musicking Artifacts for Non-musicians
Luc'ia Montesinos, Halfdan Hauch Jensen, Anders Sundnes L{o}vlie
This paper presents a Research through Design exploration of the potential for using tangible interactions to enable active music experiences - musicking - for non-musicians. We present the Tubularium prototype, which aims to help non-musicians play music without requiring any initial skill. We present the initial design of the prototype and the features implemented in order to enable music-making by non-musicians, and offer some reflections based on observations of informal initial user explorations of the prototype.
Read more4/16/2024
🤿
0
Tactile Melodies: A Desk-Mounted Haptics for Perceiving Musical Experiences
Raj Varshith Moora, Gowdham Prabhakar
This paper introduces a novel interface for experiencing music through haptic impulses to the palm of the hand. It presents a practical implementation of the system exploring the realm of musical haptics through the translation of MIDI data from a Digital Audio Workstation (DAW) into haptic sensations, from a set of haptic actuators, in real-time. It also includes a suitable music-to-haptic mapping strategy to translate notes from musical instruments to haptic feedback. The haptic actuators, placed strategically on the palmar surface of the hand allowed users to perceive music and were able to identify melody and rhythm of different musical compositions. A pilot user study conducted intended to assess the accuracy of the interface by testing the participants to select the correct audio presentation from the haptic presentation of the same musical composition. It presents a comparative study, differentiating between those with prior musical background and those without, in identifying the correct audio counterpart solely through haptic inputs. This pilot study delves into how users perceive and interpret haptic feedback within the context of musical compositions. The study showed promising results in enriching our understanding of user responses to haptic feedback in musical scenarios and exploring the intricacies of user experience with the system and its impact on musical interpretation.
Read more8/14/2024