Long-Term, Store-Front Robotics: Interactive Music for Robotic Arm, Caxixi and Frame Drums

Read original: arXiv:2407.16956 - Published 7/25/2024 by Richard Savery, Fouad Sukkar
Total Score

0

Long-Term, Store-Front Robotics: Interactive Music for Robotic Arm, Caxixi and Frame Drums

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper explores interactive music performance using a robotic arm, caxixi, and frame drums in a long-term, store-front setting.
  • The researchers developed a system that allows people to collaboratively create music by interacting with the robotic arm, caxixi, and frame drums.
  • The system was deployed in a store-front location for an extended period, allowing the researchers to study long-term engagement and interactions.

Plain English Explanation

The researchers created a musical performance system that combines a robotic arm, caxixi (a type of shaker), and frame drums. This system was set up in a store-front location, allowing people to interact with it over an extended period.

The robotic arm was programmed to play the caxixi and frame drums, creating rhythmic patterns. People could then interact with the system by touching or moving the robotic arm, blending their own sounds with the robotic performance. This created a collaborative music-making experience, where humans and the robotic system worked together to produce unique musical compositions.

By placing the system in a store-front setting for an extended period, the researchers were able to observe how people engaged with the interactive music-making experience over time and study the long-term dynamics of human-robot collaboration in a real-world, practical setting.

Technical Explanation

The paper describes the development and deployment of a robotic music performance system in a long-term, store-front setting. The system consisted of a robotic arm equipped with mallets that could strike a caxixi (a type of shaker) and a set of frame drums, allowing the robot to generate rhythmic musical patterns.

The researchers designed the system to be interactive, enabling people to engage with the robotic performer by touching or moving the arm. This interaction would blend the human's input with the robot's pre-programmed performance, creating a collaborative music-making experience.

The system was deployed in a store-front location for an extended period, allowing the researchers to study long-term engagement and interaction patterns. They collected data on the number and duration of interactions, as well as qualitative feedback from participants.

The findings suggest that the long-term, store-front deployment enabled people to develop a sense of familiarity and ownership over the system, leading to more creative and sustained interactions over time. The researchers also observed that the collaborative music-making experience fostered a sense of community and social engagement among participants.

Critical Analysis

The paper provides a valuable contribution to the field of long-term, real-world deployments of interactive robotic systems. By placing the music performance system in a store-front setting, the researchers were able to study how people engage with such systems over an extended period, which is an important consideration for the practical application of these technologies.

One potential limitation of the study is the relatively small sample size and the specific context of the store-front deployment. While the researchers were able to gather detailed insights, the findings may not be fully generalizable to other settings or larger-scale deployments. Further research could explore the scalability of the system and its applicability in different environments.

Additionally, the paper does not delve deeply into the technical details of the robotic system's design or the specific algorithms used for the interactive music-making. Providing more information about the underlying technology and its development process could be beneficial for researchers interested in replicating or building upon this work.

Conclusion

This paper presents an innovative approach to long-term, store-front robotics, focusing on the development and deployment of an interactive music performance system. The researchers demonstrated that by enabling people to collaborate with a robotic arm, caxixi, and frame drums, they were able to foster a sense of community and sustained engagement over an extended period.

The findings from this study contribute to the growing body of research on practical, real-world applications of robotic systems, particularly in the context of interactive and collaborative experiences. The insights gained from this work can inform the design and deployment of similar systems in other domains, such as public installations or educational settings, where long-term engagement and community building are crucial.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Long-Term, Store-Front Robotics: Interactive Music for Robotic Arm, Caxixi and Frame Drums
Total Score

0

Long-Term, Store-Front Robotics: Interactive Music for Robotic Arm, Caxixi and Frame Drums

Richard Savery, Fouad Sukkar

This paper presents an innovative exploration into the integration of interactive robotic musicianship within a commercial retail environment, specifically through a three-week-long in-store installation featuring a UR3 robotic arm, custom-built frame drums, and an adaptive music generation system. Situated in a prominent storefront in one of the world's largest cities, this project aimed to enhance the shopping experience by creating dynamic, engaging musical interactions that respond to the store's ambient soundscape. Key contributions include the novel application of industrial robotics in artistic expression, the deployment of interactive music to enrich retail ambiance, and the demonstration of continuous robotic operation in a public setting over an extended period. Challenges such as system reliability, variation in musical output, safety in interactive contexts, and brand alignment were addressed to ensure the installation's success. The project not only showcased the technical feasibility and artistic potential of robotic musicianship in retail spaces but also offered insights into the practical implications of such integration, including system reliability, the dynamics of human-robot interaction, and the impact on store operations. This exploration opens new avenues for enhancing consumer retail experiences through the intersection of technology, music, and interactive art, suggesting a future where robotic musicianship contributes meaningfully to public and commercial spaces.

Read more

7/25/2024

Collaboration Between Robots, Interfaces and Humans: Practice-Based and Audience Perspectives
Total Score

0

Collaboration Between Robots, Interfaces and Humans: Practice-Based and Audience Perspectives

Anna Savery, Richard Savery

This paper provides an analysis of a mixed-media experimental musical work that explores the integration of human musical interaction with a newly developed interface for the violin, manipulated by an improvising violinist, interactive visuals, a robotic drummer and an improvised synthesised orchestra. We first present a detailed technical overview of the systems involved including the design and functionality of each component. We then conduct a practice-based review examining the creative processes and artistic decisions underpinning the work, focusing on the challenges and breakthroughs encountered during its development. Through this introspective analysis, we uncover insights into the collaborative dynamics between the human performer and technological agents, revealing the complexities of blending traditional musical expressiveness with artificial intelligence and robotics. To gauge public reception and interpretive perspectives, we conducted an online survey, sharing a video of the performance with a diverse audience. The feedback collected from this survey offers valuable viewpoints on the accessibility, emotional impact, and perceived artistic value of the work. Respondents' reactions underscore the transformative potential of integrating advanced technologies in musical performance, while also highlighting areas for further exploration and refinement.

Read more

7/25/2024

Creativity and Visual Communication from Machine to Musician: Sharing a Score through a Robotic Camera
Total Score

0

Creativity and Visual Communication from Machine to Musician: Sharing a Score through a Robotic Camera

Ross Greer, Laura Fleig, Shlomo Dubnov

This paper explores the integration of visual communication and musical interaction by implementing a robotic camera within a Guided Harmony musical game. We aim to examine co-creative behaviors between human musicians and robotic systems. Our research explores existing methodologies like improvisational game pieces and extends these concepts to include robotic participation using a PTZ camera. The robotic system interprets and responds to nonverbal cues from musicians, creating a collaborative and adaptive musical experience. This initial case study underscores the importance of intuitive visual communication channels. We also propose future research directions, including parameters for refining the visual cue toolkit and data collection methods to understand human-machine co-creativity further. Our findings contribute to the broader understanding of machine intelligence in augmenting human creativity, particularly in musical settings.

Read more

9/10/2024

Robotic Blended Sonification: Consequential Robot Sound as Creative Material for Human-Robot Interaction
Total Score

0

Robotic Blended Sonification: Consequential Robot Sound as Creative Material for Human-Robot Interaction

Stine S. Johansen, Yanto Browning, Anthony Brumpton, Jared Donovan, Markus Rittenbruch

Current research in robotic sounds generally focuses on either masking the consequential sound produced by the robot or on sonifying data about the robot to create a synthetic robot sound. We propose to capture, modify, and utilise rather than mask the sounds that robots are already producing. In short, this approach relies on capturing a robot's sounds, processing them according to contextual information (e.g., collaborators' proximity or particular work sequences), and playing back the modified sound. Previous research indicates the usefulness of non-semantic, and even mechanical, sounds as a communication tool for conveying robotic affect and function. Adding to this, this paper presents a novel approach which makes two key contributions: (1) a technique for real-time capture and processing of consequential robot sounds, and (2) an approach to explore these sounds through direct human-robot interaction. Drawing on methodologies from design, human-robot interaction, and creative practice, the resulting 'Robotic Blended Sonification' is a concept which transforms the consequential robot sounds into a creative material that can be explored artistically and within application-based studies.

Read more

4/23/2024