Tangible Scenography as a Holistic Design Method for Human-Robot Interaction

Read original: arXiv:2405.19449 - Published 6/4/2024 by Amy Koike, Bengisu Cagiltay, Bilge Mutlu
Total Score

0

Tangible Scenography as a Holistic Design Method for Human-Robot Interaction

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents "tangible scenography" as a holistic design method for human-robot interaction.
  • The method combines physical and digital elements to create interactive environments that facilitate collaboration between humans and robots.
  • The researchers demonstrate the application of tangible scenography through two case studies involving a robot assistant and a robot arm.

Plain English Explanation

The paper describes a new design approach called "tangible scenography" that can be used to create interactive environments for humans and robots to work together. The key idea is to combine physical objects and digital elements to build these interactive spaces.

For example, the researchers used tangible scenography to design a workspace where a human and a robot assistant could collaborate on a task. The workspace had physical items like tools and materials, as well as digital projections and sensors that allowed the robot to perceive the environment and interact with the human.

Similarly, the researchers used tangible scenography to design a workspace for a robot arm to interact with a human user. The physical layout and digital overlays created an intuitive interface that enabled the human and robot to work together seamlessly.

The benefit of this approach is that it allows for a more holistic, immersive experience compared to traditional human-robot interaction setups. By integrating the digital and physical elements, the researchers were able to create environments that felt natural and responsive to the users, whether they were human or robot.

Technical Explanation

The paper introduces "tangible scenography" as a design method that combines physical and digital elements to create interactive environments for human-robot collaboration. The researchers demonstrate the application of this approach through two case studies.

In the first case study, the researchers designed a workspace for a robot assistant to collaborate with a human user. The workspace included physical objects like tools and materials, as well as digital projections and sensors that allowed the robot to perceive the environment and interact with the human. This integrated setup facilitated smooth and intuitive collaboration between the human and robot.

In the second case study, the researchers used tangible scenography to design a workspace for a robot arm to interact with a human user. The physical layout and digital overlays created an intuitive interface that enabled the human and robot to work together seamlessly. The researchers found that this approach led to a more immersive and responsive interaction compared to traditional setups.

The key insight of the paper is that by combining physical and digital elements, tangible scenography can create interactive environments that support more holistic and natural human-robot collaboration. This contrasts with traditional approaches that often treat the human and robot as separate entities operating in a shared space.

Critical Analysis

The paper presents a promising design approach for human-robot interaction, but it also raises some potential concerns and areas for further research.

One limitation noted by the researchers is that the case studies focused on relatively simple tasks and interactions. It remains to be seen how well the tangible scenography approach would scale to more complex scenarios with multiple humans and robots working together in a shared space.

Additionally, the paper does not address potential safety and ethical concerns related to humans and robots closely collaborating in a shared physical environment. Further research may be needed to ensure that these interactive setups can be deployed safely and reliably.

Another area for further exploration is the level of customization and adaptability offered by the tangible scenography approach. The paper suggests that the design process is quite involved, which could limit its practicality for real-world applications that require more flexible and responsive solutions.

Overall, the paper makes a compelling case for the value of integrating physical and digital elements to create more natural and intuitive human-robot interaction. However, additional research is needed to address the scalability, safety, and customization aspects of this design approach.

Conclusion

This paper presents "tangible scenography" as a holistic design method for creating interactive environments that facilitate collaboration between humans and robots. By combining physical and digital elements, the researchers were able to design workspaces that enabled more seamless and responsive interactions compared to traditional approaches.

The two case studies showcased the potential of this design approach, demonstrating how tangible scenography can be applied to create intuitive interfaces for a robot assistant and a robot arm to work alongside human users. While the paper highlights the benefits of this method, it also acknowledges the need for further research to address scalability, safety, and customization considerations.

Overall, the tangible scenography approach represents a promising direction for advancing human-robot interaction design, with the potential to create more natural and engaging collaborative experiences. As the field of robotics continues to evolve, design methods like this one will be increasingly important for bridging the gap between humans and machines.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Tangible Scenography as a Holistic Design Method for Human-Robot Interaction
Total Score

0

Tangible Scenography as a Holistic Design Method for Human-Robot Interaction

Amy Koike, Bengisu Cagiltay, Bilge Mutlu

Traditional approaches to human-robot interaction design typically examine robot behaviors in controlled environments and narrow tasks. These methods are impractical for designing robots that interact with diverse user groups in complex human environments. Drawing from the field of theater, we present the construct of scenes -- individual environments consisting of specific people, objects, spatial arrangements, and social norms -- and tangible scenography, as a holistic design approach for human-robot interactions. We created a design tool, Tangible Scenography Kit (TaSK), with physical props to aid in design brainstorming. We conducted design sessions with eight professional designers to generate exploratory designs. Designers used tangible scenography and TaSK components to create multiple scenes with specific interaction goals, characterize each scene's social environment, and design scene-specific robot behaviors. From these sessions, we found that this method can encourage designers to think beyond a robot's narrow capabilities and consider how they can facilitate complex social interactions.

Read more

6/4/2024

A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces
Total Score

0

A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces

Marius Hoggenmuller, Martin Tomitsch, Callum Parker, Trung Thanh Nguyen, Dawei Zhou, Stewart Worrall, Eduardo Nebot

The advent of cyber-physical systems, such as robots and autonomous vehicles (AVs), brings new opportunities and challenges for the domain of interaction design. Though there is consensus about the value of human-centred development, there is a lack of documented tailored methods and tools for involving multiple stakeholders in design exploration processes. In this paper we present a novel approach using a tangible multi-display toolkit. Orchestrating computer-generated imagery across multiple displays, the toolkit enables multiple viewing angles and perspectives to be captured simultaneously (e.g. top-view, first-person pedestrian view). Participants are able to directly interact with the simulated environment through tangible objects. At the same time, the objects physically simulate the interface's behaviour (e.g. through an integrated LED display). We evaluated the toolkit in design sessions with experts to collect feedback and input on the design of an AV-pedestrian interface. The paper reports on how the combination of tangible objects and multiple displays supports collaborative design explorations.

Read more

6/14/2024

🌐

Total Score

0

Interconnected virtual space and Theater. Practice as research on theater stage in the era of the network

Georges Gagner'e (INREV), C'edric Plessiet (INREV), R'emy Sohier (INREV)

Since 2014, we have been conducting experiments based on a multidisciplinary collaboration between specialists in theatrical staging and researchers in virtual reality, digital art, and video games. This team focused its work on the similarities and differencesthat exist between real physical actors (actor-performers) and virtual digital actors (avatars). From this multidisciplinary approach, experimental research-creation projects have emerged and rely on a physical actor playing with the image of an avatar, controlled by another physical actor via the intermediary of a low-cost motion-capture system. In the first part of the paper, we will introduce the scenographic design on which our presentation is based, and the modifications we have made in relation to our previous work. Next, in the second section, we will discuss in detail the impact of augmenting the player's game using an avatar, compared to the scenic limitations of the theatrical stage. In part three of the paper, we will discuss the software-related aspects of the project, focusing on exchanges between the different components of our design and describing the algorithms enabling us to utilize the real-time movement of a player via various capture devices. To conclude, we will examine in detail how our experimental system linking physical actors and avatars profoundly alters the nature of collaboration between directors, actors, and digital artists in terms of actor/avatar direction.

Read more

7/18/2024

↗️

Total Score

0

Interaction Design for Human-AI Choreography Co-creation

Yimeng Liu

Human-AI co-creation aims to combine human and AI strengths for artistic results exceeding individual capabilities. Frameworks exist for painting, music, and poetry, but choreography's embodied nature demands a dedicated approach. This paper explores AI-assisted choreography techniques (e.g., generative ideation, embodied improvisation) and analyzes interaction design -- how humans and AI collaborate and communicate -- to inform the design considerations of future human-AI choreography co-creation systems.

Read more

5/8/2024