Interconnected virtual space and Theater. Practice as research on theater stage in the era of the network

Overview

• Since 2014, researchers have been exploring the similarities and differences between real-life actors and digital avatars through a multidisciplinary collaboration.
• The team has focused on how a physical actor can interact with and control the image of a virtual avatar using a low-cost motion capture system.
• The paper aims to introduce the scenographic design, discuss the impact of using an avatar compared to a theatrical stage, explain the technical software aspects, and examine how this system alters the collaboration between directors, actors, and digital artists.

Plain English Explanation

The researchers have been conducting experiments that combine expertise from theatrical staging, virtual reality, digital art, and video games. Their work has focused on the relationship between human actors and virtual avatars.

In these experiments, a physical actor interacts with the image of a digital avatar that is being controlled by another actor using a motion capture system. This allows them to explore how the use of an avatar, rather than just a physical stage, impacts the performance and creative process.

The paper first describes the specific scenographic (stage) design they are using and how it has evolved from their previous work. It then discusses the advantages and limitations of using an avatar compared to a traditional theatrical stage.

Next, the paper delves into the technical software aspects, explaining how the different components of the system communicate and the algorithms that enable the real-time movement of the actor to be translated to the avatar.

Finally, the researchers examine how this experimental system, which links physical actors and digital avatars, fundamentally changes the way directors, actors, and digital artists collaborate and direct the performance. This includes new opportunities and challenges for avatar representation and direction.

Technical Explanation

The researchers have designed an experimental setup that allows a physical actor to interact with and control the image of a virtual avatar. This is enabled by a low-cost motion capture system that tracks the movements of the actor and translates them to the avatar in real-time.

The scenographic design is central to their work, and they have made modifications from their previous experiments. This includes the specific technical setup and the way the actor and avatar are integrated into the performance.

By using an avatar rather than just a physical stage, the researchers are able to explore the impact on the performance and creative process. They examine how the avatar's representation and the actor's ability to direct it differ from a traditional theatrical setting.

The technical aspects involve the software components that enable the communication and synchronization between the actor's movements and the avatar's actions. This includes the algorithms that translate the real-time input from the motion capture system to the avatar's movements.

Overall, this experimental system fundamentally changes the collaboration between directors, actors, and digital artists. It presents new opportunities and challenges for how the avatar is represented and directed, ultimately altering the nature of the creative process.

Critical Analysis

The paper provides a detailed overview of the researchers' experimental setup and findings, but it also acknowledges some of the limitations and areas for further exploration.

For example, the paper notes that the current motion capture system is relatively low-cost, which may impact the fidelity and responsiveness of the avatar's movements. Exploring more advanced motion capture technologies could potentially enhance the immersiveness and realism of the avatar-actor interaction.

Additionally, the paper suggests that the specific scenographic design choices, such as the layout of the performance space and the integration of the avatar, may have a significant impact on the overall experience. Further experimentation and evaluation of different design approaches could yield additional insights.

The researchers also highlight the need to continue investigating the complex relationships and dynamics between the director, actors, and digital artists within this avatar-based performance system. Exploring the "shadow coevolution processes" between these collaborators could uncover new challenges and opportunities.

Overall, the paper presents a compelling and well-executed exploration of the intersection between physical and digital performance, but there are still many avenues for further research and refinement of the experimental system.

Conclusion

This research project represents a fascinating exploration of the intersection between physical actors and virtual avatars. By combining expertise from various disciplines, the researchers have developed an experimental system that allows a physical actor to interact with and control a digital avatar in real-time.

The findings from this work offer valuable insights into the impact of using avatars in performance, the technical challenges involved, and the ways in which this approach fundamentally alters the collaboration between directors, actors, and digital artists. These insights could have significant implications for the future of digital performing arts and the evolving relationship between humans and their virtual counterparts.

As technology continues to advance, the potential for more immersive and seamless integration of physical and digital performance elements will only continue to grow. This research represents an important step forward in understanding and shaping this exciting and rapidly evolving field.