Explainability Paths for Sustained Artistic Practice with AI

Read original: arXiv:2407.15216 - Published 7/23/2024 by Austin Tecks, Thomas Peschlow, Gabriel Vigliensoni
Total Score

0

🤖

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Explores how AI systems can be made more explainable and interpretable for sustained artistic practice
  • Focuses on human-scale models and artist-curated datasets to enable AI systems that are transparent and aligned with artistic goals
  • Discusses key challenges and potential solutions for achieving explainable and generative AI in creative domains

Plain English Explanation

The provided paper examines ways to make AI systems more understandable and transparent for artists who want to use them in their creative practice. It suggests that using human-scale models and artist-curated datasets can help create AI systems that are closely aligned with the goals and needs of artists.

The key idea is to move away from highly complex, "black box" AI models and instead design systems that are more interpretable and explainable. This could involve techniques like neural audio synthesis that allow artists to understand and control the creative process. The paper also discusses the importance of human-centric explainable AI (XAI) to foster trust and collaboration between artists and AI systems.

Overall, the research aims to reduce barriers to the adoption of AI in the creative arts by making the technology more transparent, customizable, and aligned with the needs of artists and their artistic practices.

Technical Explanation

The paper proposes "explainability paths" as a framework for designing AI systems that can be effectively used in sustained artistic practice. This involves several key elements:

  1. Human-scale models: The authors argue for AI models that are more human-understandable, with transparent architectures and interpretable inputs/outputs. This could involve techniques like neural audio synthesis that allow artists to control and understand the generative process.

  2. Artist-curated datasets: Rather than relying on generic datasets, the paper suggests that AI systems be trained on datasets specifically curated by artists to align with their creative goals and artistic sensibilities. This could help address issues of bias in marginalized music genres.

  3. Human-centric explainable AI (XAI): The authors emphasize the need for XAI techniques that prioritize human understanding and collaboration, rather than just model interpretability. This could involve interactive visualizations that allow artists to explore and understand the AI's decision-making process.

Through these approaches, the paper aims to create AI systems that are more transparent, customizable, and aligned with the needs and goals of artists, ultimately enabling more sustained and effective artistic practice with AI.

Critical Analysis

The paper makes a compelling case for the importance of explainability and interpretability in AI systems used for creative applications. By focusing on human-scale models and artist-curated datasets, the authors acknowledge the unique challenges and requirements of the arts domain, where creative expression and understanding the generative process are paramount.

However, the paper does not delve into some of the practical challenges of implementing these approaches, such as the difficulty of curating high-quality datasets for niche or marginalized artistic genres. Additionally, the paper could have explored the potential tensions between maintaining explainability and achieving the level of complexity and expressiveness desired by some artists.

Further research could investigate how to balance the need for explainability with the desire for sophisticated, generative AI capabilities in creative domains. Exploring user studies and collaborations with artists could also provide valuable insights into the specific requirements and preferences of the artistic community.

Conclusion

The provided paper presents a thoughtful framework for designing AI systems that can be effectively and sustainably integrated into artistic practice. By emphasizing the importance of human-scale models, artist-curated datasets, and human-centric explainable AI, the authors aim to reduce barriers to the adoption of AI in the creative arts and foster more fruitful collaboration between artists and technology.

This research represents an important step towards bridging the gap between the technical capabilities of AI and the creative, expressive needs of artists. As AI continues to advance, the insights and approaches outlined in this paper will be increasingly crucial for enabling the widespread and meaningful use of AI in diverse artistic domains.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤖

Total Score

0

Explainability Paths for Sustained Artistic Practice with AI

Austin Tecks, Thomas Peschlow, Gabriel Vigliensoni

The development of AI-driven generative audio mirrors broader AI trends, often prioritizing immediate accessibility at the expense of explainability. Consequently, integrating such tools into sustained artistic practice remains a significant challenge. In this paper, we explore several paths to improve explainability, drawing primarily from our research-creation practice in training and implementing generative audio models. As practical provisions for improved explainability, we highlight human agency over training materials, the viability of small-scale datasets, the facilitation of the iterative creative process, and the integration of interactive machine learning as a mapping tool. Importantly, these steps aim to enhance human agency over generative AI systems not only during model inference, but also when curating and preprocessing training data as well as during the training phase of models.

Read more

7/23/2024

🤖

Total Score

0

Play Me Something Icy: Practical Challenges, Explainability and the Semantic Gap in Generative AI Music

Jesse Allison, Drew Farrar, Treya Nash, Carlos Rom'an, Morgan Weeks, Fiona Xue Ju

This pictorial aims to critically consider the nature of text-to-audio and text-to-music generative tools in the context of explainable AI. As a group of experimental musicians and researchers, we are enthusiastic about the creative potential of these tools and have sought to understand and evaluate them from perspectives of prompt creation, control, usability, understandability, explainability of the AI process, and overall aesthetic effectiveness of the results. One of the challenges we have identified that is not explicitly addressed by these tools is the inherent semantic gap in using text-based tools to describe something as abstract as music. Other gaps include explainability vs. useability, and user control and input vs. the human creative process. The aim of this pictorial is to raise questions for discussion and make a few general suggestions on the kinds of improvements we would like to see in generative AI music tools.

Read more

8/15/2024

🤖

Total Score

0

Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agenda

Johannes Schneider

Generative AI (GenAI) marked a shift from AI being able to recognize to AI being able to generate solutions for a wide variety of tasks. As the generated solutions and applications become increasingly more complex and multi-faceted, novel needs, objectives, and possibilities have emerged for explainability (XAI). In this work, we elaborate on why XAI has gained importance with the rise of GenAI and its challenges for explainability research. We also unveil novel and emerging desiderata that explanations should fulfill, covering aspects such as verifiability, interactivity, security, and cost. To this end, we focus on surveying existing works. Furthermore, we provide a taxonomy of relevant dimensions that allows us to better characterize existing XAI mechanisms and methods for GenAI. We discuss different avenues to ensure XAI, from training data to prompting. Our paper offers a short but concise technical background of GenAI for non-technical readers, focusing on text and images to better understand novel or adapted XAI techniques for GenAI. However, due to the vast array of works on GenAI, we decided to forego detailed aspects of XAI related to evaluation and usage of explanations. As such, the manuscript interests both technically oriented people and other disciplines, such as social scientists and information systems researchers. Our research roadmap provides more than ten directions for future investigation.

Read more

4/16/2024

🤖

Total Score

0

Proceedings of The second international workshop on eXplainable AI for the Arts (XAIxArts)

Nick Bryan-Kinns, Corey Ford, Shuoyang Zheng, Helen Kennedy, Alan Chamberlain, Makayla Lewis, Drew Hemment, Zijin Li, Qiong Wu, Lanxi Xiao, Gus Xia, Jeba Rezwana, Michael Clemens, Gabriel Vigliensoni

This second international workshop on explainable AI for the Arts (XAIxArts) brought together a community of researchers in HCI, Interaction Design, AI, explainable AI (XAI), and digital arts to explore the role of XAI for the Arts. Workshop held at the 16th ACM Conference on Creativity and Cognition (C&C 2024), Chicago, USA.

Read more

7/22/2024