Reducing Barriers to the Use of Marginalised Music Genres in AI

Read original: arXiv:2407.13439 - Published 7/19/2024 by Nick Bryan-Kinns, Zijin Li
Total Score

0

Reducing Barriers to the Use of Marginalised Music Genres in AI

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

• This paper aims to address the barriers that marginalized music genres face in the use of AI systems.

• The researchers collected a diverse dataset of music from various genres, including those that are often underrepresented in AI training data.

• They explored techniques to improve the performance of AI models on these marginalized music genres, focusing on addressing the challenges of small dataset sizes and biased training data.

• The paper also discusses the potential implications of their work for enhancing cultural inclusivity and fostering a more diverse and representative AI ecosystem for music.

Plain English Explanation

The researchers wanted to make it easier for AI systems to work with music genres that are often overlooked or underrepresented. They gathered a wide range of music data, including styles that are not typically included in the training of AI music models. By addressing the challenges of small datasets and biased training data, the researchers explored ways to improve the performance of AI models on these marginalized music genres.

This research is important because it can help create AI systems that are more inclusive and representative of diverse musical cultures. [link to "enhancing-cultural-inclusivity-optimizing-embedding-spaces-balanced"] By making AI more accessible to a wider range of music genres, the researchers hope to foster a more diverse and representative AI ecosystem for music. [link to "shift-artistic-practices-through-artificial-intelligence"]

Technical Explanation

The paper describes the researchers' efforts to reduce the barriers to using marginalized music genres in AI systems. They collected a diverse dataset of music, including genres that are often underrepresented in AI training data. [link to "music-genre-classification-training-ai-model"]

To address the challenges of small dataset sizes and biased training data, the researchers explored various techniques. This included developing novel data augmentation methods and exploring ways to optimize the embedding spaces of AI models to better capture the nuances of marginalized music genres. [link to "enhancing-music-genre-classification-through-multi-algorithm"]

The paper also discusses the potential implications of their work for computational copyright and royalty models in the music industry. [link to "computational-copyright-towards-royalty-model-music-generative"]

Critical Analysis

The researchers acknowledge that their work is a first step in addressing the barriers to using marginalized music genres in AI, and that more research is needed to fully understand and overcome these challenges. They note that their dataset, while more diverse than typical AI music datasets, still has limitations in terms of representation and coverage of different musical cultures and traditions.

Additionally, the paper does not delve deeply into the potential societal impacts and ethical considerations of their research. While the researchers discuss the importance of cultural inclusivity, there may be additional implications and unintended consequences that warrant further exploration.

Conclusion

This paper presents a valuable contribution to the field of AI and music by addressing the barriers that marginalized music genres face in the use of AI systems. By collecting a diverse dataset and exploring techniques to improve the performance of AI models on these underrepresented genres, the researchers have taken an important step towards fostering a more inclusive and representative AI ecosystem for music. [link to "advancing-cultural-inclusivity-optimizing-embedding-spaces-balanced"]

The findings of this research have the potential to enable greater access and representation for a wider range of musical cultures in AI-powered music applications and tools. This could lead to more equitable and inclusive musical experiences, as well as new opportunities for collaboration and cross-pollination between different musical traditions.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Reducing Barriers to the Use of Marginalised Music Genres in AI
Total Score

0

Reducing Barriers to the Use of Marginalised Music Genres in AI

Nick Bryan-Kinns, Zijin Li

AI systems for high quality music generation typically rely on extremely large musical datasets to train the AI models. This creates barriers to generating music beyond the genres represented in dominant datasets such as Western Classical music or pop music. We undertook a 4 month international research project summarised in this paper to explore the eXplainable AI (XAI) challenges and opportunities associated with reducing barriers to using marginalised genres of music with AI models. XAI opportunities identified included topics of improving transparency and control of AI models, explaining the ethics and bias of AI models, fine tuning large models with small datasets to reduce bias, and explaining style-transfer opportunities with AI models. Participants in the research emphasised that whilst it is hard to work with small datasets such as marginalised music and AI, such approaches strengthen cultural representation of underrepresented cultures and contribute to addressing issues of bias of deep learning models. We are now building on this project to bring together a global International Responsible AI Music community and invite people to join our network.

Read more

7/19/2024

Applications and Advances of Artificial Intelligence in Music Generation:A Review
Total Score

0

Applications and Advances of Artificial Intelligence in Music Generation:A Review

Yanxu Chen, Linshu Huang, Tian Gou

In recent years, artificial intelligence (AI) has made significant progress in the field of music generation, driving innovation in music creation and applications. This paper provides a systematic review of the latest research advancements in AI music generation, covering key technologies, models, datasets, evaluation methods, and their practical applications across various fields. The main contributions of this review include: (1) presenting a comprehensive summary framework that systematically categorizes and compares different technological approaches, including symbolic generation, audio generation, and hybrid models, helping readers better understand the full spectrum of technologies in the field; (2) offering an extensive survey of current literature, covering emerging topics such as multimodal datasets and emotion expression evaluation, providing a broad reference for related research; (3) conducting a detailed analysis of the practical impact of AI music generation in various application domains, particularly in real-time interaction and interdisciplinary applications, offering new perspectives and insights; (4) summarizing the existing challenges and limitations of music quality evaluation methods and proposing potential future research directions, aiming to promote the standardization and broader adoption of evaluation techniques. Through these innovative summaries and analyses, this paper serves as a comprehensive reference tool for researchers and practitioners in AI music generation, while also outlining future directions for the field.

Read more

9/6/2024

Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music
Total Score

0

Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music

Pedro Sarmento, Jackson Loth, Mathieu Barthet

Generative AI models have recently blossomed, significantly impacting artistic and musical traditions. Research investigating how humans interact with and deem these models is therefore crucial. Through a listening and reflection study, we explore participants' perspectives on AI- vs human-generated progressive metal, in symbolic format, using rock music as a control group. AI-generated examples were produced by ProgGP, a Transformer-based model. We propose a mixed methods approach to assess the effects of generation type (human vs. AI), genre (progressive metal vs. rock), and curation process (random vs. cherry-picked). This combines quantitative feedback on genre congruence, preference, creativity, consistency, playability, humanness, and repeatability, and qualitative feedback to provide insights into listeners' experiences. A total of 32 progressive metal fans completed the study. Our findings validate the use of fine-tuning to achieve genre-specific specialization in AI music generation, as listeners could distinguish between AI-generated rock and progressive metal. Despite some AI-generated excerpts receiving similar ratings to human music, listeners exhibited a preference for human compositions. Thematic analysis identified key features for genre and AI vs. human distinctions. Finally, we consider the ethical implications of our work in promoting musical data diversity within MIR research by focusing on an under-explored genre.

Read more

8/1/2024

🤖

Total Score

0

Play Me Something Icy: Practical Challenges, Explainability and the Semantic Gap in Generative AI Music

Jesse Allison, Drew Farrar, Treya Nash, Carlos Rom'an, Morgan Weeks, Fiona Xue Ju

This pictorial aims to critically consider the nature of text-to-audio and text-to-music generative tools in the context of explainable AI. As a group of experimental musicians and researchers, we are enthusiastic about the creative potential of these tools and have sought to understand and evaluate them from perspectives of prompt creation, control, usability, understandability, explainability of the AI process, and overall aesthetic effectiveness of the results. One of the challenges we have identified that is not explicitly addressed by these tools is the inherent semantic gap in using text-based tools to describe something as abstract as music. Other gaps include explainability vs. useability, and user control and input vs. the human creative process. The aim of this pictorial is to raise questions for discussion and make a few general suggestions on the kinds of improvements we would like to see in generative AI music tools.

Read more

8/15/2024