Creativity and Machine Learning: A Survey

2104.02726

YC

0

Reddit

0

Published 5/8/2024 by Giorgio Franceschelli, Mirco Musolesi

🤔

Abstract

There is a growing interest in the area of machine learning and creativity. This survey presents an overview of the history and the state of the art of computational creativity theories, key machine learning techniques (including generative deep learning), and corresponding automatic evaluation methods. After presenting a critical discussion of the key contributions in this area, we outline the current research challenges and emerging opportunities in this field.

Get summaries of the top AI research delivered straight to your inbox:

Overview

  • This paper provides an overview of the history and state of the art in computational creativity, machine learning techniques for creativity, and methods to evaluate creative AI systems.
  • It discusses the key contributions in this area and outlines the current research challenges and emerging opportunities.

Plain English Explanation

Machines are becoming increasingly capable of creative tasks like generating art, music, and even writing. This paper explores the history and latest advancements in this field, known as computational creativity. It covers the main machine learning techniques being used, including generative deep learning, and the methods researchers are developing to evaluate the "creativity" of these AI systems.

The paper highlights the important work that has been done in this area and identifies the key problems that researchers are still working to solve. For example, how can we build AI systems that are truly creative rather than just mimicking human creativity? And how do we define and measure creativity in a machine? These are some of the challenging questions that the field is grappling with.

Technical Explanation

The paper begins by providing a historical overview of computational creativity, tracing its origins back to early AI and generative art experiments in the 1950s and 60s. It then delves into the current state of the art, focusing on the role of machine learning techniques, particularly generative deep learning models, in powering creative AI systems.

The authors discuss various approaches to evaluating the creativity of these systems, including both objective metrics (e.g. novelty, surprise) and more subjective, human-based assessments. They highlight the challenges in defining and measuring creativity, especially when it comes to computational creativity.

Throughout the paper, the authors cite key research contributions and seminal works that have advanced the field. They also outline current research directions and emerging opportunities, such as the potential for machine learning to assist in scientific discovery and the need to address copyright and ownership issues that arise with creative AI.

Critical Analysis

The paper provides a comprehensive overview of the field of computational creativity, but it also acknowledges the significant challenges that researchers still face. For example, the authors note that current AI systems are often good at generating novel outputs, but struggle to exhibit true creativity that matches the depth and originality of human creativity.

Additionally, the evaluation of creative AI systems is an area that requires more research and standardization. The paper highlights the difficulties in defining and measuring creativity, and the need for more robust, reliable, and generalizable evaluation methods.

The authors also touch on the ethical and legal implications of creative AI, such as the uncertainty around copyright and ownership of AI-generated works. These are important considerations that will need to be addressed as the field continues to evolve.

Conclusion

This paper provides a valuable overview of the current state of computational creativity and the role of machine learning in powering creative AI systems. It highlights the significant progress that has been made in this area, as well as the remaining challenges and opportunities for future research.

As machine learning techniques become increasingly sophisticated, the potential for AI to assist and augment human creativity is immense. However, the paper underscores the need to carefully consider the ethical and practical implications of this technology, particularly when it comes to issues of ownership, authorship, and the very definition of creativity itself.

Overall, this paper serves as a useful introduction to the field of computational creativity and the exciting developments happening at the intersection of AI and creativity.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

Creative Beam Search

Creative Beam Search

Giorgio Franceschelli, Mirco Musolesi

YC

0

Reddit

0

Large language models are revolutionizing several areas, including artificial creativity. However, the process of generation in machines profoundly diverges from that observed in humans. In particular, machine generation is characterized by a lack of intentionality and an underlying creative process. We propose a method called Creative Beam Search that uses Diverse Beam Search and LLM-as-a-Judge to perform response generation and response validation. The results of a qualitative experiment show how our approach can provide better output than standard sampling techniques. We also show that the response validation step is a necessary complement to the response generation step.

Read more

5/10/2024

📉

Automating Creativity

Ming-Hui Huang, Roland T. Rust

YC

0

Reddit

0

Generative AI (GenAI) has spurred the expectation of being creative, due to its ability to generate content, yet so far, its creativity has somewhat disappointed, because it is trained using existing data following human intentions to generate outputs. The purpose of this paper is to explore what is required to evolve AI from generative to creative. Based on a reinforcement learning approach and building upon various research streams of computational creativity, we develop a triple prompt-response-reward engineering framework to develop the creative capability of GenAI. This framework consists of three components: 1) a prompt model for expected creativity by developing discriminative prompts that are objectively, individually, or socially novel, 2) a response model for observed creativity by generating surprising outputs that are incrementally, disruptively, or radically innovative, and 3) a reward model for improving creativity over time by incorporating feedback from the AI, the creator/manager, and/or the customers. This framework enables the application of GenAI for various levels of creativity strategically.

Read more

5/14/2024

Knowledge-guided Machine Learning: Current Trends and Future Prospects

Knowledge-guided Machine Learning: Current Trends and Future Prospects

Anuj Karpatne, Xiaowei Jia, Vipin Kumar

YC

0

Reddit

0

This paper presents an overview of scientific modeling and discusses the complementary strengths and weaknesses of ML methods for scientific modeling in comparison to process-based models. It also provides an introduction to the current state of research in the emerging field of scientific knowledge-guided machine learning (KGML) that aims to use both scientific knowledge and data in ML frameworks to achieve better generalizability, scientific consistency, and explainability of results. We discuss different facets of KGML research in terms of the type of scientific knowledge used, the form of knowledge-ML integration explored, and the method for incorporating scientific knowledge in ML. We also discuss some of the common categories of use cases in environmental sciences where KGML methods are being developed, using illustrative examples in each category.

Read more

5/3/2024

🖼️

Opportunities for machine learning in scientific discovery

Ricardo Vinuesa, Jean Rabault, Hossein Azizpour, Stefan Bauer, Bingni W. Brunton, Arne Elofsson, Elias Jarlebring, Hedvig Kjellstrom, Stefano Markidis, David Marlevi, Paola Cinnella, Steven L. Brunton

YC

0

Reddit

0

Technological advancements have substantially increased computational power and data availability, enabling the application of powerful machine-learning (ML) techniques across various fields. However, our ability to leverage ML methods for scientific discovery, {it i.e.} to obtain fundamental and formalized knowledge about natural processes, is still in its infancy. In this review, we explore how the scientific community can increasingly leverage ML techniques to achieve scientific discoveries. We observe that the applicability and opportunity of ML depends strongly on the nature of the problem domain, and whether we have full ({it e.g.}, turbulence), partial ({it e.g.}, computational biochemistry), or no ({it e.g.}, neuroscience) {it a-priori} knowledge about the governing equations and physical properties of the system. Although challenges remain, principled use of ML is opening up new avenues for fundamental scientific discoveries. Throughout these diverse fields, there is a theme that ML is enabling researchers to embrace complexity in observational data that was previously intractable to classic analysis and numerical investigations.

Read more

5/8/2024