Crafting Generative Art through Genetic Improvement: Managing Creative Outputs in Diverse Fitness Landscapes

Read original: arXiv:2407.20095 - Published 7/30/2024 by Erik M. Fredericks, Denton Bobeldyk, Jared M. Moore
Total Score

0

Crafting Generative Art through Genetic Improvement: Managing Creative Outputs in Diverse Fitness Landscapes

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper explores the use of genetic improvement techniques to generate creative artworks.
  • It investigates how to manage the diverse "fitness landscapes" that arise when optimizing generative art for different aesthetic assessments.
  • The key focus is on developing strategies to maintain creative diversity while still optimizing the generated outputs.

Plain English Explanation

The paper is about using a technique called genetic improvement to create unique and interesting works of generative art. Generative art is art that is created by computer algorithms rather than by a human artist.

The researchers wanted to find a way to make the computer-generated art look good, without losing the creativity and diversity of the outputs. They call this the "fitness landscape" - the range of possible artworks that the computer can create.

The researchers experimented with different ways of evaluating the aesthetic quality of the generated art, using machine learning classifiers and neural networks. This allowed them to "judge" the art and give it a score. They then used this feedback to guide the genetic improvement process, tweaking the algorithms to produce better and better artwork.

The key challenge was maintaining the diversity and creativity of the art, even as they optimized it to score highly on their aesthetic assessments. They explored different strategies for doing this, such as encouraging unexpected or novel elements in the art.

Technical Explanation

The paper presents a genetic improvement-based approach for generating diverse and aesthetically-pleasing generative art. The researchers utilize grammatical evolution to evolve generative programs that produce images, and explore various fitness functions and optimization strategies to manage the resulting "fitness landscapes."

Key elements of the technical approach include:

  • Image Analysis: The researchers employ convolutional neural network-based classifiers to assess the aesthetic quality and novelty of the generated images.
  • Fitness Comparison: They experiment with different fitness functions, including combining novelty and aesthetic scores, to guide the genetic improvement process.
  • Diversity Maintenance: The paper investigates techniques like multi-objective optimization and novelty search to preserve the diversity of the generated art.

The experimental results demonstrate the potential of this genetic improvement approach to produce a wide range of creative artworks, while also highlighting the challenges in balancing aesthetic optimization and creative diversity.

Critical Analysis

The paper provides a thoughtful exploration of the tradeoffs involved in using genetic improvement techniques for generative art. While the results show promise, the authors acknowledge several limitations and areas for further research:

  • The aesthetic assessment models, while effective, may not fully capture all aspects of human aesthetic judgment. More work is needed to develop richer fitness functions.
  • Maintaining diversity becomes increasingly challenging as the genetic improvement process progresses. Additional methods for preserving novelty and creativity may be required.
  • The generative programs evolved in this work are relatively simple. Scaling up to more complex, open-ended generative systems poses further challenges.

Additionally, one could question whether the focus on aesthetic optimization aligns with the broader goal of supporting human creativity. There may be value in exploring approaches that prioritize the creative process and human-AI collaboration over pure optimization.

Conclusion

This paper presents an innovative approach to leveraging genetic improvement techniques for the generation of creative artworks. By carefully managing the resulting fitness landscapes, the researchers demonstrate the potential to produce a diverse range of aesthetically-pleasing generative art.

The insights from this work could have broader implications for the field of computational creativity, highlighting the importance of balancing optimization and diversity preservation. As the capabilities of generative AI systems continue to advance, finding the right balance between human and machine creative agency will be an important challenge to address.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Crafting Generative Art through Genetic Improvement: Managing Creative Outputs in Diverse Fitness Landscapes
Total Score

0

Crafting Generative Art through Genetic Improvement: Managing Creative Outputs in Diverse Fitness Landscapes

Erik M. Fredericks, Denton Bobeldyk, Jared M. Moore

Generative art is a rules-driven approach to creating artistic outputs in various mediums. For example, a fluid simulation can govern the flow of colored pixels across a digital display or a rectangle placement algorithm can yield a Mondrian-style painting. Previously, we investigated how genetic improvement, a sub-field of genetic programming, can automatically create and optimize generative art drawing programs. One challenge of applying genetic improvement to generative art is defining fitness functions and their interaction in a many-objective evolutionary algorithm such as Lexicase selection. Here, we assess the impact of each fitness function in terms of the their individual effects on generated images, characteristics of generated programs, and impact of bloat on this specific domain. Furthermore, we have added an additional fitness function that uses a classifier for mimicking a human's assessment as to whether an output is considered as art. This classifier is trained on a dataset of input images resembling the glitch art aesthetic that we aim to create. Our experimental results show that with few fitness functions, individual generative techniques sweep across populations. Moreover, we found that compositions tended to be driven by one technique with our current fitness functions. Lastly, we show that our classifier is best suited for filtering out noisy images, ideally leading towards more outputs relevant to user preference.

Read more

7/30/2024

Conserving Human Creativity with Evolutionary Generative Algorithms: A Case Study in Music Generation
Total Score

0

Conserving Human Creativity with Evolutionary Generative Algorithms: A Case Study in Music Generation

Justin Kilb, Caroline Ellis

This study explores the application of evolutionary generative algorithms in music production to preserve and enhance human creativity. By integrating human feedback into Differential Evolution algorithms, we produced six songs that were submitted to international record labels, all of which received contract offers. In addition to testing the commercial viability of these methods, this paper examines the long-term implications of content generation using traditional machine learning methods compared with evolutionary algorithms. Specifically, as current generative techniques continue to scale, the potential for computer-generated content to outpace human creation becomes likely. This trend poses a risk of exhausting the pool of human-created training data, potentially forcing generative machine learning models to increasingly depend on their random input functions for generating novel content. In contrast to a future of content generation guided by aimless random functions, our approach allows for individualized creative exploration, ensuring that computer-assisted content generation methods are human-centric and culturally relevant through time.

Read more

6/11/2024

Combining Neuroevolution with the Search for Novelty to Improve the Generation of Test Inputs for Games
Total Score

0

Combining Neuroevolution with the Search for Novelty to Improve the Generation of Test Inputs for Games

Patric Feldmeier, Gordon Fraser

As games challenge traditional automated white-box test generators, the Neatest approach generates test suites consisting of neural networks that exercise the source code by playing the games. Neatest generates these neural networks using an evolutionary algorithm that is guided by an objective function targeting individual source code statements. This approach works well if the objective function provides sufficient guidance, but deceiving or complex fitness landscapes may inhibit the search. In this paper, we investigate whether the issue of challenging fitness landscapes can be addressed by promoting novel behaviours during the search. Our case study on two Scratch games demonstrates that rewarding novel behaviours is a promising approach for overcoming challenging fitness landscapes, thus enabling future research on how to adapt the search algorithms to best use this information.

Read more

7/9/2024

LLM2FEA: Discover Novel Designs with Generative Evolutionary Multitasking
Total Score

0

LLM2FEA: Discover Novel Designs with Generative Evolutionary Multitasking

Melvin Wong, Jiao Liu, Thiago Rios, Stefan Menzel, Yew Soon Ong

The rapid research and development of generative artificial intelligence has enabled the generation of high-quality images, text, and 3D models from text prompts. This advancement impels an inquiry into whether these models can be leveraged to create digital artifacts for both creative and engineering applications. Drawing on innovative designs from other domains may be one answer to this question, much like the historical practice of ``bionics, where humans have sought inspiration from nature's exemplary designs. This raises the intriguing possibility of using generative models to simultaneously tackle design tasks across multiple domains, facilitating cross-domain learning and resulting in a series of innovative design solutions. In this paper, we propose LLM2FEA as the first attempt to discover novel designs in generative models by transferring knowledge across multiple domains. By utilizing a multi-factorial evolutionary algorithm (MFEA) to drive a large language model, LLM2FEA integrates knowledge from various fields to generate prompts that guide the generative model in discovering novel and practical objects. Experimental results in the context of 3D aerodynamic design verify the discovery capabilities of the proposed LLM2FEA. The designs generated by LLM2FEA not only satisfy practicality requirements to a certain degree but also feature novel and aesthetically pleasing shapes, demonstrating the potential applications of LLM2FEA in discovery tasks.

Read more

6/24/2024