Creative Problem Solving in Large Language and Vision Models -- What Would it Take?
0
💬
Sign in to get full access
Overview
- This paper explores ways to integrate Computational Creativity (CC) with large language and vision models (LLVMs) to address the limitation of creative problem solving in these models.
- The authors present preliminary experiments showing how CC principles can be applied to augment prompting and improve creative problem solving in LLVMs.
- The goal is to foster discussions around the intersection of Computational Creativity and machine learning algorithms for creative problem solving.
Plain English Explanation
Integrating Computational Creativity with Large Language and Vision Models
Large language and vision models (LLVMs) are powerful AI systems that can perform a wide range of tasks, from natural language processing to image recognition. However, these models have a limitation when it comes to creative problem solving.
In this paper, the researchers explore ways to address this limitation by integrating principles from the field of Computational Creativity (CC). CC is the study of how computers can be programmed to generate novel and valuable ideas, similar to how humans are creative.
The researchers present preliminary experiments that show how CC principles can be applied to "augment" the prompting process for LLVMs. This means they found ways to guide the models to generate more creative and innovative solutions to problems.
By combining the power of LLVMs with the creative capabilities of CC, the researchers hope to advance the state of the art in machine creativity and foster further research in this exciting area of AI and creativity.
Technical Explanation
The researchers in this paper explore the integration of Computational Creativity (CC) principles with large language and vision models (LLVMs) to address the limitation of creative problem solving in these models.
They present preliminary experiments that demonstrate how CC techniques can be applied to the prompting process for LLVMs. Prompting refers to the input provided to the model to guide its output. The authors show that by incorporating CC-based prompting strategies, they can enhance the creative problem-solving capabilities of LLVMs.
The key idea is to leverage the strengths of CC, which involves computational methods for generating novel and valuable ideas, and apply these principles to the prompting process for LLVMs. This allows the models to go beyond their typical response patterns and generate more creative and innovative solutions to problems.
Through these experiments, the researchers aim to foster further discussions and research at the intersection of Computational Creativity and machine learning algorithms for creative problem solving in the context of LLVMs.
Critical Analysis
The paper presents a promising approach for addressing the creative problem-solving limitations of large language and vision models (LLVMs). By integrating principles from Computational Creativity (CC), the researchers have shown preliminary evidence that the prompting process can be augmented to enhance the creative capabilities of these models.
However, the paper is limited in scope, as it only presents initial experiments and does not provide a comprehensive evaluation of the proposed approach. Further research is needed to fully understand the effectiveness and scalability of this integration of CC and LLVMs for creative problem solving.
Additionally, the paper does not delve into the potential challenges and limitations of this approach. For example, it would be valuable to explore how the CC-based prompting strategies perform on a diverse set of creative tasks, and whether there are any biases or limitations inherent in the CC techniques that may be transferred to the LLVM outputs.
It would also be interesting to see the researchers compare their approach to other methods for improving the creative capabilities of LLVMs, such as techniques for mathematical reasoning or evaluating the creativity of LLVM-based systems. This could help provide a more holistic understanding of the strengths and weaknesses of the proposed approach.
Conclusion
This paper presents a novel approach for integrating Computational Creativity (CC) principles with large language and vision models (LLVMs) to address the limitation of creative problem solving in these powerful AI systems.
The preliminary experiments described in the paper demonstrate that by applying CC-based prompting strategies, the creative capabilities of LLVMs can be enhanced. This is a promising step towards advancing the state of the art in machine creativity and exploring the frontiers of vision-language models.
While the paper is limited in scope, it lays the groundwork for further research and discussions at the intersection of Computational Creativity and machine learning algorithms for creative problem solving. By continuing to explore these integration approaches, researchers may be able to unlock new avenues for AI systems to tackle complex, open-ended problems in innovative ways.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
💬
0
Creative Problem Solving in Large Language and Vision Models -- What Would it Take?
Lakshmi Nair, Evana Gizzi, Jivko Sinapov
In this paper, we discuss approaches for integrating Computational Creativity (CC) with research in large language and vision models (LLVMs) to address a key limitation of these models, i.e., creative problem solving. We present preliminary experiments showing how CC principles can be applied to address this limitation through augmented prompting. With this work, we hope to foster discussions of Computational Creativity in the context of ML algorithms for creative problem solving in LLVMs. Our code is at: https://github.com/lnairGT/creative-problem-solving-LLMs
Read more8/22/2024
0
Benchmarking Language Model Creativity: A Case Study on Code Generation
Yining Lu, Dixuan Wang, Tianjian Li, Dongwei Jiang, Daniel Khashabi
As LLMs become increasingly prevalent, it is interesting to consider how ``creative'' these models can be. From cognitive science, creativity consists of at least two key characteristics: emph{convergent} thinking (purposefulness to achieve a given goal) and emph{divergent} thinking (adaptability to new environments or constraints) citep{runco2003critical}. In this work, we introduce a framework for quantifying LLM creativity that incorporates the two characteristics. This is achieved by (1) Denial Prompting pushes LLMs to come up with more creative solutions to a given problem by incrementally imposing new constraints on the previous solution, compelling LLMs to adopt new strategies, and (2) defining and computing the NeoGauge metric which examines both convergent and divergent thinking in the generated creative responses by LLMs. We apply the proposed framework on Codeforces problems, a natural data source for collecting human coding solutions. We quantify NeoGauge for various proprietary and open-source models and find that even the most creative model, GPT-4, still falls short of demonstrating human-like creativity. We also experiment with advanced reasoning strategies (MCTS, self-correction, etc.) and observe no significant improvement in creativity. As a by-product of our analysis, we release NeoCoder dataset for reproducing our results on future models.
Read more7/15/2024
0
Enhancing Creativity in Large Language Models through Associative Thinking Strategies
Pronita Mehrotra, Aishni Parab, Sumit Gulwani
This paper explores the enhancement of creativity in Large Language Models (LLMs) like vGPT-4 through associative thinking, a cognitive process where creative ideas emerge from linking seemingly unrelated concepts. Associative thinking strategies have been found to effectively help humans boost creativity. However, whether the same strategies can help LLMs become more creative remains under-explored. In this work, we investigate whether prompting LLMs to connect disparate concepts can augment their creative outputs. Focusing on three domains -- Product Design, Storytelling, and Marketing -- we introduce creativity tasks designed to assess vGPT-4's ability to generate original and useful content. By challenging the models to form novel associations, we evaluate the potential of associative thinking to enhance the creative capabilities of LLMs. Our findings show that leveraging associative thinking techniques can significantly improve the originality of vGPT-4's responses.
Read more5/14/2024
💬
0
Divergent Creativity in Humans and Large Language Models
Antoine Bellemare-Pepin (CoCo Lab, Psychology department, Universit'e de Montr'eal, Montreal, QC, Canada, Music department, Concordia University, Montreal, QC, Canada), Franc{c}ois Lespinasse (Sociology and Anthropology department, Concordia University, Montreal, QC, Canada), Philipp Tholke (CoCo Lab, Psychology department, Universit'e de Montr'eal, Montreal, QC, Canada), Yann Harel (CoCo Lab, Psychology department, Universit'e de Montr'eal, Montreal, QC, Canada), Kory Mathewson (Mila), Jay A. Olson (Department of Psychology, University of Toronto Mississauga, Mississauga, ON, Canada), Yoshua Bengio (Mila, Department of Computer Science and Operations Research, Universit'e de Montr'eal, Montreal, QC, Canada), Karim Jerbi (CoCo Lab, Psychology department, Universit'e de Montr'eal, Montreal, QC, Canada, UNIQUE Center)
The recent surge in the capabilities of Large Language Models (LLMs) has led to claims that they are approaching a level of creativity akin to human capabilities. This idea has sparked a blend of excitement and apprehension. However, a critical piece that has been missing in this discourse is a systematic evaluation of LLM creativity, particularly in comparison to human divergent thinking. To bridge this gap, we leverage recent advances in creativity science to build a framework for in-depth analysis of divergent creativity in both state-of-the-art LLMs and a substantial dataset of 100,000 humans. We found evidence suggesting that LLMs can indeed surpass human capabilities in specific creative tasks such as divergent association and creative writing. Our quantitative benchmarking framework opens up new paths for the development of more creative LLMs, but it also encourages more granular inquiries into the distinctive elements that constitute human inventive thought processes, compared to those that can be artificially generated.
Read more5/24/2024