ArtWhisperer: A Dataset for Characterizing Human-AI Interactions in Artistic Creations
0
Sign in to get full access
Overview
- This paper introduces a new dataset called "ArtWhisperer" for studying human-AI interactions in the creation of artistic works.
- The dataset includes transcripts of dialogues between humans and AI systems as they collaboratively generate artworks.
- The researchers aim to use this dataset to better understand the dynamics and challenges of human-AI co-creation in the artistic domain.
Plain English Explanation
The paper describes a new dataset called "ArtWhisperer" that was created to study how people interact with AI systems when they work together to make art. The dataset includes text transcripts that show the conversations and back-and-forth between humans and AI as they collaborate on creating artworks.
The researchers who made this dataset hope that by analyzing these human-AI interactions, they can gain a better understanding of the dynamics and challenges that arise when people and AI systems work together creatively. This could help inform the design of better AI-powered art tools and interaction experiences in the future.
Technical Explanation
The "ArtWhisperer" dataset contains transcripts of dialogues between humans and AI systems as they collaborate on the creation of artistic works. The researchers collected these transcripts by having participants engage with AI-powered art generation tools and recording their conversations.
The dataset covers a variety of artistic domains, including painting, photography, and digital illustration. The transcripts capture the back-and-forth exchanges between the humans and AI as they discuss ideas, provide feedback, and make decisions about the evolving artworks.
By analyzing this dataset, the researchers aim to gain insights into the collaborative dynamics, communication patterns, and creative processes that emerge when people work together with AI systems to produce artistic creations. This could inform the design of better human-AI co-creation experiences and help us understand the challenges and opportunities of AI-assisted artistic production.
Critical Analysis
The ArtWhisperer dataset provides a valuable resource for studying human-AI interactions in the artistic domain. By capturing real-world dialogues between people and AI systems, the dataset offers a unique window into the nuances and complexities of this type of creative collaboration.
However, the researchers acknowledge some limitations of the dataset. For example, the conversations may be influenced by the specific AI tools and interfaces used, which could limit the generalizability of the findings. Additionally, the dataset only represents a small sample of interactions, and the participants may not be fully representative of the broader population of artists and AI users.
Further research could explore how these human-AI interactions vary across different artistic disciplines, skill levels, and cultural contexts. It would also be interesting to investigate the long-term evolution of these collaborative relationships as both humans and AI systems become more experienced and sophisticated over time.
Conclusion
The ArtWhisperer dataset represents an important step towards understanding the dynamic interplay between humans and AI in the creative arts. By analyzing these real-world dialogues, researchers can gain insights that inform the design of more effective AI-powered art tools and human-AI co-creation experiences. This knowledge could ultimately help unlock new possibilities for artistic expression and inquiry at the intersection of human and artificial intelligence.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
ArtWhisperer: A Dataset for Characterizing Human-AI Interactions in Artistic Creations
Kailas Vodrahalli, James Zou
As generative AI becomes more prevalent, it is important to study how human users interact with such models. In this work, we investigate how people use text-to-image models to generate desired target images. To study this interaction, we created ArtWhisperer, an online game where users are given a target image and are tasked with iteratively finding a prompt that creates a similar-looking image as the target. Through this game, we recorded over 50,000 human-AI interactions; each interaction corresponds to one text prompt created by a user and the corresponding generated image. The majority of these are repeated interactions where a user iterates to find the best prompt for their target image, making this a unique sequential dataset for studying human-AI collaborations. In an initial analysis of this dataset, we identify several characteristics of prompt interactions and user strategies. People submit diverse prompts and are able to discover a variety of text descriptions that generate similar images. Interestingly, prompt diversity does not decrease as users find better prompts. We further propose a new metric to quantify the steerability of AI using our dataset. We define steerability as the expected number of interactions required to adequately complete a task. We estimate this value by fitting a Markov chain for each target task and calculating the expected time to reach an adequate score in the Markov chain. We quantify and compare AI steerability across different types of target images and two different models, finding that images of cities and natural world images are more steerable than artistic and fantasy images. These findings provide insights into human-AI interaction behavior, present a concrete method of assessing AI steerability, and demonstrate the general utility of the ArtWhisperer dataset.
Read more6/18/2024
0
Artworks Reimagined: Exploring Human-AI Co-Creation through Body Prompting
Jonas Oppenlaender, Hannah Johnston, Johanna Silvennoinen, Helena Barranha
Image generation using generative artificial intelligence is a popular activity. However, it is almost exclusively performed in the privacy of an individual's home via typing on a keyboard. In this article, we explore body prompting as input for image generation. Body prompting extends interaction with generative AI beyond textual inputs to reconnect the creative act of image generation with the physical act of creating artworks. We implement this concept in an interactive art installation, Artworks Reimagined, designed to transform artworks via body prompting. We deployed the installation at an event with hundreds of visitors in a public and private setting. Our results from a sample of visitors (N=79) show that body prompting was well-received and provides an engaging and fun experience. We identify three distinct patterns of embodied interaction with the generative AI and present insights into participants' experience of body prompting and AI co-creation. We provide valuable recommendations for practitioners seeking to design interactive generative AI experiences in museums, galleries, and other public cultural spaces.
Read more8/13/2024
0
Stylebreeder: Exploring and Democratizing Artistic Styles through Text-to-Image Models
Matthew Zheng, Enis Simsar, Hidir Yesiltepe, Federico Tombari, Joel Simon, Pinar Yanardag
Text-to-image models are becoming increasingly popular, revolutionizing the landscape of digital art creation by enabling highly detailed and creative visual content generation. These models have been widely employed across various domains, particularly in art generation, where they facilitate a broad spectrum of creative expression and democratize access to artistic creation. In this paper, we introduce texttt{STYLEBREEDER}, a comprehensive dataset of 6.8M images and 1.8M prompts generated by 95K users on Artbreeder, a platform that has emerged as a significant hub for creative exploration with over 13M users. We introduce a series of tasks with this dataset aimed at identifying diverse artistic styles, generating personalized content, and recommending styles based on user interests. By documenting unique, user-generated styles that transcend conventional categories like 'cyberpunk' or 'Picasso,' we explore the potential for unique, crowd-sourced styles that could provide deep insights into the collective creative psyche of users worldwide. We also evaluate different personalization methods to enhance artistic expression and introduce a style atlas, making these models available in LoRA format for public use. Our research demonstrates the potential of text-to-image diffusion models to uncover and promote unique artistic expressions, further democratizing AI in art and fostering a more diverse and inclusive artistic community. The dataset, code and models are available at https://stylebreeder.github.io under a Public Domain (CC0) license.
Read more6/24/2024
🔎
0
The Adversarial AI-Art: Understanding, Generation, Detection, and Benchmarking
Yuying Li, Zeyan Liu, Junyi Zhao, Liangqin Ren, Fengjun Li, Jiebo Luo, Bo Luo
Generative AI models can produce high-quality images based on text prompts. The generated images often appear indistinguishable from images generated by conventional optical photography devices or created by human artists (i.e., real images). While the outstanding performance of such generative models is generally well received, security concerns arise. For instance, such image generators could be used to facilitate fraud or scam schemes, generate and spread misinformation, or produce fabricated artworks. In this paper, we present a systematic attempt at understanding and detecting AI-generated images (AI-art) in adversarial scenarios. First, we collect and share a dataset of real images and their corresponding artificial counterparts generated by four popular AI image generators. The dataset, named ARIA, contains over 140K images in five categories: artworks (painting), social media images, news photos, disaster scenes, and anime pictures. This dataset can be used as a foundation to support future research on adversarial AI-art. Next, we present a user study that employs the ARIA dataset to evaluate if real-world users can distinguish with or without reference images. In a benchmarking study, we further evaluate if state-of-the-art open-source and commercial AI image detectors can effectively identify the images in the ARIA dataset. Finally, we present a ResNet-50 classifier and evaluate its accuracy and transferability on the ARIA dataset.
Read more4/24/2024