âPrompting AI Art: An Investigation into the Creative Skill of Prompt Engineeringâ, 2023-03-13 ()â :
Humankind is entering a novel era of creativityâan era in which anybody can synthesize digital content. The paradigm under which this revolution takes place is prompt-based learning (or in-context learning). This paradigm has found fruitful application in text-to-image generation where it is being used to synthesize digital images from zero-shot text prompts in natural language for the purpose of creating AI art. This activity is referred to as prompt engineeringâthe practice of iteratively crafting prompts to generate and improve images.
In this paper, we investigate prompt engineering as a novel creative skill for creating prompt-based art. In 3 studies with participants recruited from a crowdsourcing platform, we explore whether untrained participants could (1) recognize the quality of prompts, (2) write prompts, and (3) improve their prompts. Our results indicate that participants could assess the quality of prompts and respective images. This ability increased with the participantsâ experience and interest in art. Participants further were able to write prompts in rich descriptive language.
However, even though participants were specifically instructed to generate artworks, participantsâ prompts were missing the specific vocabulary needed to apply a certain style to the generated images. Our results suggest that prompt engineering is a learned skill that requires expertise and practice. Based on our findings and experience with running our studies with participants recruited from a crowdsourcing platform, we provide 10 recommendations for conducting experimental research on text-to-image generation and prompt engineering with a paid crowd.
Our studies offer a deeper understanding of prompt engineering thereby opening up avenues for research on the future of prompt engineering. We conclude by speculating on 4 possible futures of prompt engineering.