Home / Papers / Investigating Prompt Engineering in Diffusion Models

Investigating Prompt Engineering in Diffusion Models

44 Citations2022
Sam Witteveen, Martin Andrews
ArXiv

Techniques for measuring the effect that specific words and phrases in prompts have, and guidance on the selection of prompts to produce desired effects are presented.

Abstract

With the spread of the use of Text2Img diffusion models such as DALL-E 2, Imagen, Mid Journey and Stable Diffusion, one challenge that artists face is selecting the right prompts to achieve the desired artistic output. We present techniques for measuring the effect that specific words and phrases in prompts have, and (in the Appendix) present guidance on the selection of prompts to produce desired effects.