The Prompt Report: A Systematic Survey of Prompt Engineering Techniques

Abstract

Generative Artificial Intelligence (GenAI) systems are increasingly being deployed across diverse industries and research domains. Developers and end-users interact with these systems through the use of prompting and prompt engineering. Although prompt engineering is a widely adopted and extensively researched area, it suffers from conflicting terminology and a fragmented ontological understanding of what constitutes an effective prompt due to its relatively recent emergence. We establish a structured understanding of prompt engineering by assembling a taxonomy of prompting techniques and analyzing their applications. We present a detailed vocabulary of 33 vocabulary terms, a taxonomy of 58 LLM prompting techniques, and 40 techniques for other modalities. Additionally, we provide best practices and guidelines for prompt engineering, including advice for prompting state-of-the-art (SOTA) LLMs such as ChatGPT. We further present a meta-analysis of the entire literature on natural language prefix-prompting. As a culmination of these efforts, this paper presents the most comprehensive survey on prompt engineering to date.

Cited by in corpus (6)

• A Comprehensive Survey on Integrating Large Language Models with Knowledge-Based Methods
• StreetSurfaceVis: a dataset of crowdsourced street-level imagery annotated by road surface type and quality
• That's Not the Feedback I Need! -- Student Engagement with GenAI Feedback in the Tutor Kai
• Exploring Anthropomorphism in Conversational Agents for Environmental Sustainability
• Helping LLMs Improve Code Generation Using Feedback from Testing and Static Analysis
• Generative AI in Health Economics and Outcomes Research: A Taxonomy of Key Definitions and Emerging Applications, an ISPOR Working Group Report