Learning to Translate from Soft to Hard LLM Prompts

Pitipat Kongsomjit, Suryansh Goyal, Jacob Whitehill

Soft prompting, also known as continuous prompting, is a parameter-efficient method for tuning LLMs to specific tasks. Like other machine learning techniques, its parameters encode…