PromptNCE: Conditional Probabilities and PMI Using Only LLMs and Contrastive Estimation Prompts

Juliette Woodrow, Chris Piech

Estimating mutual information from text usually requires training a task-specific critic, which limits its use in low-data settings. We ask whether large language models can instea…