RELISH: LLM REgression with a Latent Iterative State Head

Yiheng Su, Matthew Lease

We present RELISH (REgression with a Latent Iterative State Head), a novel, lightweight architecture designed for text regression with large language models. Rather than decoding n…