On the Fragility of Tasks under Composition: Implicit Budgeting in Language Models

Chenpan Li, Thies Brockmoeller, Stefanie Jegelka +2

Modern language models are increasingly asked to handle several tasks within a single prompt. Doing so requires solving each task correctly while integrating the resulting answers…