4 papers
The Hidden Cost of Structured Generation in LLMs: Draft-Conditioned Constrained Decoding
Avinash Reddy, Thayne T. Walker, James S. Ide +1
Large language models (LLMs) are increasingly used to generate executable outputs, JSON objects, and API calls, where a single syntax error can make the output unusable. Constraine…
Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Models
Soumya Suvra Ghosal, Souradip Chakraborty, Avinash Reddy +6
Recent trends in test-time scaling for reasoning models (e.g., OpenAI o1, DeepSeek R1) have led to a popular belief that extending thinking traces using prompts like "Wait" or "Let…
Bounded Rationality for LLMs: Satisficing Alignment at Inference-Time
Mohamad Chehade, Soumya Suvra Ghosal, Souradip Chakraborty +4
Aligning large language models with humans is challenging due to the inherently multifaceted nature of preference feedback. While existing approaches typically frame this as a mult…
Align-Pro: A Principled Approach to Prompt Optimization for LLM Alignment
Prashant Trivedi, Souradip Chakraborty, Avinash Reddy +3
The alignment of large language models (LLMs) with human values is critical as these models become increasingly integrated into various societal and decision-making processes. Trad…