2 citations · 3 across the 6 of their papers we have counts for
5 papers · 1 filter
EMAFusion: A Self-Optimizing System for Seamless LLM Selection and Integration
Soham Shah, Kumar Shridhar, Surojit Chatterjee +1
While recent advances in large language models (LLMs) have significantly enhanced performance across diverse natural language tasks, the high computational and financial costs asso…
UNDO: Understanding Distillation as Optimization
Kushal Jain, Piyushi Goyal, Kumar Shridhar
Knowledge distillation has emerged as an effective strategy for compressing large language models' (LLMs) knowledge into smaller, more efficient student models. However, standard o…
Beyond Pattern Recognition: Probing Mental Representations of LMs
Moritz Miller, Kumar Shridhar
Language Models (LMs) have demonstrated impressive capabilities in solving complex reasoning tasks, particularly when prompted to generate intermediate explanations. However, it re…
Distilling LLMs' Decomposition Abilities into Compact Language Models
Denis Tarasov, Kumar Shridhar
Large Language Models (LLMs) have demonstrated proficiency in their reasoning abilities, yet their large size presents scalability challenges and limits any further customization.…
First-Step Advantage: Importance of Starting Right in Multi-Step Math Reasoning
Kushal Jain, Moritz Miller, Niket Tandon +1
Language models can solve complex reasoning tasks better by learning to generate rationales for their predictions. Often these models know how to solve a task but their auto-regres…