Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
A Mechanistic Investigation of Supervised Fine Tuning
Ruhaan Chopra
The cosine similarity between a large language model's hidden activations before and after Supervised Fine-Tuning (SFT) remains very high. This, at first glance, suggests that SFT…
cs.AI2025
Hecto: Modular Sparse Experts for Adaptive and Interpretable Reasoning
Sanskar Pandey, Ruhaan Chopra, Saad Murtaza Bhat +1
Mixture-of-Experts (MoE) models enable conditional computation by routing inputs to specialized experts, but these experts rely on identical inductive biases, thus limiting represe…