activity
20202026
most citedULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks

113 citations · 191 across the 22 of their papers we have counts for

collaborators
Showing 2026Show all

2 papers · 1 filter

cs.LG2026

Same Architecture, Different Capacity: Optimizer-Induced Spectral Scaling Laws

Nandan Kumar Jha, Brandon Reagen

Scaling laws have made language-model performance predictable from model size, data, and compute, but they typically treat the optimizer as a fixed training detail. We show that th…

cs.LG2026

NerVE: Nonlinear Eigenspectrum Dynamics in LLM Feed-Forward Networks

Nandan Kumar Jha, Brandon Reagen

We introduce NerVE, a unified eigenspectral framework for understanding how feed-forward networks (FFNs) in large language models (LLMs) organize and regulate information flow in h…