Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Sparsity Saves Compute, Not Samples: Oracle Inequalities for Dense and Sparse Mixture of Experts
Sagar Ghosh, Huy Nguyen, Alessandro Rinaldo
Mixture-of-Experts (MoE) models combine specialized experts through an input-dependent routing mechanism, and their sparse variants underpin many modern large-scale systems. Yet th…
cs.LG2025
Transformers Are Universally Consistent
Sagar Ghosh, Kushal Bose, Swagatam Das
Despite their central role in the success of foundational models and large-scale language modeling, the theoretical foundations governing the operation of Transformers remain only…
cs.LG2024
Consistent Spectral Clustering in Hyperbolic Spaces
Sagar Ghosh, Swagatam Das
Clustering, as an unsupervised technique, plays a pivotal role in various data analysis applications. Among clustering algorithms, Spectral Clustering on Euclidean Spaces has been…