3 papers
cs.NI2026
GORGO: Online Tuning for Cross-Region Network-Aware LLM Serving
Alessio Ricci Toniolo, Rome Thorstenson, Abinaya Dinesh
Increasingly, LLM inference services proxy client requests to engine replicas distributed globally. Load-balancing policies must jointly account for factors including KV-cache loca…
cs.LG2026
Protein contacts are already in the attention: a single-forward-pass alternative to the Categorical Jacobian
Rome Thorstenson
The Categorical Jacobian of Zhang et al. (2024) reads protein contacts from a language model by perturbing every residue with every alternative amino acid, about forward pass…
cs.LG2025
Sparsity and Superposition in Mixture of Experts
Marmik Chaudhari, Jeremi Nuer, Rome Thorstenson
Mixture of Experts (MoE) models have become central to scaling large language models, yet their mechanistic differences from dense networks remain poorly understood. Previous work…