2 papers
cs.LG2025
CurvaDion: Curvature-Adaptive Distributed Orthonormalization
Bhavesh Kumar, Roger Jin, Jeffrey Quesnelle
As language models scale to trillions of parameters, distributed training across many GPUs becomes essential, yet gradient synchronization over high-bandwidth, low-latency networks…
cs.AI2025
Hermes 4 Technical Report
Ryan Teknium, Roger Jin, Jai Suphavadeeprasit +6
We present Hermes 4, a family of hybrid reasoning models that combine structured, multi-turn reasoning with broad instruction-following ability. We describe the challenges encounte…