3 papers
cs.LG2025
CurvaDion: Curvature-Adaptive Distributed Orthonormalization
Bhavesh Kumar, Roger Jin, Jeffrey Quesnelle
As language models scale to trillions of parameters, distributed training across many GPUs becomes essential, yet gradient synchronization over high-bandwidth, low-latency networks…
cs.AI2025
Hermes 4 Technical Report
Ryan Teknium, Roger Jin, Jai Suphavadeeprasit +6
We present Hermes 4, a family of hybrid reasoning models that combine structured, multi-turn reasoning with broad instruction-following ability. We describe the challenges encounte…
stat.ML2024
Spectrally Transformed Kernel Regression
Runtian Zhai, Rattana Pukdee, Roger Jin +2
Unlabeled data is a key component of modern machine learning. In general, the role of unlabeled data is to impose a form of smoothness, usually from the similarity information enco…