Publications (22)
Nemotron-Labs-TwoTower: Diffusion Language Modeling with Pretrained Autoregressive Context
Fitsum Reda, John Kamalu, Roger Waleffe +3
Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence
NVIDIA, :, Amala Sanjay Deshmukh +204
LatentMoE: Toward Optimal Accuracy per FLOP and Parameter in Mixture of Experts
Venmugil Elango, Nidhi Bhatia, Roger Waleffe +13
Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
NVIDIA, :, Aaron Blakeman +198
MariusGNN: Resource-Efficient Out-of-Core Training of Graph Neural Networks
Roger Waleffe, Jason Mohoney, Theodoros Rekatsinas +1
NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model
NVIDIA, :, Aarti Basant +214
Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learning
Patrik Okanovic, Roger Waleffe, Vasilis Mageirakos +5
Pretraining Large Language Models with NVFP4
NVIDIA, Felix Abecassis, Anjulie Agrusa +87
Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
NVIDIA, :, Aakshita Chandiramani +544
NVIDIA Nemotron 3: Efficient and Open Intelligence
NVIDIA, :, Aaron Blakeman +356
Principal Component Networks: Parameter Reduction Early in Training
Roger Waleffe, Theodoros Rekatsinas
Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
NVIDIA, :, Aaron Blakeman +571
Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
NVIDIA, :, Aaron Blakeman +311
NVIDIA Nemotron Nano V2 VL
NVIDIA, :, Amala Sanjay Deshmukh +121
Llama-Nemotron: Efficient Reasoning Models
Akhiad Bercovich, Itay Levy, Izik Golan +132
Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Models
Wenqi Jiang, Marco Zeller, Roger Waleffe +2
Cosmos 3: Omnimodal World Models for Physical AI
NVIDIA, :, Aditi +293
Armada: Memory-Efficient Distributed Training of Large-Scale Graph Neural Networks
Roger Waleffe, Devesh Sarda, Jason Mohoney +3
MLKV: Efficiently Scaling up Large Embedding Model Training with Disk-based Key-Value Storage
Yongjun He, Roger Waleffe, Zhichao Han +8
GraphSnapShot: Caching Local Structure for Fast Graph Learning
Dong Liu, Roger Waleffe, Meng Jiang +1
An Empirical Study of Mamba-based Language Models
Roger Waleffe, Wonmin Byeon, Duncan Riach +13
Marius: Learning Massive Graph Embeddings on a Single Machine
Jason Mohoney, Roger Waleffe, Yiheng Xu +2