activity
20182026
most citedParameter Hub: a Rack-Scale Parameter Server for Distributed Deep Neural Network Training

97 citations · 625 across the 24 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.CL2026

Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning

NVIDIA, :, Aaron Blakeman +572

We introduce Nemotron 3 Ultra, a 550 billion total and 55 billion active parameter Mixture-of-Experts Hybrid Mamba-Attention language model. We pre-trained Nemotron 3 Ultra on 20 t…