3 papers
cs.AI2025
The AI Consumer Index (ACE)
Julien Benchek, Rohit Shetty, Benjamin Hunsberger +5
We introduce the first version of the AI Consumer Index (ACE), a benchmark for assessing whether frontier AI models can perform everyday consumer tasks. ACE contains a hidden heldo…
econ.GN2025
The AI Productivity Index (APEX)
Bertie Vidgen, Abby Fennelly, Evan Pinnix +17
We present an extended version of the AI Productivity Index (APEX-v1-extended), a benchmark for assessing whether frontier models are capable of performing economically valuable ta…
cs.CL2025
Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
NVIDIA, :, Aaron Blakeman +198
As inference-time scaling becomes critical for enhanced reasoning capabilities, it is increasingly becoming important to build models that are efficient to infer. We introduce Nemo…