Publications (37)
MLSys: The New Frontier of Machine Learning Systems
Alexander Ratner, Dan Alistarh, Gustavo Alonso +66
Emergent Abilities of Large Language Models
Jason Wei, Yi Tay, Rishi Bommasani +13
Distilling the Knowledge in a Neural Network
Geoffrey Hinton, Oriol Vinyals, Jeff Dean
Shaping AI's Impact on Billions of Lives
Mariano-Florentino Cuéllar, Jeff Dean, Finale Doshi-Velez +6
A Review of Sparse Expert Models in Deep Learning
William Fedus, Jeff Dean, Barret Zoph
Scalable and accurate deep learning for electronic health records
Alvin Rajkomar, Eyal Oren, Kai Chen +31
Efficient Neural Architecture Search via Parameter Sharing
Hieu Pham, Melody Y. Guan, Barret Zoph +2
The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
David Patterson, Joseph Gonzalez, Urs Hölzle +7
Gemma 3 Technical Report
Gemma Team, Aishwarya Kamath, Johan Ferret +209
That Chip Has Sailed: A Critique of Unfounded Skepticism Around AI for Chip Design
Anna Goldie, Azalia Mirhoseini, Jeff Dean
Gemma: Open Models Based on Gemini Research and Technology
Gemma Team, Thomas Mesnard, Cassidy Hardin +105
Pathways: Asynchronous Distributed Dataflow for ML
Paul Barham, Aakanksha Chowdhery, Jeff Dean +13
Gemma 2: Improving Open Language Models at a Practical Size
Gemma Team, Morgane Riviere, Shreya Pathak +195
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Gemini Team, Petko Georgiev, Ving Ian Lei +1132
WAXAL: A Large-Scale Multilingual African Language Speech Corpus
Abdoulaye Diack, Perry Nelson, Kwaku Agbesi +40
Equilibria and Learning in Modular Marketplaces
Kshipra Bhawalkar, Jeff Dean, Christopher Liaw +2
Device Placement Optimization with Reinforcement Learning
Azalia Mirhoseini, Hieu Pham, Quoc V. Le +7
Building high-level features using large scale unsupervised learning
Quoc V. Le, Marc'Aurelio Ranzato, Rajat Monga +5
An Evolutionary Approach to Dynamic Introduction of Tasks in Large-scale Multitask Learning Systems
Andrea Gesmundo, Jeff Dean
Dynamic Control Flow in Large-Scale Machine Learning
Yuan Yu, MartÃn Abadi, Paul Barham +12
PaLM: Scaling Language Modeling with Pathways
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin +64
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz +4
Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
Gheorghe Comanici, Eric Bieber, Mike Schaekermann +3431
Efficiently Scaling Transformer Inference
Reiner Pope, Sholto Douglas, Aakanksha Chowdhery +7
Using Web Co-occurrence Statistics for Improving Image Categorization
Samy Bengio, Jeff Dean, Dumitru Erhan +5
Matryoshka Quantization
Pranav Nair, Puranjay Datta, Jeff Dean +2
Interlocking Backpropagation: Improving depthwise model-parallelism
Aidan N. Gomez, Oscar Key, Kuba Perlin +4
Capabilities of Gemini Models in Medicine
Khaled Saab, Tao Tu, Wei-Hung Weng +64
Brainformers: Trading Simplicity for Efficiency
Yanqi Zhou, Nan Du, Yanping Huang +12
ST-MoE: Designing Stable and Transferable Sparse Expert Models
Barret Zoph, Irwan Bello, Sameer Kumar +5
Scaling Instruction-Finetuned Language Models
Hyung Won Chung, Le Hou, Shayne Longpre +32
muNet: Evolving Pretrained Deep Neural Networks into Scalable Auto-tuning Multitask Systems
Andrea Gesmundo, Jeff Dean
Carbon Emissions and Large Neural Network Training
David Patterson, Joseph Gonzalez, Quoc Le +6
Chip Placement with Deep Reinforcement Learning
Azalia Mirhoseini, Anna Goldie, Mustafa Yazgan +19
Decoupled DiLoCo for Resilient Distributed Pre-training
Arthur Douillard, Keith Rush, Yani Donchev +14
Measuring the environmental impact of delivering AI at Google Scale
Cooper Elsworth, Keguo Huang, David Patterson +9
AI and the Opportunity for Shared Prosperity: Lessons from the History of Technology and the Economy
Guy Ben-Ishai, Jeff Dean, James Manyika +3