297 citations · 320 across the 4 of their papers we have counts for
4 papers
Orbax: Distributed Checkpointing with JAX
Colin Gaffney, Shutong Li, Daniel Ng +13
In a landscape of high-performance distributed ML systems, JAX has emerged as a framework of choice. However, JAX's modular design philosophy leaves it without a standardized check…
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Gemini Team, Petko Georgiev, Ving Ian Lei +1132
In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over…
Structured Model Pruning of Convolutional Networks on Tensor Processing Units
Kongtao Chen, Ken Franko, Ruoxin Sang
The deployment of convolutional neural networks is often hindered by high computational and storage requirements. Structured model pruning is a promising approach to alleviate thes…
Ranking Neural Checkpoints
Yandong Li, Xuhui Jia, Ruoxin Sang +4
This paper is concerned with ranking many pre-trained deep neural networks (DNNs), called checkpoints, for the transfer learning to a downstream task. Thanks to the broad use of DN…