3 papers
cs.DC2026
Orbax: Distributed Checkpointing with JAX
Colin Gaffney, Shutong Li, Daniel Ng +13
In a landscape of high-performance distributed ML systems, JAX has emerged as a framework of choice. However, JAX's modular design philosophy leaves it without a standardized check…
cs.CL2024
Gemma 2: Improving Open Language Models at a Practical Size
Gemma Team, Morgane Riviere, Shreya Pathak +195
In this work, we introduce Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters. In th…
cs.AI2024
KerasCV and KerasNLP: Vision and Language Power-Ups
Matthew Watson, Divyashree Shivakumar Sreepathihalli, Francois Chollet +14
We present the Keras domain packages KerasCV and KerasNLP, extensions of the Keras API for Computer Vision and Natural Language Processing workflows, capable of running on either J…