2 papers
cs.LG2023
Saturn: Efficient Multi-Large-Model Deep Learning
Kabir Nagrecha, Arun Kumar
In this paper, we propose Saturn, a new data system to improve the efficiency of multi-large-model training (e.g., during model selection/hyperparameter optimization). We first ide…
cs.LG2023
Saturn: An Optimized Data System for Large Model Deep Learning Workloads
Kabir Nagrecha, Arun Kumar
Large language models such as GPT-3 & ChatGPT have transformed deep learning (DL), powering applications that have captured the public's imagination. These models are rapidly being…