MinT: Managed Infrastructure for Training and Serving Millions of LLMs

Mind Lab, :, Song Cao +60

We present MindLab Toolkit (MinT), a managed infrastructure system for Low-Rank Adaptation (LoRA) post-training and online serving. MinT targets a setting where many trained polici…