distributed execution 1GPU memory efficiency 1large language model training 1long-context reinforcement learning 1policy optimization 1
From the 1 of 3 linked papers with an AI index.
3 papers
cs.LG2026
LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget
Changhai Zhou, Kieran Liu, Yuhua Zhou +17
LongStraw introduces an execution framework that enables reinforcement‑learning post‑training on million‑token prompts using a fixed GPU budget by separating prompt evaluation from…
cs.LG2026
On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters
Mind Lab, :, Vin Bo +64
Parameter-efficient fine-tuning (PEFT) is usually treated as a cheaper alternative to full fine-tuning. We study a broader role: small trainable adapters as persistent local state…
cs.LG2026
MinT: Managed Infrastructure for Training and Serving Millions of LLMs
Mind Lab, :, Song Cao +60
We present MindLab Toolkit (MinT), a managed infrastructure system for Low-Rank Adaptation (LoRA) post-training and online serving. MinT targets a setting where many trained polici…