8 papers · 1 filter
MJev-Spatial: System One Spatial Intelligence via Native Attention Matching
Luozheng Qin, Yuhan Zhu, Changhai Zhou +10
Spatial intelligence lets an agent perceive and act in the physical world, and many of its judgments must be made at interaction rates: which spatial relation holds, how far an obj…
miniTE: Diagnosing and Bridging the Execution Gap in Native NVFP4 Reinforcement Learning
Zhen Li, Mingfa Feng, Yiming Zhang +6
Native NVFP4 promises to accelerate reinforcement learning (RL) for large language models (LLMs), but achieving stable learning across separate training and sampling engines remain…
Positions Are Not Facts: The Mismatch Between KV Caches and Memory
Changhai Zhou, Yuhua Zhou, Shiyang Zhang +5
When a fact changes, how should a language model update the history stored in its key-value (KV) cache? Hiding the old record is cheap, but it may still contain needed details or a…
LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget
Changhai Zhou, Kieran Liu, Yuhua Zhou +17
Long-context RL post-training is constrained by the lifetime of state and gradients, not attention cost alone. In GRPO, one multi-million-token prompt must serve old-policy and ref…
BUDDY: BUdget-Driven DYnamic Depth Routing for Adaptive Large Language Model Inference
Yuhua Zhou, Shaoqi Yu, Shichao Weng +4
Large language models (LLMs) incur high inference cost due to their depth and parameter scale. Depth pruning can reduce latency by skipping redundant Transformer blocks, but existi…
MinT: Managed Infrastructure for Training and Serving Millions of LLMs
Mind Lab, :, Song Cao +60
We present MindLab Toolkit (MinT), a managed infrastructure system for Low-Rank Adaptation (LoRA) post-training and online serving. MinT targets a setting where many trained polici…
CoRE: A Fine-Grained Code Reasoning Benchmark Beyond Output Prediction
Jun Gao, Yun Peng, Qian Qiao +6
Despite strong performance on code generation tasks, it remains unclear whether large language models (LLMs) genuinely reason about code execution. Existing code reasoning benchmar…
AutoQRA: Joint Optimization of Mixed-Precision Quantization and Low-rank Adapters for Efficient LLM Fine-Tuning
Changhai Zhou, Shiyang Zhang, Yuhua Zhou +5
Quantization followed by parameter-efficient fine-tuning has emerged as a promising paradigm for downstream adaptation under tight GPU memory constraints. However, this sequential…