eager execution 1large language model training 1memory optimization 1online profiling 1swap-based management 1
From the 1 of 2 linked papers with an AI index.
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
SmartSwap: Swap-Based Memory Optimization for LLM Training under Varying Operator Sequences
Zibo Wang, Yuhang Zhou, Zhibin Wang +13
The paper introduces SmartSwap, a swap‑based memory optimization framework that adapts to varying operator sequences in eager‑mode training of large language models, using a lightw…
cs.DC2026
STAR: Decode-Phase Rescheduling for LLM Inference
Zhibin Wang, Zetao Hong, Xue Li +8
Large Language Model (LLM) inference has emerged as a fundamental paradigm, however, variations in output length cause severe workload imbalance in the decode phase, particularly f…