Showing 2026Show all
2 papers · 1 filter
cs.LG2026
StructZO: Structured Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning
Xuanlin Yang, Jia Li, Zhouchen Lin
Fine-tuning large language models at scale is increasingly limited by the memory cost of backpropagation. Zeroth-Order (ZO) optimizers reduce this burden by relying only on forward…
cs.LG2026
DataFlex: A Unified Framework for Data-Centric Dynamic Training of Large Language Models
Hao Liang, Zhengyang Zhao, Meiyi Qiang +22
Data-centric training has emerged as a promising direction for improving large language models (LLMs) by optimizing not only model parameters but also the selection, composition, a…