activity
20242026
most citedZeroth-Order Fine-Tuning of LLMs in Random Subspaces

1 citations · 2 across the 4 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.LG2026

SubZero+: Memory-Efficient Adaptive Zeroth-Order LLM Fine-Tuning in Random Subspaces

Ziming Yu, Shuyao Xiao, Xingyu Zhao +6

Zeroth-order (ZO) optimization with SGD in random subspaces enables memory-efficient fine-tuning of large language models without backpropagation. However, high gradient estimation…