1 citations · 2 across the 5 of their papers we have counts for
Showing 2025Show all
3 papers · 1 filter
cs.AI2025
DTS: Enhancing Large Reasoning Models via Decoding Tree Sketching
Zicheng Xu, Xiuyi Lou, Guanchu Wang +6
Large Reasoning Models (LRMs) achieve remarkable inference-time improvements through parallel thinking. However, existing methods rely on redundant sampling of reasoning trajectori…
cs.LG2025★ 1 cited
SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
Minrui Luo, Fuhang Kuang, Yu Wang +2
Parameter-Efficient Fine-Tuning (PEFT) methods, particularly Low-Rank Adaptation (LoRA), are indispensable for efficiently customizing Large Language Models (LLMs). However, vanill…
cs.LG2025
Breaking the Frozen Subspace: Importance Sampling for Low-Rank Optimization in LLM Pretraining
Haochen Zhang, Junze Yin, Guanchu Wang +5
Low-rank optimization has emerged as a promising approach to enabling memory-efficient training of large language models (LLMs). Existing low-rank optimization methods typically pr…