103 citations · 278 across the 43 of their papers we have counts for
7 papers · 1 filter
MixReasoning: Switching Modes to Think
Haiquan Lu, Gongfan Fang, Xinyin Ma +2
Reasoning models enhance performance by tackling problems in a step-by-step manner, decomposing them into sub-problems and exploring long chains of thought before producing an answ…
ConciseHint: Boosting Efficient Reasoning via Continuous Concise Hints during Generation
Siao Tang, Xinyin Ma, Gongfan Fang +1
Recent advancements in large reasoning models (LRMs) like DeepSeek-R1 and OpenAI o1 series have achieved notable performance enhancements on complex reasoning tasks by scaling up t…
CoT-Valve: Length-Compressible Chain-of-Thought Tuning
Xinyin Ma, Guangnian Wan, Runpeng Yu +2
Chain-of-Thought significantly enhances a model's reasoning capability, but it also comes with a considerable increase in inference costs due to long chains. With the observation t…
MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
Gongfan Fang, Hongxu Yin, Saurav Muralidharan +5
Large Language Models (LLMs) are distinguished by their massive parameter counts, which typically result in significant redundancy. This work introduces MaskLLM, a learnable prunin…
A Comprehensive Study of Structural Pruning for Vision Models
Changhao Li, Haoling Li, Mengqi Xue +6
Structural pruning has emerged as a promising approach for producing more efficient models. Nevertheless, the community suffers from a lack of standardized benchmarks and metrics,…
DepGraph: Towards Any Structural Pruning
Gongfan Fang, Xinyin Ma, Mingli Song +2
Structural pruning enables model acceleration by removing structurally-grouped parameters from neural networks. However, the parameter-grouping patterns vary widely across differen…
Contrastive Model Inversion for Data-Free Knowledge Distillation
Gongfan Fang, Jie Song, Xinchao Wang +3
Model inversion, whose goal is to recover training data from a pre-trained model, has been recently proved feasible. However, existing inversion methods usually suffer from the mod…