42 citations · 72 across the 9 of their papers we have counts for
4 papers · 1 filter
An Empirical Study of Qwen3 Quantization
Xingyu Zheng, Yuye Li, Haoran Chu +7
The Qwen series has emerged as a leading family of open-source Large Language Models (LLMs), demonstrating remarkable capabilities in natural language understanding tasks. With the…
Clustering Properties of Self-Supervised Learning
Xi Weng, Jianing An, Xudong Ma +5
Self-supervised learning (SSL) methods via joint embedding architectures have proven remarkably effective at capturing semantically rich representations with strong clustering prop…
An empirical study of LLaMA3 quantization: from LLMs to MLLMs
Wei Huang, Xingyu Zheng, Xudong Ma +7
The LLaMA family, a collection of foundation language models ranging from 7B to 65B parameters, has become one of the most powerful open-source large language models (LLMs) and the…
Accurate LoRA-Finetuning Quantization of LLMs via Information Retention
Haotong Qin, Xudong Ma, Xingyu Zheng +6
The LoRA-finetuning quantization of LLMs has been extensively studied to obtain accurate yet compact LLMs for deployment on resource-constrained hardware. However, existing methods…