2 papers
cs.CL2026
Data Scaling as Progressive Coverage of a Predictive Contribution Spectrum
Zihui Song, Shihao Ji, Hongxi Li +2
We investigate the hypothesis that real-data scaling laws are governed by progressive coverage of a latent predictive contribution spectrum rather than by token-frequency tails alo…
cs.CL2024
VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks
Yang Li, Shaobo Han, Shihao Ji
As the adoption of large language models increases and the need for per-user or per-task model customization grows, the parameter-efficient fine-tuning (PEFT) methods, such as low-…