Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models
Wanyun Cui, Qianle Wang
This paper reveals the phenomenon of parameter heterogeneity in large language models (LLMs). We find that a small subset of "cherry" parameters exhibit a disproportionately large…
cs.CL2024
Ada-Instruct: Adapting Instruction Generators for Complex Reasoning
Wanyun Cui, Qianle Wang
Instructions augmentation is a crucial step for unleashing the full potential of large language models (LLMs) in downstream tasks. Existing Self-Instruct methods primarily simulate…