Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Compensate Quantization Errors: Make Weights Hierarchical to Compensate Each Other
Yifei Gao, Jie Ou, Lei Wang +4
Emergent Large Language Models (LLMs) use their extraordinary performance and powerful deduction capacity to discern from traditional language models. However, the expenses of comp…
cs.CL2023
Pay Attention to What You Need
Yifei Gao, Shaohong Chen, Lei Wang +5
Although large language models (LLMs) have achieved significant success in natural language processing, they still struggle with long-context comprehension. Traditional approaches…