126 citations
- Huawei Technologies (China)CN21 papers
- Peking UniversityCN10 papers
- Huawei Technologies (Sweden)SE7 papers
- Huawei Technologies (United States)US6 papers
- University College LondonGB5 papers
- University of Hong KongHK5 papers
- Hong Kong University of Science and TechnologyHK3 papers
- Lomonosov Moscow State UniversityRU3 papers
- National Research University Higher School of EconomicsRU3 papers
- Shanghai Jiao Tong UniversityCN3 papers
- Southern University of Science and TechnologyCN3 papers
- Tsinghua UniversityCN3 papers
5 papers · 1 filter
EFQ-Softmax: Exp-Free Quantization for Softmax
Haohui Han, Yuming Wan, Hongni Wang +4
Low-bit attention accelerates Transformer inference by moving the and matrix multiplications to FP8 or FP4 matrix engines. However, the softmax path often evaluates…
What Proves You Wrong: Benchmarking Language Models on Falsifiable Research Ideation
Ziyue Wang, Aomufei Yuan, Yiran Yao +10
Large language models are increasingly used to propose research ideas, yet the prevailing ways of judging such ideas supply no shared decision rule: free-form judging sways with st…
Antenna Optimization for Decode-and-Forward Relay in Magnetic Induction Communications
Honglei Ma, Erwu Liu, Rui Wang +4
Magnetic Induction (MI) communication is effective in underground tunnels for emergency rescue vehicle due to the small-size antenna. It can highly benefit from a cooperative decod…
Adaptive multi-fidelity optimization with fast learning rates
Come Fiegel, Victor Gabillon, Michal Valko
In multi-fidelity optimization, biased approximations of varying costs of the target function are available. This paper studies the problem of optimizing a locally smooth function…
Sparsity-Aware Low-Rank Representation for Efficient Fine-Tuning of Large Language Models
Longteng Zhang, Sen Wu, Shuai Hou +7
Adapting large pre-trained language models to downstream tasks often entails fine-tuning millions of parameters or deploying costly dense weight updates, which hinders their use in…