1 citations · 2 across the 11 of their papers we have counts for
5 papers · 1 filter
Beyond Model Base Retrieval: Weaving Knowledge to Master Fine-grained Neural Network Design
Jialiang Wang, Hanmo Liu, Shimin Di +4
Designing high-performance neural networks for new tasks requires balancing optimization quality with search efficiency. Current methods fail to achieve this balance: neural archit…
Adapting Pretrained Language Models for Citation Classification via Self-Supervised Contrastive Learning
Tong Li, Jiachuan Wang, Yongqi Zhang +2
Citation classification, which identifies the intention behind academic citations, is pivotal for scholarly analysis. Previous works suggest fine-tuning pretrained language models…
Learning Towards Emergence: Paving the Way to Induce Emergence by Inhibiting Monosemantic Neurons on Pre-trained Models
Jiachuan Wang, Shimin Di, Tianhao Tang +4
Emergence, the phenomenon of a rapid performance increase once the model scale reaches a threshold, has achieved widespread attention recently. The literature has observed that mon…
PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing
Cheng Deng, Luoyang Sun, Jiwen Jiang +10
While scaling laws have been continuously validated in large language models (LLMs) with increasing model parameters, the inherent tension between the inference demands of LLMs and…
Activation-aware Probe-Query: Effective Key-Value Retrieval for Long-Context LLMs Inference
Qingfa Xiao, Jiachuan Wang, Haoyang Li +6
Recent advances in large language models (LLMs) have showcased exceptional performance in long-context tasks, while facing significant inference efficiency challenges with limited…