1 citations · 1 across the 9 of their papers we have counts for
Showing 2023Show all
3 papers · 1 filter
cs.CL2023
Unraveling Feature Extraction Mechanisms in Neural Networks
Xiaobing Sun, Jiaxi Li, Wei Lu
The underlying mechanism of neural networks in capturing precise knowledge has been the subject of consistent research efforts. In this work, we propose a theoretical approach base…
cs.CL2023
Decomposed Prompt Tuning via Low-Rank Reparameterization
Yao Xiao, Lu Xu, Jiaxi Li +2
While prompt tuning approaches have achieved competitive performance with high efficiency, we observe that they invariably employ the same initialization process, wherein the soft…
cs.CL2023
Contextual Distortion Reveals Constituency: Masked Language Models are Implicit Parsers
Jiaxi Li, Wei Lu
Recent advancements in pre-trained language models (PLMs) have demonstrated that these models possess some degree of syntactic awareness. To leverage this knowledge, we propose a n…