1 citations · 1 across the 4 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2023★ 2 cited
MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language Models
Mengting Ai, Tianxin Wei, Yifan Chen +2
Fine-tuning a pre-trained language model (PLM) emerges as the predominant strategy in many natural language processing applications. However, this process is known to be expensive,…
cs.LG2023
A Gromov--Wasserstein Geometric View of Spectrum-Preserving Graph Coarsening
Yifan Chen, Rentian Yao, Yun Yang +1
Graph coarsening is a technique for solving large-scale graph problems by working on a smaller version of the original graph, and possibly interpolating the results back to the ori…
cs.LG2021
Skyformer: Remodel Self-Attention with Gaussian Kernel and Nyström Method
Yifan Chen, Qi Zeng, Heng Ji +1
Transformers are expensive to train due to the quadratic time and space complexity in the self-attention mechanism. On the other hand, although kernel machines suffer from the same…