activity
20232026
most citedMiniCPM-SALA: Hybridizing Sparse and Linear Attention for Efficient Long-Context Modeling

1 citations · 2 across the 5 of their papers we have counts for

collaborators
Showing 2023Show all

1 paper · 1 filter

cs.CL2023

Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models

Weize Chen, Xiaoyue Xu, Xu Han +5

Parameter-shared pre-trained language models (PLMs) have emerged as a successful approach in resource-constrained environments, enabling substantial reductions in model storage and…