61 citations · 125 across the 16 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2024
MEP: Multiple Kernel Learning Enhancing Relative Positional Encoding Length Extrapolation
Weiguo Gao
When the predicted sequence length exceeds the length seen during training, the transformer's inference accuracy diminishes. Existing relative position encoding methods, such as th…
cs.LG2020
A Partial Regularization Method for Network Compression
E Zhenqian, Gao Weiguo
Deep Neural Networks have achieved remarkable success relying on the developing availability of GPUs and large-scale datasets with increasing network depth and width. However, due…
cs.LG2020
An Improving Framework of regularization for Network Compression
E Zhenqian, Gao Weiguo
Deep Neural Networks have achieved remarkable success relying on the developing high computation capability of GPUs and large-scale datasets with increasing network depth and width…