6 citations · 22 across the 5 of their papers we have counts for
5 papers
TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer
Zhen Qin, Dong Li, Weigao Sun +8
We present TransNormerLLM, the first linear attention-based Large Language Model (LLM) that outperforms conventional softmax attention-based models in terms of both accuracy and ef…
PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Prediction
Hao Wu, Fan Xu, Chong Chen +3
In this paper, we investigate the challenge of spatio-temporal video prediction task, which involves generating future video frames based on historical spatio-temporal observation…
Parameter-efficient Tuning of Large-scale Multimodal Foundation Model
Haixin Wang, Xinlong Yang, Jianlong Chang +5
Driven by the progress of large-scale pre-training, parameter-efficient transfer learning has gained immense popularity across different subfields of Artificial Intelligence. The c…
LION: Implicit Vision Prompt Tuning
Haixin Wang, Jianlong Chang, Xiao Luo +3
Despite recent competitive performance across a range of vision tasks, vision Transformers still have an issue of heavy computational costs. Recently, vision prompt learning has pr…
Expediting Large-Scale Vision Transformer for Dense Prediction without Fine-tuning
Weicong Liang, Yuhui Yuan, Henghui Ding +6
Vision transformers have recently achieved competitive results across various vision tasks but still suffer from heavy computation costs when processing a large number of tokens. M…