794 citations · 2k across the 30 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.CL2026
Mixture-of-Depths Attention
Lianghui Zhu, Yuxin Fang, Bencheng Liao +10
Scaling depth is a key driver for large language models (LLMs). Yet, as LLMs become deeper, they often suffer from signal degradation: informative features formed in shallow layers…
cs.CV2026
Cross-Layer Attentive Feature Upsampling for Low-latency Semantic Segmentation
Tianheng Cheng, Xinggang Wang, Junchao Liao +1
Semantic segmentation is a fundamental problem in computer vision and it requires high-resolution feature maps for dense prediction. Current coordinate-guided low-resolution featur…