3 papers
cs.CL2026
Training-free Context-adaptive Attention for Efficient Long Context Modeling
Zeng You, Yaofo Chen, Shuhai Zhang +5
Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. These capabilities stem primarily from the self-att…
cs.CV2025
Beyond Memorization: A Multi-Modal Ordinal Regression Benchmark to Expose Popularity Bias in Vision-Language Models
Li-Zhong Szu-Tu, Ting-Lin Wu, Chia-Jui Chang +2
We expose a significant popularity bias in state-of-the-art vision-language models (VLMs), which achieve up to 34% higher accuracy on famous buildings compared to ordinary ones, in…
cs.DC2025
FlashRecovery: Fast and Low-Cost Recovery from Failures for Large-Scale Training of LLMs
Haijun Zhang, Jinxiang Wang, Zhenhua Yu +20
Large language models (LLMs) have made a profound impact across various fields due to their advanced capabilities. However, training these models at unprecedented scales requires e…