8 papers
CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models
Yu Chen, Xiaohong Li, Xiaole Wang +3
In video understanding, vision-language models (VLMs) must ingest massive numbers of visual tokens, causing the computational and memory cost of the prefill stage to rise sharply.…
SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
Yanze Wang, Pengfei Yao, Tianyi Sun +7
Agent skills, SKILL files that package reusable procedural knowledge for an LLM agent, are a popular mechanism for extending agent capabilities. Public repositories now host them i…
Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction
Xiaojie Xia, Huigang Zhang, Chaoliang Zhong +2
Transformer architectures deliver state-of-the-art accuracy via dense full-attention, but their quadratic time and memory complexity with respect to sequence length limits practica…
MSA: Memory Sparse Attention for Efficient End-to-End Memory Model Scaling to 100M Tokens
Yu Chen, Runkai Chen, Sheng Yi +9
Long-term memory is a cornerstone of human intelligence. Enabling AI to process lifetime-scale information remains a long-standing pursuit in the field. Due to the constraints of f…
TempoFit: Plug-and-Play Layer-Wise Temporal KV Memory for Long-Horizon Vision-Language-Action Manipulation
Jun Sun, Boyu Yang, Jiahao Zhang +7
Pretrained Vision-Language-Action (VLA) policies have achieved strong single-step manipulation, but their inference remains largely memoryless, which is brittle in non-Markovian lo…
Backdoor4Good: Benchmarking Beneficial Uses of Backdoors in LLMs
Yige Li, Wei Zhao, Zhe Li +6
Backdoor mechanisms have traditionally been studied as security threats that compromise the integrity of machine learning models. However, the same mechanism -- the conditional act…