5 papers · 1 filter
AvoKV-E: Payload-Aware KV Cache Eviction for Long Reasoning
Han Yu, Wenhui Zhu, Xiwen Chen +9
Long-output reasoning shifts the KV-cache bottleneck from the fixed prompt to the generated trace. Existing reasoning-cache eviction methods largely treat cached entries as routing…
Smaller Models, Better Rejects: Preference Distillation Scaling
Rui Cai, Wenhui Zhu, Xiwen Chen +15
Preference distillation typically treats a teacher response as preferred and the student's own response as rejected. This assumes that self-generated failures are the most informat…
ModelLens: Finding the Best for Your Task from Myriads of Models
Rui Cai, Weijie Jacky Mo, Xiaofei Wen +5
The open-source model ecosystem now contains hundreds of thousands of pretrained models, yet picking the best model for a new dataset is increasingly infeasible: new models and unb…
Diagnosing and Mitigating Modality Interference in Multimodal Large Language Models
Rui Cai, Bangzheng Li, Xiaofei Wen +2
Multimodal Large Language Models demonstrate strong performance on multimodal benchmarks, yet often exhibit poor robustness when exposed to spurious modality interference, such as…
Zero-Shot Relational Learning for Multimodal Knowledge Graphs
Rui Cai, Shichao Pei, Xiangliang Zhang
Relational learning is an essential task in the domain of knowledge representation, particularly in knowledge graph completion (KGC). While relational learning in traditional singl…