7 papers
When Is a Task Vector Enough? An Empirical Theory of Implicit Multimodal ICL
Jiaqian Li
Implicit multimodal in-context learning compresses demonstrations into internal interventions, ranging from static task vectors to query-conditioned transformations and attention r…
AudioKV: KV Cache Eviction in Efficient Large Audio Language Models
Yuxuan Wang, Peize He, Xiyan Gui +6
Large Audio-Language Models (LALMs) have set new benchmarks in speech processing, yet their deployment is hindered by the memory footprint of the Key-Value (KV) cache during long-c…
StarSD: One-for-Many Speculative Decoding
Junhao He, Feiran You, Hongyang Du
Speculative decoding accelerates autoregressive generation by separating token proposal from verification, but most existing approaches are designed for single-node execution and d…
K-DeCore: Facilitating Knowledge Transfer in Continual Structured Knowledge Reasoning via Knowledge Decoupling
Yongrui Chen, Yi Huang, Yunchang Liu +5
Continual Structured Knowledge Reasoning (CSKR) focuses on training models to handle sequential tasks, where each task involves translating natural language questions into structur…
Pandora: A Code-Driven Large Language Model Agent for Unified Reasoning Across Diverse Structured Knowledge
Yongrui Chen, Junhao He, Linbo Fu +10
Unified Structured Knowledge Reasoning (USKR) aims to answer natural language questions (NLQs) by using structured sources such as tables, databases, and knowledge graphs in a unif…
Pandora: Leveraging Code-driven Knowledge Transfer for Unified Structured Knowledge Reasoning
Yongrui Chen, Junhao He, Linbo Fu +10
Unified Structured Knowledge Reasoning (USKR) aims to answer natural language questions by using structured sources such as tables, databases, and knowledge graphs in a unified way…