From the 1 of 16 linked papers with an AI index.
16 papers
FutureBridge: Token Selection Beyond Local Preference in Collaborative Decoding
Quanquan Li, Hongbo Zhang, Yihe Chi +9
Token-level collaboration allows a large language model (LLM) to assist a small language model (SLM) when their predictions diverge. Existing methods either use LLM-generated inter…
Hidden APIs in Language Models: Discovering Reusable Causal Interfaces from Forked Futures
SiYuan Ma, Yiqin Luo, Zhangji +8
The paper introduces a technique called forked futures that samples future operations after a prefix state to compare hidden states of language models, enabling the discovery of re…
Text as Partial Constraint: Core-Residual Alignment for Robust Vision-Language Learning
Chengzhen Yu, Canran Xiao, Siyuan Ma +1
Vision-language alignment powers open-vocabulary recognition, retrieval, and LVLM grounding, yet natural captions are often underspecified, making similarity brittle and overly con…
Attention-Spectrum Regularization for Replay-Free Continual Multimodal LLMs
Chuangxin Zhao, Canran Xiao, Siyuan Ma +5
Multimodal large language models (MLLMs) are increasingly required to adapt to non-stationary streams of visual domains, question types, and user instructions, yet continual fine-t…
Agent-Assisted Side-Channel Attacks on Non-Prefix KV Cache in RAG
He Sun, Shinan Liu, Siyuan Ma +3
Modern Large Language Model (LLM) serving engines increasingly rely on Retrieval-Augmented Generation (RAG) and non-prefix Key-Value (KV) cache fusion to accelerate long-context, m…
A comparative study on power delivery aspects of compute-in/near-memory approaches using DRAM
Siddhartha Raman Sundara Raman, Siyuan Ma, Lizy Kurian John
Compute-in-memory (PIM) mitigates the memory wall by performing computation within memory, reducing data movement and improving energy efficiency. DRAM-based PIM is particularly at…