5 papers
PatchKV: Efficient KV Cache Recovery for Dynamically Edited LLM Contexts
Guotao Yang, Rui Guo, Siwei He +3
Long-running LLM agent workflows often revise interior context spans while retaining long suffixes. Although suffix tokens remain unchanged, altered causal histories and rotary pos…
AsymSpec: Efficient Cloud-Edge Speculative Decoding over Asymmetric Networks
Guotao Yang, Hao Chen, Rui Guo +5
Cloud-edge speculative decoding places a lightweight draft model at an edge gateway and a higher-quality target model in the cloud, but inserts communication into every speculative…
Towards Transparent AI: A Survey on Explainable Language Models
Avash Palikhe, Zichong Wang, Zhipeng Yin +4
Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical con…
Diffusion-grounded VideoLLM for Entity-aware temoporal grounding
Pengcheng Fang, Yuxia Chen, Yong Wang +3
Precise temporal grounding requires distinguishing when a queried event occurs from when its participating entities are merely visible. We propose Diffusion-Grounded VideoLLM, whic…
QUB-Cirdan at "Discharge Me!": Zero shot discharge letter generation by open-source LLM
Rui Guo, Greg Farnan, Niall McLaughlin +1
The BioNLP ACL'24 Shared Task on Streamlining Discharge Documentation aims to reduce the administrative burden on clinicians by automating the creation of critical sections of pati…