4 papers
AsymSpec: Efficient Cloud-Edge Speculative Decoding over Asymmetric Networks
Guotao Yang, Hao Chen, Rui Guo +5
Cloud-edge speculative decoding places a lightweight draft model at an edge gateway and a higher-quality target model in the cloud, but inserts communication into every speculative…
Towards Transparent AI: A Survey on Explainable Language Models
Avash Palikhe, Zichong Wang, Zhipeng Yin +4
Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical con…
When and What: Diffusion-Grounded VideoLLM with Entity Aware Segmentation for Long Video Understanding
Pengcheng Fang, Yuxia Chen, Rui Guo
Understanding videos requires more than answering open ended questions, it demands the ability to pinpoint when events occur and how entities interact across time. While recent Vid…
QUB-Cirdan at "Discharge Me!": Zero shot discharge letter generation by open-source LLM
Rui Guo, Greg Farnan, Niall McLaughlin +1
The BioNLP ACL'24 Shared Task on Streamlining Discharge Documentation aims to reduce the administrative burden on clinicians by automating the creation of critical sections of pati…