4 papers
CoLLM: Continuous Adaptation for SLO-Aware LLM Serving on Shared GPU Clusters
Shaoyuan Huang, Yunfeng Zhao, Na Yan +5
As Large Language Models (LLMs) are increasingly adopted in edge intelligence to power domain-specific applications and personalized services, the quality and efficiency of the LLM…
Context-Guided Dynamic Retrieval for Improving Generation Quality in RAG Models
Jacky He, Guiran Liu, Binrong Zhu +3
This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance…
Pre-trained Language Models and Few-shot Learning for Medical Entity Extraction
Xiaokai Wang, Guiran Liu, Binrong Zhu +3
This study proposes a medical entity extraction method based on Transformer to enhance the information extraction capability of medical literature. Considering the professionalism…
A LongFormer-Based Framework for Accurate and Efficient Medical Text Summarization
Dan Sun, Jacky He, Hanlu Zhang +3
This paper proposes a medical text summarization method based on LongFormer, aimed at addressing the challenges faced by existing models when processing long medical texts. Traditi…