4 papers
Improving LLM Reasoning via Dependency-Aware Query Decomposition and Logic-Parallel Content Expansion
Xianjun Gao, Jianchun Liu, Hongli Xu +1
The integration of Large Language Models (LLMs) into real-time Web applications, such as AI-powered search and conversational agents, presents a fundamental Web infrastructure chal…
SABlock: Semantic-Aware KV Cache Eviction with Adaptive Compression Block Size
Jinhan Chen, Jianchun Liu, Hongli Xu +2
The growing memory footprint of the Key-Value (KV) cache poses a severe scalability bottleneck for long-context Large Language Model (LLM) inference. While KV cache eviction has em…
Efficient Federated Fine-Tuning of Large Language Models with Layer Dropout
Shilong Wang, Jianchun Liu, Hongli Xu +2
Fine-tuning plays a crucial role in enabling pre-trained LLMs to evolve from general language comprehension to task-specific expertise. To preserve user data privacy, federated fin…
Enhancing Federated Graph Learning via Adaptive Fusion of Structural and Node Characteristics
Xianjun Gao, Jianchun Liu, Hongli Xu +2
Federated Graph Learning (FGL) has demonstrated the advantage of training a global Graph Neural Network (GNN) model across distributed clients using their local graph data. Unlike…