4 papers
Signed Rescue Routing: Harm-Aware Cascades for Efficient LLM Inference
Zheyuan Wang, Siyu Li, Peiqiao Song +3
Large language model (LLM) cascades answer easy requests with a small model and escalate selected requests to a larger model. Most routers prioritize examples on which the small mo…
CEDAR: Error-Bounded Residual Routing for Efficient Long-Context Attention
Siyu Li, Dong Wang, Jie Zhou +3
Post-hoc sparse attention accelerates long-context prefill by routing each query to a small set of token-level interactions. Hard selection, however, assigns zero probability to ev…
Graph-Augmented Reasoning with Large Language Models for Tobacco Pest and Disease Management
Siyu Li, Chenwei Song, Qi Zhou +2
This paper proposes a graph-augmented reasoning framework for tobacco pest and disease management that integrates structured domain knowledge into large language models. Building o…
Knowledge Reasoning of Large Language Models Integrating Graph-Structured Information for Pest and Disease Control in Tobacco
Siyu Li, Chenwei Song, Wan Zhou +1
This paper proposes a large language model (LLM) approach that integrates graph-structured information for knowledge reasoning in tobacco pest and disease control. Built upon the G…