5 papers
Signed Rescue Routing: Harm-Aware Cascades for Efficient LLM Inference
Zheyuan Wang, Siyu Li, Peiqiao Song +3
Large language model (LLM) cascades answer easy requests with a small model and escalate selected requests to a larger model. Most routers prioritize examples on which the small mo…
CEDAR: Error-Bounded Residual Routing for Efficient Long-Context Attention
Siyu Li, Dong Wang, Jie Zhou +3
Post-hoc sparse attention accelerates long-context prefill by routing each query to a small set of token-level interactions. Hard selection, however, assigns zero probability to ev…
Graph-Augmented Reasoning with Large Language Models for Tobacco Pest and Disease Management
Siyu Li, Chenwei Song, Qi Zhou +2
This paper proposes a graph-augmented reasoning framework for tobacco pest and disease management that integrates structured domain knowledge into large language models. Building o…
Knowledge Reasoning of Large Language Models Integrating Graph-Structured Information for Pest and Disease Control in Tobacco
Siyu Li, Chenwei Song, Wan Zhou +1
This paper proposes a large language model (LLM) approach that integrates graph-structured information for knowledge reasoning in tobacco pest and disease control. Built upon the G…
Text Classification Based on Knowledge Graphs and Improved Attention Mechanism
Siyu Li, Lu Chen, Chenwei Song +1
To resolve the semantic ambiguity in texts, we propose a model, which innovatively combines a knowledge graph with an improved attention mechanism. An existing knowledge base is ut…