Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Deadline-Aware Adaptive Prefill Chunking for Efficient Large Language Model Serving
Siyu Song, Qi Bai, Jinbo Hao +3
Continuous batching improves large language model (LLM) serving throughput, but long prompt prefills can delay decode iterations and violate inter-token latency objectives. Chunked…
cs.CL2026
Beyond Direct Answering: Aligning Educational LLMs as Socratic Guides via Heuristic Reinforcement Learning
Xiaokun Wang, Siyu Song, Wentao Liu +1
Large language models (LLMs) deployed in educational settings often behave as direct answerers: they disclose target concepts in the opening turn instead of guiding students throug…