adaptive pruning 1agentic systems 1batch processing 1evidence state management 1inference acceleration 1large language models 1multimodal reasoning 1omni-modal question answering 1speculative decoding 1training-free planning 1
From the 2 of 5 linked papers with an AI index.
1 citations · 1 across the 4 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding
Hong Liu, Rui Cen, Junhan Shi +10
Speculative decoding accelerates large language model inference without changing the target distribution, but no single drafting structure performs best across real-world workloads…
cs.CL2026
D-cut: Adaptive Verification Depth Pruning for Batched Speculative Decoding
Tianyu Liu, Yuhao Shen, Rui Cen +7
The paper introduces D-Cut, an adaptive method that prunes draft tokens across a batch to focus verification on the most promising tokens, improving the speed of speculative decodi…