Showing 2026Show all
2 papers · 1 filter
cs.CL2026
Dustin: Draft-Augmented Sparse Verification for Efficient Long-Context Generation with Speculative Decoding
WenHung Lee, Jian-Jia Chen, Xiaolin Lin +6
While speculative decoding improves inference throughput for multi-batch long-context Large Language Models (LLMs), its efficiency is often limited by a verification bottleneck whe…
cs.LG2026
Jump Like A Squirrel: Optimized Execution Step Order for Anytime Random Forest Inference
Daniel Biebert, Christian Hakert, Kay Heider +3
Due to their efficiency and small size, decision trees and random forests are popular machine learning models used for classification on resource-constrained systems. In such syste…