2 papers
cs.AI2026
TrigReason: Trigger-Based Collaboration between Small and Large Reasoning Models
Yi Zhao, Yajuan Peng, Cam-Tu Nguyen +4
Large Reasoning Models (LRMs) achieve strong performance on complex tasks through extended chains of thought but suffer from high inference latency due to autoregressive reasoning.…
cs.LG2026
SmallKV: Small Model Assisted Compensation of KV Cache Compression for Efficient LLM Inference
Yi Zhao, Yajuan Peng, Cam-Tu Nguyen +4
KV cache eviction has emerged as an effective solution to alleviate resource constraints faced by LLMs in long-context scenarios. However, existing token-level eviction methods oft…