2 citations · 3 across the 9 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.AI2026
Distilling LLM Reasoning into Graph of Concept Predictors
Ziyang Yu, Liang Zhao
Deploying Large Language Models (LLMs) for discriminative workloads is often limited by inference latency, compute, and API costs at scale. Active distillation reduces these costs…
cs.CL2026
HySparse: A Hybrid Sparse Attention Architecture with Oracle Token Selection and KV Cache Sharing
Yizhao Gao, Jianyu Wei, Qihao Zhang +11
This work introduces Hybrid Sparse Attention (HySparse), a new architecture that interleaves each full attention layer with several sparse attention layers. While conceptually simp…