13 citations · 15 across the 9 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.AR2026
Unified Lookup-Table Inference with Signed-Digit K/V Caches for Ternary LLMs
Ziang Duan, Jiajun Wu, Zetian Chen +8
Ternary LLMs make their weight-dominated projections compact and efficient, but attention remains a mismatch: its K/V cache is created online and is typically processed by a separa…
cs.AI2026
Anon: Extrapolating Adaptivity Beyond SGD and Adam
Yiheng Zhang, Kaiyan Zhao, Shaowu Wu +5
Adaptive optimizers such as Adam and non-adaptive methods like SGD exhibit distinct generalization capabilities across different architectures. Prior tunable optimizers attempt to…
cs.LG2026
Shiva-DiT: Residual-Based Differentiable Top- Selection for Efficient Diffusion Transformers
Jiaji Zhang, Hailiang Zhao, Jiaju Wu +3
Diffusion Transformers (DiTs) are costly at high resolution because self-attention scales quadratically with token sequence length. Existing pruning methods do not jointly provide…