works on
gpu acceleration 1hardware-software co-design 1n:m sparsity 1sparse inference 1vision transformers 1

From the 1 of 8 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2026

UnionSparse: An Index-Efficient Sparsity Framework for Low-Bit Sparse LLM Inference on Edge

Tianhao Jiang, Hang Gu, Teng Wang +9

Edge LLM inference combines sparsity and low-bit quantization to meet device memory, latency, and power limits. Yet quantization shrinks weight payloads without proportionally redu…