From the 1 of 8 linked papers with an AI index.
8 papers
DeltaLog: Deferred Materialization of Recurrent States for Linear Attention Decoding
Junqing Lin, Jingwei Sun, Guangzhong Sun
Linear attention models eliminate the quadratic prefix computation and context-growing KV cache of softmax attention by replacing pairwise token interactions with recurrent state u…
FlashQuant: Sparse-Dense Fusion for Memory-Efficient Outlier-Aware LLM Inference
Junqing Lin, Jingwei Sun, Zhengding Hu +1
Low-bit quantization reduces the memory footprint and computational cost of large language model (LLM) inference. However, high-magnitude outlier weights can induce substantial qua…
EMO: Energy Efficiency Modeling and Optimization for AI Workloads
Jiyu Luo, Shaoyu Chen, Jingwei Sun +3
EMO is a lightweight framework that models and optimizes the energy consumption of GPU-accelerated AI workloads by detecting fine‑grained slack in asynchronous execution and applyi…
GCL-Sampler: Discovering Kernel Similarity for Sampled GPU Simulation via Graph Contrastive Learning
Jiaqi Wang, Jingwei Sun, Jiyu Luo +2
GPU architectural simulation is orders of magnitude slower than native execution, necessitating workload sampling for practical speedups. Existing methods rely on hand-crafted feat…
RSH-SpMM: A Row-Structured Hybrid Kernel for Sparse Matrix-Matrix Multiplication on GPUs
Aiying Li, Jingwei Sun, Han Li +2
Sparse Matrix-Matrix Multiplication (SpMM) is a fundamental computation in graph analytics, scientific simulation, and sparse deep learning workloads. However, the extreme irregula…
Token Pruning for In-Context Generation in Diffusion Transformers
Junqing Lin, Xingyu Zheng, Pei Cheng +3
In-context generation significantly enhances Diffusion Transformers (DiTs) by enabling controllable image-to-image generation through reference examples. However, the resulting inp…