6 citations · 6 across the 8 of their papers we have counts for
4 papers · 1 filter
A Thread-Register Decoupled GPU Execution Model for Efficient Tensor Computation
Zihan Liu, Jingwen Leng, Yangjie Zhou +12
Modern GPUs increasingly integrate Tensor Cores into the execution pipeline. Although aggregate tensor throughput continues to grow, aided by an operand supply that has evolved fro…
TOM: A Ternary Read-only Memory Accelerator for LLM-powered Edge Intelligence
Hongyi Guan, Yijia Zhang, Wenqiang Wang +4
The deployment of Large Language Models (LLMs) for real-time intelligence on edge devices is rapidly growing. However, conventional hardware architectures face a fundamental memory…
M2XFP: A Metadata-Augmented Microscaling Data Format for Efficient Low-bit Quantization
Weiming Hu, Zihan Zhang, Haoyan Zhang +8
Existing low-bit Microscaling (MX) formats, such as MXFP4, often suffer from substantial accuracy degradation due to the use of a shared scaling factor with the Power-of-Two format…
Sandwich Reasoning: An Answer-Reasoning-Answer Approach for Low-Latency Query Correction
Chen Zhang, Kepu Zhang, Jiatong Zhang +2
Query correction is a critical entry point in modern search pipelines, demanding high accuracy strictly within real-time latency constraints. Chain-of-Thought (CoT) reasoning impro…