94 citations · 103 across the 11 of their papers we have counts for
4 papers · 1 filter
KernelZero: Co-Evolving Proposer and Coder for Continuously Improved GPU Kernel Generation
Changxin Ke, Rui Zhang, Zixiang Fang +8
High-performance GPU kernels are essential to modern machine learning systems, yet automatically generating kernels that are both correct and efficient remains challenging. Existin…
QiMeng-CRUX: Narrowing the Gap Between Natural Language and Verilog via Core Refined Understanding eXpression for Circuit Design
Lei Huang, Rui Zhang, Jiaming Guo +9
Large language models (LLMs) have shown promising capabilities in hardware description language (HDL) generation. However, existing approaches often rely on free-form natural langu…
QiMeng-Attention: SOTA Attention Operator is generated by SOTA Attention Algorithm
Qirui Zhou, Shaohui Peng, Weiqiang Xiong +11
The attention operator remains a critical performance bottleneck in large language models (LLMs), particularly for long-context scenarios. While FlashAttention is the most widely u…
QiMeng-TensorOp: Automatically Generating High-Performance Tensor Operators with Hardware Primitives
Xuzhi Zhang, Shaohui Peng, Qirui Zhou +12
Computation-intensive tensor operators constitute over 90\% of the computations in Large Language Models (LLMs) and Deep Neural Networks.Automatically and efficiently generating hi…