6 papers
MOSS-Video-Preview: Toward Real-Time Video Understanding via Cross-Attention
Pengyu Wang, Chenkun Tan, Shaojun Zhou +18
Video understanding is shifting from the offline paradigm -- taking a fully recorded video as input and producing a single answer after it ends -- toward real-time interaction, in…
QiMeng-Kernel: Macro-Thinking Micro-Coding Paradigm for LLM-Based High-Performance GPU Kernel Generation
Xinguo Zhu, Shaohui Peng, Jiaming Guo +10
Developing high-performance GPU kernels is critical for AI and scientific computing, but remains challenging due to its reliance on expert crafting and poor portability. While LLMs…
Incorporating Local Hölder Regularity into PINNs for Solving Elliptic PDEs
Qirui Zhou, Jiebao Sun, Yi Ran +1
In this paper, local Hölder regularization is incorporated into a physics-informed neural networks (PINNs) framework for solving elliptic partial differential equations (PDEs). Mo…
Coupling local and nonlocal total variation flow for image despeckling
Yi Ran, Zhichang Guo, Kehan Shi +4
Nonlocal equations effectively preserve textures but exhibit weak regularization effects in image denoising, whereas local equations offer strong denoising capabilities yet fail to…
QiMeng-Attention: SOTA Attention Operator is generated by SOTA Attention Algorithm
Qirui Zhou, Shaohui Peng, Weiqiang Xiong +11
The attention operator remains a critical performance bottleneck in large language models (LLMs), particularly for long-context scenarios. While FlashAttention is the most widely u…
QiMeng-TensorOp: Automatically Generating High-Performance Tensor Operators with Hardware Primitives
Xuzhi Zhang, Shaohui Peng, Qirui Zhou +12
Computation-intensive tensor operators constitute over 90\% of the computations in Large Language Models (LLMs) and Deep Neural Networks.Automatically and efficiently generating hi…