6 papers
daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimization
Dayuan Fu, Mohan Jiang, Tongyu Wang +5
GPU kernel optimization represents a paradigm where functional correctness is assumed and execution efficiency is the objective. We present daVinci-kernel, a reinforcement learning…
MARS: Scaling Multi-Agent Tree Search via Reinforcement Learning for Code Generation
Pengfei Li, Shijie Wang, Fangyuan Li +7
Reinforcement learning (RL) paradigms have demonstrated strong performance on reasoning-intensive tasks such as code generation. However, limited trajectory diversity often leads t…
WIST: Web-Grounded Iterative Self-Play Tree for Domain-Targeted Reasoning Improvement
Fangyuan Li, Pengfei Li, Shijie Wang +4
Recent progress in reinforcement learning with verifiable rewards (RLVR) offers a practical path to self-improvement of language models, but existing methods face a key trade-off:…
MARTI-MARS: Scaling Multi-Agent Self-Search via Reinforcement Learning for Code Generation
Shijie Wang, Pengfei Li, Yikun Fu +21
While the complex reasoning capability of Large Language Models (LLMs) has attracted significant attention, single-agent systems often encounter inherent performance ceilings in co…
Bohdi: Heterogeneous LLM Fusion with Automatic Data Exploration
Junqi Gao, Zhichang Guo, Dazhi Zhang +5
Heterogeneous Large Language Model (LLM) fusion integrates the strengths of multiple source LLMs with different architectures into a target LLM with low computational overhead. Whi…
Fast and Slow Gradient Approximation for Binary Neural Network Optimization
Xinquan Chen, Junqi Gao, Biqing Qi +4
Binary Neural Networks (BNNs) have garnered significant attention due to their immense potential for deployment on edge devices. However, the non-differentiability of the quantizat…