36 citations · 88 across the 26 of their papers we have counts for
26 papers
QiMeng-CodeV-SVA: Training Specialized LLMs for Hardware Assertion Generation via RTL-Grounded Bidirectional Data Synthesis
Yutong Wu, Chenrui Cao, Pengwei Jin +6
SystemVerilog Assertions (SVAs) are crucial for hardware verification. Recent studies leverage general-purpose LLMs to translate natural language properties to SVAs (NL2SVA), but t…
Efficient Diffusion Planning with Temporal Diffusion
Jiaming Guo, Rui Zhang, Zerun Li +7
Diffusion planning is a promising method for learning high-performance policies from offline data. To avoid the impact of discrepancies between planning and reality on performance,…
Code Driven Planning with Domain-Adaptive Critic
Zikang Tian, Shaohui Peng, Du Huang +11
Large Language Models (LLMs) have been widely adopted as task planners for AI agents in sequential decision-making problems, leveraging their extensive world knowledge. However, th…
QiMeng-CodeV-R1: Reasoning-Enhanced Verilog Generation
Yaoyu Zhu, Di Huang, Hanqi Lyu +16
Large language models (LLMs) trained via reinforcement learning with verifiable reward (RLVR) have achieved breakthroughs on tasks with explicit, automatable verification, such as…
World-Consistent Data Generation for Vision-and-Language Navigation
Yu Zhong, Rui Zhang, Zihao Zhang +9
Vision-and-Language Navigation (VLN) is a challenging task that requires an agent to navigate through photorealistic environments following natural-language instructions. One main…
Ex3: Automatic Novel Writing by Extracting, Excelsior and Expanding
Lei Huang, Jiaming Guo, Guanhua He +5
Generating long-term texts such as novels using artificial intelligence has always been a challenge. A common approach is to use large language models (LLMs) to construct a hierarc…
CodeV: Empowering LLMs with HDL Generation through Multi-Level Summarization
Yang Zhao, Di Huang, Chongxiao Li +14
The design flow of processors, particularly in hardware description languages (HDL) like Verilog and Chisel, is complex and costly. While recent advances in large language models (…
InverseCoder: Self-improving Instruction-Tuned Code LLMs with Inverse-Instruct
Yutong Wu, Di Huang, Wenxuan Shi +13
Recent advancements in open-source code large language models (LLMs) have been driven by fine-tuning on the data generated from powerful closed-source LLMs, which are expensive to…
Luban: Building Open-Ended Creative Agents via Autonomous Embodied Verification
Yuxuan Guo, Shaohui Peng, Jiaming Guo +15
Building open agents has always been the ultimate goal in AI research, and creative agents are the more enticing. Existing LLM agents excel at long-horizon tasks with well-defined…
Non-autoregressive Machine Translation with Probabilistic Context-free Grammar
Shangtong Gui, Chenze Shao, Zhengrui Ma +3
Non-autoregressive Transformer(NAT) significantly accelerates the inference of neural machine translation. However, conventional NAT models suffer from limited expression power and…
Emergent Communication for Rules Reasoning
Yuxuan Guo, Yifan Hao, Rui Zhang +14
Research on emergent communication between deep-learning-based agents has received extensive attention due to its inspiration for linguistics and artificial intelligence. However,…
Efficient Symbolic Policy Learning with Differentiable Symbolic Expression
Jiaming Guo, Rui Zhang, Shaohui Peng +8
Deep reinforcement learning (DRL) has led to a wide range of advances in sequential decision-making tasks. However, the complexity of neural network policies makes it difficult to…
Contrastive Modules with Temporal Attention for Multi-Task Reinforcement Learning
Siming Lan, Rui Zhang, Qi Yi +10
In the field of multi-task reinforcement learning, the modular principle, which involves specializing functionalities into different modules and combining them appropriately, has b…
Pushing the Limits of Machine Design: Automated CPU Design with AI
Shuyao Cheng, Pengwei Jin, Qi Guo +16
Design activity -- constructing an artifact description satisfying given goals and constraints -- distinguishes humanity from other animals and traditional machines, and endowing m…
Online Prototype Alignment for Few-shot Policy Transfer
Qi Yi, Rui Zhang, Shaohui Peng +10
Domain adaptation in reinforcement learning (RL) mainly deals with the changes of observation when transferring the policy to a new environment. Many traditional approaches of doma…
Ultra-low Precision Multiplication-free Training for Deep Neural Networks
Chang Liu, Rui Zhang, Xishan Zhang +5
The training for deep neural networks (DNNs) demands immense energy consumption, which restricts the development of deep learning as well as increases carbon emissions. Thus, the s…
Object-Category Aware Reinforcement Learning
Qi Yi, Rui Zhang, Shaohui Peng +6
Object-oriented reinforcement learning (OORL) is a promising way to improve the sample efficiency and generalization ability over standard RL. Recent works that try to solve OORL t…
Causality-driven Hierarchical Structure Discovery for Reinforcement Learning
Shaohui Peng, Xing Hu, Rui Zhang +9
Hierarchical reinforcement learning (HRL) effectively improves agents' exploration efficiency on tasks with sparse reward, with the guide of high-quality hierarchical structures (e…
Real-Time Robust Video Object Detection System Against Physical-World Adversarial Attacks
Husheng Han, Xing Hu, Kaidi Xu +7
DNN-based video object detection (VOD) powers autonomous driving and video surveillance industries with rising importance and promising opportunities. However, adversarial patch at…
Neural Program Synthesis with Query
Di Huang, Rui Zhang, Xing Hu +6
Aiming to find a program satisfying the user intent given input-output examples, program synthesis has attracted increasing interest in the area of machine learning. Despite the pr…
Distilling Object Detectors with Feature Richness
Zhixing Du, Rui Zhang, Ming Chang +4
In recent years, large-scale deep models have achieved great success, but the huge computational complexity and massive storage requirements make it a great challenge to deploy the…
Eden: A Unified Environment Framework for Booming Reinforcement Learning Algorithms
Ruizhi Chen, Xiaoyu Wu, Yansong Pan +12
With AlphaGo defeats top human players, reinforcement learning(RL) algorithms have gradually become the code-base of building stronger artificial intelligence(AI). The RL algorithm…
Hindsight Value Function for Variance Reduction in Stochastic Dynamic Environment
Jiaming Guo, Rui Zhang, Xishan Zhang +6
Policy gradient methods are appealing in deep reinforcement learning but suffer from high variance of gradient estimate. To reduce the variance, the state value function is applied…
Domain-Specific Suppression for Adaptive Object Detection
Yu Wang, Rui Zhang, Shuo Zhang +4
Domain adaptation methods face performance degradation in object detection, as the complexity of tasks require more about the transferability of the model. We propose a new perspec…