568 citations · 6.2k across the 157 of their papers we have counts for
51 papers · 1 filter
Fast Second-Order Online Kernel Learning through Incremental Matrix Sketching and Decomposition
Dongxie Wen, Xiao Zhang, Zhewei Wei +3
Online Kernel Learning (OKL) has attracted considerable research interest due to its promising predictive performance in streaming environments. Second-order approaches are particu…
Specify Robust Causal Representation from Mixed Observations
Mengyue Yang, Xinyu Cai, Furui Liu +2
Learning representations purely from observations concerns the problem of learning a low-dimensional, compact representation which is beneficial to prediction models. Under the hyp…
Large Sequence Models for Sequential Decision-Making: A Survey
Muning Wen, Runji Lin, Hanjing Wang +6
Transformer architectures have facilitated the development of large-scale and general-purpose sequence models for prediction tasks in natural language processing and computer visio…
Refined Edge Usage of Graph Neural Networks for Edge Prediction
Jiarui Jin, Yangkun Wang, Weinan Zhang +5
Graph Neural Networks (GNNs), originally proposed for node classification, have also motivated many recent works on edge prediction (a.k.a., link prediction). However, existing met…
Branch Ranking for Efficient Mixed-Integer Programming via Offline Ranking-based Policy Learning
Zeren Huang, Wenhao Chen, Weinan Zhang +7
Deriving a good variable selection strategy in branch-and-bound is essential for the efficiency of modern mixed-integer programming (MIP) solvers. With MIP branching data collected…
Learning Enhanced Representations for Tabular Data via Neighborhood Propagation
Kounianhua Du, Weinan Zhang, Ruiwen Zhou +6
Prediction over tabular data is an essential and fundamental problem in many important downstream tasks. However, existing methods either take a data instance of the table independ…
Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfer
Bin Lu, Xiaoying Gan, Weinan Zhang +3
Spatio-temporal graph learning is a key method for urban computing tasks, such as traffic flow, taxi demand and air quality forecasting. Due to the high cost of data collection, so…
Plan Your Target and Learn Your Skills: Transferable State-Only Imitation Learning via Decoupled Policy Optimization
Minghuan Liu, Zhengbang Zhu, Yuzheng Zhuang +4
Recent progress in state-only imitation learning extends the scope of applicability of imitation learning to real-world settings by relieving the need for observing expert actions.…
Multi-View Graph Representation for Programming Language Processing: An Investigation into Algorithm Detection
Ting Long, Yutong Xie, Xianyu Chen +3
Program representation, which aims at converting program source code into vectors with automatically extracted features, is a fundamental problem in programming language processing…
Generative Adversarial Exploration for Reinforcement Learning
Weijun Hong, Menghui Zhu, Minghuan Liu +4
Exploration is crucial for training the optimal reinforcement learning (RL) policy, where the key is to discriminate whether a state visiting is novel. Most previous work focuses o…
DropNAS: Grouped Operation Dropout for Differentiable Architecture Search
Weijun Hong, Guilin Li, Weinan Zhang +4
Neural architecture search (NAS) has shown encouraging results in automating the architecture design. Recently, DARTS relaxes the search process with a differentiable formulation t…
Offline Pre-trained Multi-Agent Decision Transformer: One Big Sequence Model Tackles All SMAC Tasks
Linghui Meng, Muning Wen, Yaodong Yang +7
Offline reinforcement learning leverages previously-collected offline datasets to learn optimal policies with no necessity to access the real environment. Such a paradigm is also d…
Towards Return Parity in Markov Decision Processes
Jianfeng Chi, Jian Shen, Xinyi Dai +3
Algorithmic decisions made by machine learning models in high-stakes domains may have lasting impacts over time. However, naive applications of standard fairness criterion in stati…
On Effective Scheduling of Model-based Reinforcement Learning
Hang Lai, Jian Shen, Weinan Zhang +5
Model-based reinforcement learning has attracted wide attention due to its superior sample efficiency. Despite its impressive success so far, it is still unclear how to appropriate…
Curriculum Offline Imitation Learning
Minghuan Liu, Hanye Zhao, Zhengyu Yang +4
Offline reinforcement learning (RL) tasks require the agent to learn from a pre-collected dataset with no further interactions with the environment. Despite the potential to surpas…
Why Propagate Alone? Parallel Use of Labels and Features on Graphs
Yangkun Wang, Jiarui Jin, Weinan Zhang +7
Graph neural networks (GNNs) and label propagation represent two interrelated modeling strategies designed to exploit graph structure in tasks such as node property prediction. The…
Task-wise Split Gradient Boosting Trees for Multi-center Diabetes Prediction
Mingcheng Chen, Zhenghui Wang, Zhiyun Zhao +14
Diabetes prediction is an important data science application in the social healthcare domain. There exist two main challenges in the diabetes prediction task: data heterogeneity si…
Model-based Multi-agent Policy Optimization with Adaptive Opponent-wise Rollouts
Weinan Zhang, Xihuai Wang, Jian Shen +1
This paper investigates the model-based methods in multi-agent reinforcement learning (MARL). We specify the dynamics sample complexity and the opponent sample complexity in MARL,…
Bag of Tricks for Node Classification with Graph Neural Networks
Yangkun Wang, Jiarui Jin, Weinan Zhang +3
Over the past few years, graph neural networks (GNN) and label propagation-based methods have made significant progress in addressing node classification tasks on graphs. However,…
Fork or Fail: Cycle-Consistent Training with Many-to-One Mappings
Qipeng Guo, Zhijing Jin, Ziyu Wang +5
Cycle-consistent training is widely used for jointly learning a forward and inverse mapping between two domains of interest without the cumbersome requirement of collecting matched…
Towards Generalized Implementation of Wasserstein Distance in GANs
Minkai Xu, Zhiming Zhou, Guansong Lu +3
Wasserstein GANs (WGANs), built upon the Kantorovich-Rubinstein (KR) duality of Wasserstein distance, is one of the most theoretically sound GAN models. However, in practice it doe…
Model-based Policy Optimization with Unsupervised Model Adaptation
Jian Shen, Han Zhao, Weinan Zhang +1
Model-based reinforcement learning methods learn a dynamics model with real data sampled from the environment and leverage it to generate simulated data to derive an agent. However…
GeneraLight: Improving Environment Generalization of Traffic Signal Control via Meta Reinforcement Learning
Chang Liu, Huichu Zhang, Weinan Zhang +2
The heavy traffic congestion problem has always been a concern for modern cities. To alleviate traffic congestion, researchers use reinforcement learning (RL) to develop better tra…
Bidirectional Model-based Policy Optimization
Hang Lai, Jian Shen, Weinan Zhang +1
Model-based reinforcement learning approaches leverage a forward dynamics model to support planning and decision making, which, however, may fail catastrophically if the model is i…