activity
20202024
most citedLearning on Graphs with Out-of-Distribution Nodes

30 citations · 88 across the 30 of their papers we have counts for

collaborators

30 papers

cs.CV2024★ 4 cited

Multi-Level Correlation Network For Few-Shot Image Classification

Yunkai Dang, Min Zhang, Zhengyu Chen +4

Few-shot image classification(FSIC) aims to recognize novel classes given few labeled images from base classes. Recent works have achieved promising classification performance, esp…

cs.LG2023

Learning How to Propagate Messages in Graph Neural Networks

Teng Xiao, Zhengyu Chen, Donglin Wang +1

This paper studies the problem of learning message propagation strategies for graph neural networks (GNNs). One of the challenges for graph neural networks is that of defining the…

cs.LG2023★ 3 cited

A General Offline Reinforcement Learning Framework for Interactive Recommendation

Teng Xiao, Donglin Wang

This paper studies the problem of learning interactive recommender systems from logged feedbacks without any exploration in online environments. We address the problem by proposing…

cs.LG2023★ 30 cited

Learning on Graphs with Out-of-Distribution Nodes

Yu Song, Donglin Wang

Graph Neural Networks (GNNs) are state-of-the-art models for performing prediction tasks on graphs. While existing GNNs have shown great performance on various tasks related to gra…

cs.LG2023

STRAPPER: Preference-based Reinforcement Learning via Self-training Augmentation and Peer Regularization

Yachen Kang, Li He, Jinxin Liu +2

Preference-based reinforcement learning (PbRL) promises to learn a complex reward function with binary human preference. However, such human-in-the-loop formulation requires consid…

cs.LG2023★ 2 cited

Beyond OOD State Actions: Supported Cross-Domain Offline Reinforcement Learning

Jinxin Liu, Ziqi Zhang, Zhenyu Wei +4

Offline reinforcement learning (RL) aims to learn a policy using only pre-collected and fixed data. Although avoiding the time-consuming online interactions in RL, it poses challen…

cs.LG2023

Beyond Reward: Offline Preference-guided Policy Optimization

Yachen Kang, Diyuan Shi, Jinxin Liu +2

This study focuses on the topic of offline preference-based reinforcement learning (PbRL), a variant of conventional reinforcement learning that dispenses with the need for online…

cs.LG2023★ 2 cited

CEIL: Generalized Contextual Imitation Learning

Jinxin Liu, Li He, Yachen Kang +3

In this paper, we present \textbf{C}ont\textbf{E}xtual \textbf{I}mitation \textbf{L}earning~(CEIL), a general and broadly applicable algorithm for imitation learning (IL). Inspired…

cs.LG2023

Design from Policies: Conservative Test-Time Adaptation for Offline Policy Optimization

Jinxin Liu, Hongyin Zhang, Zifeng Zhuang +3

In this work, we decouple the iterative bi-level offline RL (value estimation and policy extraction) from the offline training phase, forming a non-iterative bi-level paradigm and…

cs.LG2023

CLUE: Calibrated Latent Guidance for Offline Reinforcement Learning

Jinxin Liu, Lipeng Zu, Li He +1

Offline reinforcement learning (RL) aims to learn an optimal policy from pre-collected and labeled datasets, which eliminates the time-consuming data collection in online RL. Howev…

cs.LG2023★ 3 cited

OER: Offline Experience Replay for Continual Offline Reinforcement Learning

Sibo Gai, Donglin Wang, Li He

The capability of continuously learning new skills via a sequence of pre-collected offline datasets is desired for an agent. However, consecutively learning a sequence of offline t…

cs.CV2023★ 1 cited

RotoGBML: Towards Out-of-Distribution Generalization for Gradient-Based Meta-Learning

Min Zhang, Zifeng Zhuang, Zhitao Wang +2

Gradient-based meta-learning (GBML) algorithms are able to fast adapt to new tasks by transferring the learned meta-knowledge, while assuming that all tasks come from the same dist…

cs.CV2023★ 1 cited

Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learning

Siteng Huang, Biao Gong, Yutong Feng +3

Recent compositional zero-shot learning (CZSL) methods adapt pre-trained vision-language models (VLMs) by constructing trainable prompts only for composed state-object pairs. Relyi…

cs.LG2023★ 8 cited

Behavior Proximal Policy Optimization

Zifeng Zhuang, Kun Lei, Jinxin Liu +2

Offline reinforcement learning (RL) is a challenging setting where existing off-policy actor-critic methods perform poorly due to the overestimation of out-of-distribution state-ac…

cs.CV2023★ 1 cited

Graph based Environment Representation for Vision-and-Language Navigation in Continuous Environments

Ting Wang, Zongkai Wu, Feiyu Yao +1

Vision-and-Language Navigation in Continuous Environments (VLN-CE) is a navigation task that requires an agent to follow a language instruction in a realistic environment. The unde…

cs.CL2022★ 2 cited

Can Offline Reinforcement Learning Help Natural Language Understanding?

Ziqi Zhang, Yile Wang, Yue Zhang +1

Pre-training has been a useful method for learning implicit transferable knowledge and it shows the benefit of offering complementary features across different modalities. Recent w…

cs.CV2022★ 3 cited

VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval

Siteng Huang, Biao Gong, Yulin Pan +4

Many recent studies leverage the pre-trained CLIP for text-video cross-modal retrieval by tuning the backbone with additional heavy modules, which not only brings huge computationa…

cs.AI2022★ 1 cited

KSG: Knowledge and Skill Graph

Feng Zhao, Ziqi Zhang, Donglin Wang

The knowledge graph (KG) is an essential form of knowledge representation that has grown in prominence in recent years. Because it concentrates on nominal entities and their relati…

cs.CV2022

Reference-Limited Compositional Zero-Shot Learning

Siteng Huang, Qiyao Wei, Donglin Wang

Compositional zero-shot learning (CZSL) refers to recognizing unseen compositions of known visual primitives, which is an essential ability for artificial intelligence systems to l…

cs.CV2022★ 5 cited

Tree Structure-Aware Few-Shot Image Classification via Hierarchical Aggregation

Min Zhang, Siteng Huang, Wenbin Li +1

In this paper, we mainly focus on the problem of how to learn additional feature representations for few-shot image classification through pretext tasks (e.g., rotation or color pe…

cs.LG2022★ 8 cited

DARA: Dynamics-Aware Reward Augmentation in Offline Reinforcement Learning

Jinxin Liu, Hongyin Zhang, Donglin Wang

Offline reinforcement learning algorithms promise to be applicable in settings where a fixed dataset is available and no new experience can be acquired. However, such formulation i…

cs.LG2021★ 3 cited

Learning to Evolve on Dynamic Graphs

Xintao Xiang, Tiancheng Huang, Donglin Wang

Representation learning in dynamic graphs is a challenging problem because the topology of graph and node features vary at different time. This requires the model to be able to eff…

cs.LG2021★ 3 cited

Unsupervised Domain Adaptation with Dynamics-Aware Rewards in Reinforcement Learning

Jinxin Liu, Hao Shen, Donglin Wang +2

Unsupervised reinforcement learning aims to acquire skills without prior goal representations, where an agent automatically explores an open-ended environment to represent goals an…

cs.LG2021

Off-Dynamics Inverse Reinforcement Learning from Hetero-Domain

Yachen Kang, Jinxin Liu, Xin Cao +1

We propose an approach for inverse reinforcement learning from hetero-domain which learns a reward function in the simulator, drawing on the demonstrations from the real world. The…