activity
20242026
most citedQ-value Regularized Transformer for Offline Reinforcement Learning

4 citations · 11 across the 17 of their papers we have counts for

collaborators
Showing 2024Show all

7 papers · 1 filter

cs.LG2024

Task-Aware Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning

Ziqing Fan, Shengchao Hu, Yuhang Zhou +4

The purpose of offline multi-task reinforcement learning (MTRL) is to develop a unified policy applicable to diverse tasks without the need for online environmental interaction. Re…

cs.CV2024

Self-supervised Anomaly Detection Pretraining Enhances Long-tail ECG Diagnosis

Aofan Jiang, Chaoqin Huang, Qing Cao +5

Current computer-aided ECG diagnostic systems struggle with the underdetection of rare but critical cardiac anomalies due to the imbalanced nature of ECG datasets. This study intro…

cs.CV2024★ 1 cited

Few-Shot Anomaly Detection via Category-Agnostic Registration Learning

Chaoqin Huang, Haoyan Guan, Aofan Jiang +4

Most existing anomaly detection (AD) methods require a dedicated model for each category. Such a paradigm, despite its promising results, is computationally expensive and inefficie…

cs.LG2024★ 1 cited

Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware Minimization

Ziqing Fan, Shengchao Hu, Jiangchao Yao +4

In federated learning (FL), the multi-step update and data heterogeneity among clients often lead to a loss landscape with sharper minima, degenerating the performance of the resul…

cs.CV2024★ 2 cited

Domain-Inspired Sharpness-Aware Minimization Under Domain Shifts

Ruipeng Zhang, Ziqing Fan, Jiangchao Yao +2

This paper presents a Domain-Inspired Sharpness-Aware Minimization (DISAM) algorithm for optimization under domain shifts. It is motivated by the inconsistent convergence degree of…

cs.LG2024★ 1 cited

HarmoDT: Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning

Shengchao Hu, Ziqing Fan, Li Shen +3

The purpose of offline multi-task reinforcement learning (MTRL) is to develop a unified policy applicable to diverse tasks without the need for online environmental interaction. Re…

cs.LG2024★ 4 cited

Q-value Regularized Transformer for Offline Reinforcement Learning

Shengchao Hu, Ziqing Fan, Chaoqin Huang +4

Recent advancements in offline reinforcement learning (RL) have underscored the capabilities of Conditional Sequence Modeling (CSM), a paradigm that learns the action distribution…