activity
20212026
most citedFederated Neural Bandits

2 citations · 7 across the 14 of their papers we have counts for

collaborators

15 papers

cs.CV2026

Authority-Preserving Evaluation of Medical Vision-Language Assistants

Flint Xiaofeng Fan, Cheston Tan, Yew-Soon Ong +1

Medical vision-language models can propose how urgently a skin lesion should be reviewed, but the local service retains authority to accept or replace that proposal under referral…

cs.AI2026

FedPref: Federated Preference Learning for Structured Radiology Report Extraction

Flint Xiaofeng Fan, Cheston Tan, Yew-Soon Ong +1

Radiology reports describe findings and locations in free text, but downstream search and analysis require these relations in a fixed schema. Learning this extraction requires labe…

cs.CY2026

Why Do We Suffer for Fun? Ordeal Pleasure in Souls-like Games

Flint Xiaofeng Fan

Souls-like games exemplify how digital play can produce radical forms of pleasure through sustained challenge: players voluntarily invest tens or hundreds of hours in experiences d…

cs.CL2026

ConvApparel: A Benchmark Dataset and Validation Framework for User Simulators in Conversational Recommenders

Ofer Meshi, Krisztian Balog, Sally Goldman +5

The promise of LLM-based user simulators to improve conversational AI is hindered by a critical "realism gap," leading to systems that are optimized for simulated interactions, but…

cs.AI2026

Information Fidelity in Tool-Using LLM Agents: A Martingale Analysis of the Model Context Protocol

Flint Xiaofeng Fan, Cheston Tan, Roger Wattenhofer +1

As AI agents powered by large language models (LLMs) increasingly use external tools for high-stakes decisions, a critical reliability question arises: how do errors propagate acro…

cs.LG2025

FedHPD: Heterogeneous Federated Reinforcement Learning via Policy Distillation

Wenzheng Jiang, Ji Wang, Xiongtao Zhang +3

Federated Reinforcement Learning (FedRL) improves sample efficiency while preserving privacy; however, most existing studies assume homogeneous agents, limiting its applicability i…

cs.LG2024

FedRLHF: A Convergence-Guaranteed Federated Framework for Privacy-Preserving and Personalized RLHF

Flint Xiaofeng Fan, Cheston Tan, Yew-Soon Ong +2

In the era of increasing privacy concerns and demand for personalized experiences, traditional Reinforcement Learning with Human Feedback (RLHF) frameworks face significant challen…

cs.LG2024

Diversifying Policy Behaviors with Extrinsic Behavioral Curiosity

Zhenglin Wan, Xingrui Yu, David Mark Bossens +5

Imitation learning (IL) has shown promise in various applications (e.g. robot locomotion) but is often limited to learning a single expert policy, constraining behavior diversity a…

cs.IR2024

SUBER: An RL Environment with Simulated Human Behavior for Recommender Systems

Nathan Corecco, Giorgio Piatti, Luca A. Lanzendörfer +2

Reinforcement learning (RL) has gained popularity in the realm of recommender systems due to its ability to optimize long-term rewards and guide users in discovering relevant conte…

cs.LG2024

CAESAR: Enhancing Federated RL in Heterogeneous MDPs through Convergence-Aware Sampling with Screening

Hei Yi Mak, Flint Xiaofeng Fan, Luca A. Lanzendörfer +3

In this study, we delve into Federated Reinforcement Learning (FedRL) in the context of value-based agents operating across diverse Markov Decision Processes (MDPs). Existing FedRL…

cs.LG2024★ 1 cited

Decentralized Federated Policy Gradient with Byzantine Fault-Tolerance and Provably Fast Convergence

Philip Jordan, Florian Grötschla, Flint Xiaofeng Fan +1

In Federated Reinforcement Learning (FRL), agents aim to collaboratively learn a common task, while each agent is acting in its local environment without exchanging raw trajectorie…

cs.RO2023★ 2 cited

Action and Trajectory Planning for Urban Autonomous Driving with Hierarchical Reinforcement Learning

Xinyang Lu, Flint Xiaofeng Fan, Tianying Wang

Reinforcement Learning (RL) has made promising progress in planning and decision-making for Autonomous Vehicles (AVs) in simple driving scenarios. However, existing RL algorithms f…

cs.LG2023★ 1 cited

FedHQL: Federated Heterogeneous Q-Learning

Flint Xiaofeng Fan, Yining Ma, Zhongxiang Dai +3

Federated Reinforcement Learning (FedRL) encourages distributed agents to learn collectively from each other's experience to improve their performance without exchanging their raw…

cs.LG2022★ 2 cited

Federated Neural Bandits

Zhongxiang Dai, Yao Shu, Arun Verma +3

Recent works on neural contextual bandits have achieved compelling performances due to their ability to leverage the strong representation power of neural networks (NNs) for reward…

cs.LG2021★ 1 cited

Fault-Tolerant Federated Reinforcement Learning with Theoretical Guarantee

Flint Xiaofeng Fan, Yining Ma, Zhongxiang Dai +3

The growing literature of Federated Learning (FL) has recently inspired Federated Reinforcement Learning (FRL) to encourage multiple agents to federatively build a better decision-…