23 citations · 44 across the 5 of their papers we have counts for
5 papers
Camera Adaptation for Fundus-Image-Based CVD Risk Estimation
Zhihong Lin, Danli Shi, Donghao Zhang +3
Recent studies have validated the association between cardiovascular disease (CVD) risk and retinal fundus images. Combining deep learning (DL) and portable fundus cameras will ena…
UCB Momentum Q-learning: Correcting the bias without forgetting
Pierre Menard, Omar Darwiche Domingues, Xuedong Shang +1
We propose UCBMQ, Upper Confidence Bound Momentum Q-learning, a new algorithm for reinforcement learning in tabular and possibly stage-dependent, episodic Markov decision process.…
Stochastic Bandits with Vector Losses: Minimizing -Norm of Relative Losses
Xuedong Shang, Han Shao, Jian Qian
Multi-armed bandits are widely applied in scenarios like recommender systems, for which the goal is to maximize the click rate. However, more factors should be considered, e.g., us…
Gamification of Pure Exploration for Linear Bandits
Rémy Degenne, Pierre Ménard, Xuedong Shang +1
We investigate an active pure-exploration setting, that includes best-arm identification, in the context of linear stochastic bandits. While asymptotically optimal algorithms exist…
Fixed-Confidence Guarantees for Bayesian Best-Arm Identification
Xuedong Shang, Rianne de Heide, Emilie Kaufmann +2
We investigate and provide new insights on the sampling rule called Top-Two Thompson Sampling (TTTS). In particular, we justify its use for fixed-confidence best-arm identification…