activity
20192026
most citedHow Does Learning Rate Decay Help Modern Neural Networks?

162 citations · 445 across the 12 of their papers we have counts for

collaborators
Showing cs.LGShow all

7 papers · 1 filter

cs.LG2026★ 75 cited

Towards Accurate Model Selection in Deep Unsupervised Domain Adaptation

Kaichao You, Ximei Wang, Mingsheng Long +1

Deep unsupervised domain adaptation (Deep UDA) methods successfully leverage rich labeled data in a source domain to boost the performance on related but unlabeled data in a target…

cs.LG2024

depyf: Open the Opaque Box of PyTorch Compiler for Machine Learning Researchers

Kaichao You, Runsheng Bai, Meng Cao +3

PyTorch \texttt{2.x} introduces a compiler designed to accelerate deep learning programs. However, for machine learning researchers, adapting to the PyTorch compiler to full potent…

cs.LG2022

From Big to Small: Adaptive Learning to Partial-Set Domains

Zhangjie Cao, Kaichao You, Ziyang Zhang +2

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirem…

cs.LG2021★ 11 cited

Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs

Kaichao You, Yong Liu, Ziyang Zhang +3

Model hubs with many pre-trained models (PTMs) have become a cornerstone of deep learning. Although built at a high cost, they remain \emph{under-exploited} -- practitioners usuall…

cs.LG2021★ 116 cited

Tianshou: a Highly Modularized Deep Reinforcement Learning Library

Jiayi Weng, Huayu Chen, Dong Yan +6

In this paper, we present Tianshou, a highly modularized Python library for deep reinforcement learning (DRL) that uses PyTorch as its backend. Tianshou intends to be research-frie…

cs.LG2021★ 40 cited

LogME: Practical Assessment of Pre-trained Models for Transfer Learning

Kaichao You, Yong Liu, Jianmin Wang +1

This paper studies task adaptive pre-trained model selection, an underexplored problem of assessing pre-trained models for the target task and select best ones from the model zoo \…

cs.LG2019★ 162 cited

How Does Learning Rate Decay Help Modern Neural Networks?

Kaichao You, Mingsheng Long, Jianmin Wang +1

Learning rate decay (lrDecay) is a \emph{de facto} technique for training modern neural networks. It starts with a large learning rate and then decays it multiple times. It is empi…