476 citations · 484 across the 5 of their papers we have counts for
4 papers
RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models
Xin Guo, Jianlei Yang, Haoyi Zhou +2
Pre-trained language models achieve outstanding performance in NLP tasks. Various knowledge distillation methods have been proposed to reduce the heavy computation and storage requ…
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Haoyi Zhou, Shanghang Zhang, Jieqi Peng +4
Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a h…
Differentially-private Federated Neural Architecture Search
Ishika Singh, Haoyi Zhou, Kunlin Yang +3
Neural architecture search, which aims to automatically search for architectures (e.g., convolution, max pooling) of neural networks that maximize validation performance, has achie…
Stacked Kernel Network
Shuai Zhang, Jianxin Li, Pengtao Xie +4
Kernel methods are powerful tools to capture nonlinear patterns behind data. They implicitly learn high (even infinite) dimensional nonlinear features in the Reproducing Kernel Hil…