activity
20192023
most citedPanGu-: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

94 citations · 160 across the 18 of their papers we have counts for

collaborators

18 papers

cs.CL2023★ 10 cited

DyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modeling

Yuchen Zhuang, Yue Yu, Lingkai Kong +2

Learning from noisy labels is a challenge that arises in many real-world applications where training data can contain incorrect or corrupted labels. When fine-tuning language model…

cs.LG2023★ 4 cited

Local Boosting for Weakly-Supervised Learning

Rongzhi Zhang, Yue Yu, Jiaming Shen +2

Boosting is a commonly used technique to enhance the performance of a set of base models by combining them into a strong ensemble model. Though widely adopted, boosting is typicall…

physics.chem-ph2023★ 3 cited

MUBen: Benchmarking the Uncertainty of Molecular Representation Models

Yinghao Li, Lingkai Kong, Yuanqi Du +4

Large molecular representation models pre-trained on massive unlabeled data have shown great success in predicting molecular properties. However, these models may tend to overfit t…

cs.CL2023★ 3 cited

CCGen: Explainable Complementary Concept Generation in E-Commerce

Jie Huang, Yifan Gao, Zheng Li +7

We propose and study Complementary Concept Generation (CCGen): given a concept of interest, e.g., "Digital Cameras", generating a list of complementary concepts, e.g., 1) Camera Le…

cs.CL2023★ 2 cited

ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval

Yue Yu, Yuchen Zhuang, Rongzhi Zhang +3

With the development of large language models (LLMs), zero-shot learning has attracted much attention for various NLP tasks. Different from prior works that generate training data…

cs.LG2023

Neighborhood-Regularized Self-Training for Learning with Few Labels

Ran Xu, Yue Yu, Hejie Cui +5

Training deep neural networks (DNNs) with limited supervision has been a popular research topic as it can significantly alleviate the annotation burden. Self-training has been succ…

cs.LG2022★ 7 cited

End-to-End Stochastic Optimization with Energy-Based Model

Lingkai Kong, Jiaming Cui, Yuchen Zhuang +3

Decision-focused learning (DFL) was recently proposed for stochastic optimization problems that involve unknown parameters. By integrating predictive modeling with an implicitly di…

cs.CL2022★ 11 cited

COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning

Yue Yu, Chenyan Xiong, Si Sun +2

We present a new zero-shot dense retrieval (ZeroDR) method, COCO-DR, to improve the generalization ability of dense retrieval by combating the distribution shifts between source tr…

cs.IR2022

CERES: Pretraining of Graph-Conditioned Transformer for Semi-Structured Session Data

Rui Feng, Chen Luo, Qingyu Yin +3

User sessions empower many search and recommendation tasks on a daily basis. Such session data are semi-structured, which encode heterogeneous relations between queries and product…

stat.ML2021

Supervised Multivariate Learning with Simultaneous Feature Auto-grouping and Dimension Reduction

Yiyuan She, Jiahui Shen, Chao Zhang

Modern high-dimensional methods often adopt the "bet on sparsity" principle, while in supervised multivariate learning statisticians may face "dense" problems with a large number o…

cs.CL2021★ 2 cited

AcTune: Uncertainty-aware Active Self-Training for Semi-Supervised Active Learning with Pretrained Language Models

Yue Yu, Lingkai Kong, Jieyu Zhang +2

While pre-trained language model (PLM) fine-tuning has achieved strong performance in many NLP tasks, the fine-tuning stage can be still demanding in labeled data. Recent works hav…

cs.LG2021★ 1 cited

CAMul: Calibrated and Accurate Multi-view Time-Series Forecasting

Harshavardhan Kamarthi, Lingkai Kong, Alexander Rodríguez +2

Probabilistic time-series forecasting enables reliable decision making across many domains. Most forecasting problems have diverse sources of data containing multiple modalities an…

cs.CL2021★ 2 cited

Self-Training with Differentiable Teacher

Simiao Zuo, Yue Yu, Chen Liang +5

Self-training achieves enormous success in various semi-supervised and weakly-supervised learning tasks. The method can be interpreted as a teacher-student framework, where the tea…

cs.CL2021★ 1 cited

BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition

Yinghao Li, Pranav Shetty, Lucas Liu +2

We study the problem of learning a named entity recognition (NER) tagger using noisy labels from multiple weak supervision sources. Though cheap to obtain, the labels from weak sup…

cs.CL2021★ 94 cited

PanGu-: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Wei Zeng, Xiaozhe Ren, Teng Su +35

Large-scale Pretrained Language Models (PLMs) have become the new paradigm for Natural Language Processing (NLP). PLMs with hundreds of billions parameters such as GPT-3 have demon…

cs.CL2020★ 10 cited

Transformer-Based Neural Text Generation with Syntactic Guidance

Yinghao Li, Rui Feng, Isaac Rehg +1

We study the problem of using (partial) constituency parse trees as syntactic guidance for controlled text generation. Existing approaches to this problem use recurrent structures,…

cs.CV2020★ 6 cited

Exploring the Hierarchy in Relation Labels for Scene Graph Generation

Yi Zhou, Shuyang Sun, Chao Zhang +2

By assigning each relationship a single label, current approaches formulate the relationship detection as a classification problem. Under this formulation, predicate categories are…

cs.LG2019★ 4 cited

A gradual, semi-discrete approach to generative network training via explicit Wasserstein minimization

Yucheng Chen, Matus Telgarsky, Chao Zhang +3

This paper provides a simple procedure to fit generative networks to target distributions, with the goal of a small Wasserstein distance (or other optimal transport costs). The app…