activity
20192023
most citedPanGu-: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

94 citations · 143 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CL202310 cited

DyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modeling

Yuchen Zhuang, Yue Yu, Lingkai Kong +2

Learning from noisy labels is a challenge that arises in many real-world applications where training data can contain incorrect or corrupted labels. When fine-tuning language model…

cs.LG20227 cited

End-to-End Stochastic Optimization with Energy-Based Model

Lingkai Kong, Jiaming Cui, Yuchen Zhuang +3

Decision-focused learning (DFL) was recently proposed for stochastic optimization problems that involve unknown parameters. By integrating predictive modeling with an implicitly di…

cs.CL202211 cited

COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning

Yue Yu, Chenyan Xiong, Si Sun +2

We present a new zero-shot dense retrieval (ZeroDR) method, COCO-DR, to improve the generalization ability of dense retrieval by combating the distribution shifts between source tr…

cs.IR2022

CERES: Pretraining of Graph-Conditioned Transformer for Semi-Structured Session Data

Rui Feng, Chen Luo, Qingyu Yin +3

User sessions empower many search and recommendation tasks on a daily basis. Such session data are semi-structured, which encode heterogeneous relations between queries and product…

cs.CL20211 cited

BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition

Yinghao Li, Pranav Shetty, Lucas Liu +2

We study the problem of learning a named entity recognition (NER) tagger using noisy labels from multiple weak supervision sources. Though cheap to obtain, the labels from weak sup…

cs.CL202194 cited

PanGu-: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Wei Zeng, Xiaozhe Ren, Teng Su +35

Large-scale Pretrained Language Models (PLMs) have become the new paradigm for Natural Language Processing (NLP). PLMs with hundreds of billions parameters such as GPT-3 have demon…