activity
20162023
most citedKnowledge Enhanced Pretrained Language Models: A Compreshensive Survey

25 citations · 61 across the 11 of their papers we have counts for

collaborators

11 papers

cs.LG2023★ 1 cited

Greener yet Powerful: Taming Large Code Generation Models with Quantization

Xiaokai Wei, Sujan Gonugondla, Wasi Ahmad +13

ML-powered code generation aims to assist developers to write code in a more productive manner, by intelligently generating code blocks based on natural language prompts. Recently,…

cs.IR2022

Debiasing Neural Retrieval via In-batch Balancing Regularization

Yuantong Li, Xiaokai Wei, Zijian Wang +4

People frequently interact with information retrieval (IR) systems, however, IR models exhibit biases and discrimination towards various demographics. The in-processing fair rankin…

cs.CL2022★ 1 cited

Entailment Tree Explanations via Iterative Retrieval-Generation Reasoner

Danilo Ribeiro, Shen Wang, Xiaofei Ma +8

Large language models have achieved high performance on various question answering (QA) benchmarks, but the explainability of their output remains elusive. Structured explanations,…

cs.CL2021★ 25 cited

Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey

Xiaokai Wei, Shen Wang, Dejiao Zhang +2

Pretrained Language Models (PLM) have established a new paradigm through learning informative contextualized representations on large-scale text corpus. This new paradigm has revol…

cs.CL2021★ 1 cited

Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora

Xisen Jin, Dejiao Zhang, Henghui Zhu +5

Pretrained language models (PTLMs) are typically learned over a large, static corpus and further fine-tuned for various downstream tasks. However, when deployed in the real world,…

cs.LG2021★ 8 cited

Supporting Clustering with Contrastive Learning

Dejiao Zhang, Feng Nan, Xiaokai Wei +6

Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often ove…