290 citations · 889 across the 57 of their papers we have counts for
8 papers · 1 filter
Investigating Uncertainty Calibration of Aligned Language Models under the Multiple-Choice Setting
Guande He, Peng Cui, Jianfei Chen +2
Despite the significant progress made in practical applications of aligned language models (LMs), they tend to be overconfident in output answers compared to the corresponding pre-…
DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics
Kaiwen Zheng, Cheng Lu, Jianfei Chen +1
Diffusion probabilistic models (DPMs) have exhibited excellent performance for high-fidelity image generation while suffering from inefficient sampling. Recent works accelerate the…
Memory Efficient Optimizers with 4-bit States
Bingrui Li, Jianfei Chen, Jun Zhu
Optimizer states are a major source of memory consumption for training neural networks, limiting the maximum trainable model within given memory budget. Compressing the optimizer s…
Training Transformers with 4-bit Integers
Haocheng Xi, Changhao Li, Jianfei Chen +1
Quantizing the activation, weight, and gradient to 4-bit is promising to accelerate neural network training. However, existing 4-bit training methods require custom numerical forma…
Stabilizing GANs' Training with Brownian Motion Controller
Tianjiao Luo, Ziyu Zhu, Jianfei Chen +1
The training process of generative adversarial networks (GANs) is unstable and does not converge globally. In this paper, we examine the stability of GANs from the perspective of c…
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models
Guande He, Jianfei Chen, Jun Zhu
Large pre-trained language models (PLMs) have demonstrated strong performance on natural language understanding (NLU) tasks through fine-tuning. However, fine-tuned models still su…