Jinbo Wang

activity

20232026

most citedExploring the Integration of Large Language Models into Automatic Speech Recognition Systems: An Empirical Study

15 citations · 20 across the 11 of their papers we have counts for

collaborators

Showing 2025Show all

2 papers · 1 filter

cs.LG2025

GradPower: Powering Gradients for Faster Language Model Pre-Training

Jinbo Wang, Mingze Wang, Jiaqi Zhang +5

We propose GradPower, a lightweight gradient-transformation technique for accelerating language model pre-training. Given a gradient vector $g = (g_{i})_{i}$ , GradPower first applies the…

cs.LG2025

The Sharpness Disparity Principle in Transformers for Accelerating Language Model Pre-Training

Jinbo Wang, Mingze Wang, Zhanpeng Zhou +3

Transformers consist of diverse building blocks, such as embedding layers, normalization layers, self-attention mechanisms, and point-wise feedforward networks. Thus, understanding…