works on
evolutionary algorithms 1large language models 1model compression 1post-training fine-tuning 1structured pruning 1

From the 1 of 6 linked papers with an AI index.

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2026

Variable-Width Transformers

Zhaofeng Wu, Oliver Sieberling, Shawn Tan +3

Scaling model size, specifically depth and width, has driven significant progress in transformer-based language models. However, most architectures maintain a constant width across…