Virtual Width Networks

Seed, Baisheng Li, Banggu Wu +115

We introduce Virtual Width Networks (VWN), a framework that delivers the benefits of wider representations without incurring the quadratic cost of increasing the hidden size. VWN d…