activity
20182025
most citedStochastic Weight Averaging in Parallel: Large-Batch Training that Generalizes Well

15 citations · 20 across the 3 of their papers we have counts for

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2025

SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling

Krishna C. Puvvada, Faisal Ladhak, Santiago Akle Serrano +8

We present a decoder-only Transformer architecture that robustly generalizes to sequence lengths substantially longer than those seen during training. Our model, SWAN-GPT, interlea…