373 citations · 548 across the 15 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
Merging Text Transformer Models from Different Initializations
Neha Verma, Maha Elbayad
Recent work on permutation-based model merging has shown impressive low- or zero-barrier mode connectivity between models from completely different initializations. However, this l…
cs.CL2024★ 2 cited
Spirit LM: Interleaved Spoken and Written Language Model
Tu Anh Nguyen, Benjamin Muller, Bokai Yu +13
We introduce Spirit LM, a foundation multimodal language model that freely mixes text and speech. Our model is based on a 7B pretrained text language model that we extend to the sp…