85 citations · 85 across the 4 of their papers we have counts for
4 papers
LMFusion: Adapting Pretrained Language Models for Multimodal Generation
Weijia Shi, Xiaochuang Han, Chunting Zhou +4
We present LMFusion, a framework for empowering pretrained text-only large language models (LLMs) with multimodal generative capabilities, enabling them to understand and generate…
Reimagining Retrieval Augmented Language Models for Answering Queries
Wang-Chiew Tan, Yuliang Li, Pedro Rodriguez +4
We present a reality check on large language models and inspect the promise of retrieval augmented language models in comparison. Such language models are semi-parametric, where mo…
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru +15
Recent work has shown that fine-tuning large pre-trained language models on a collection of tasks described via instructions, a.k.a. instruction-tuning, improves their zero and few…
Pretty Princess vs. Successful Leader: Gender Roles in Greeting Card Messages
Jiao Sun, Tongshuang Wu, Yue Jiang +3
People write personalized greeting cards on various occasions. While prior work has studied gender roles in greeting card messages, systematic analysis at scale and tools for raisi…