88 citations · 229 across the 15 of their papers we have counts for
4 papers · 1 filter
Towards Better Few-Shot and Finetuning Performance with Forgetful Causal Language Models
Hao Liu, Xinyang Geng, Lisa Lee +4
Large language models (LLM) trained using the next-token-prediction objective, such as GPT3 and PaLM, have revolutionized natural language processing in recent years by showing imp…
Instruction-Following Agents with Multimodal Transformer
Hao Liu, Lisa Lee, Kimin Lee +1
Humans are excellent at understanding language and vision to accomplish a wide range of tasks. In contrast, creating general instruction-following embodied agents remains a difficu…
Spectral Decomposition Representation for Reinforcement Learning
Tongzheng Ren, Tianjun Zhang, Lisa Lee +3
Representation learning often plays a critical role in reinforcement learning by managing the curse of dimensionality. A representative class of algorithms exploits a spectral deco…
Multimodal Masked Autoencoders Learn Transferable Representations
Xinyang Geng, Hao Liu, Lisa Lee +3
Building scalable models to learn from diverse, multimodal data remains an open challenge. For vision-language data, the dominant approaches are based on contrastive learning objec…