356 citations · 393 across the 5 of their papers we have counts for
4 papers · 1 filter
PaLM-E: An Embodied Multimodal Language Model
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi +19
Large language models excel at a wide range of complex tasks. However, enabling general inference in the real world, e.g., for robotics problems, raises the challenge of grounding.…
Neural Assistant: Joint Action Prediction, Response Generation, and Latent Knowledge Reasoning
Arvind Neelakantan, Semih Yavuz, Sharan Narang +5
Task-oriented dialog presents a difficult challenge encompassing multiple problems including multi-turn language understanding and generation, knowledge retrieval and reasoning, an…
The Importance of Generation Order in Language Modeling
Nicolas Ford, Daniel Duckworth, Mohammad Norouzi +1
Neural language models are a critical component of state-of-the-art systems for machine translation, summarization, audio transcription, and other tasks. These language models are…
Stochastic natural gradient descent draws posterior samples in function space
Samuel L. Smith, Daniel Duckworth, Semon Rezchikov +2
Recent work has argued that stochastic gradient descent can approximate the Bayesian uncertainty in model parameters near local minima. In this work we develop a similar correspond…