activity
20172022
most citedScaling Language Models: Methods, Analysis & Insights from Training Gopher

243 citations · 402 across the 5 of their papers we have counts for

collaborators

9 papers

cs.CL2022243 cited

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

Jack W. Rae, Sebastian Borgeaud, Trevor Cai +77

Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.…

cs.CL2021

Challenges in Detoxifying Language Models

Johannes Welbl, Amelia Glaese, Jonathan Uesato +7

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of saf…

cs.LG202014 cited

Enabling certification of verification-agnostic networks via memory-efficient semidefinite programming

Sumanth Dathathri, Krishnamurthy Dvijotham, Alexey Kurakin +8

Convex relaxations have emerged as a promising approach for verifying desirable properties of neural networks like robustness to adversarial perturbations. Widely used Linear Progr…

cs.CL2020

Plug-and-Play Conversational Models

Andrea Madotto, Etsuko Ishii, Zhaojiang Lin +2

There has been considerable progress made towards conversational models that generate coherent and fluent responses; however, this often involves training large language models on…

cs.LG2020

Robust Constrained Reinforcement Learning for Continuous Control with Model Misspecification

Daniel J. Mankowitz, Dan A. Calian, Rae Jeong +5

Many real-world physical control systems are required to satisfy constraints upon deployment. Furthermore, real-world systems are often subject to effects such as non-stationarity,…

eess.SY20204 cited

Counter-example Guided Learning of Bounds on Environment Behavior

Yuxiao Chen, Sumanth Dathathri, Tung Phan-Minh +1

There is a growing interest in building autonomous systems that interact with complex environments. The difficulty associated with obtaining an accurate model for such environments…