Training language models to follow instructions with human feedback

Long Ouyang, Jeff Wu, Xu Jiang +17

Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic,…