Mixed-effects transformers for hierarchical adaptation

Julia White, Noah Goodman, Robert Hawkins

Language use differs dramatically from context to context. To some degree, modern language models like GPT-3 are able to account for such variance by conditioning on a string of pr…