7 citations · 7 across the 2 of their papers we have counts for
2 papers
cs.CL2021
DEMix Layers: Disentangling Domains for Modular Language Modeling
Suchin Gururangan, Mike Lewis, Ari Holtzman +2
We introduce a new domain expert mixture (DEMix) layer that enables conditioning a language model (LM) on the domain of the input text. A DEMix layer is a collection of expert feed…
cs.LG2021★ 7 cited
Emergent Discrete Communication in Semantic Spaces
Mycal Tucker, Huao Li, Siddharth Agrawal +4
Neural agents trained in reinforcement learning settings can learn to communicate among themselves via discrete tokens, accomplishing as a team what agents would be unable to do al…