106 citations · 253 across the 22 of their papers we have counts for
5 papers · 1 filter
What Matters for Model Merging at Scale?
Prateek Yadav, Tu Vu, Jonathan Lai +4
Model merging aims to combine multiple expert models into a more capable single model, offering benefits such as reduced storage and serving costs, improved generalization, and sup…
Learning Associative Inference Using Fast Weight Memory
Imanol Schlag, Tsendsuren Munkhdalai, Jürgen Schmidhuber
Humans can quickly associate stimuli to solve problems in novel contexts. Our novel neural network model learns state representations of facts that can be composed to perform such…
Rapid Adaptation with Conditionally Shifted Neurons
Tsendsuren Munkhdalai, Xingdi Yuan, Soroush Mehri +1
We describe a mechanism by which artificial neural networks can learn rapid adaptation - the ability to adapt on the fly, with little data, to new tasks - that we call conditionall…
Meta Networks
Tsendsuren Munkhdalai, Hong Yu
Neural networks have been successfully applied in applications with a large amount of labeled data. However, the task of rapid generalization on new concepts with small training da…
Neural Semantic Encoders
Tsendsuren Munkhdalai, Hong Yu
We present a memory augmented neural network for natural language understanding: Neural Semantic Encoders. NSE is equipped with a novel memory update rule and has a variable sized…