73 citations · 203 across the 7 of their papers we have counts for
8 papers
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
Jamba Team, Barak Lenz, Alan Arazi +58
We present Jamba-1.5, new instruction-tuned large language models based on our Jamba architecture. Jamba is a hybrid Transformer-Mamba mixture of experts architecture, providing hi…
Exemplar Guided Active Learning
Jason Hartford, Kevin Leyton-Brown, Hadas Raviv +3
We consider the problem of wisely using a limited budget to label a small subset of a large unlabeled dataset. We are motivated by the NLP problem of word sense disambiguation. For…
Technical Report: Auxiliary Tuning and its Application to Conditional Text Generation
Yoel Zeldes, Dan Padnos, Or Sharir +1
We introduce a simple and efficient method, called Auxiliary Tuning, for adapting a pre-trained Language Model to a novel task; we demonstrate this approach on the task of conditio…
SenseBERT: Driving Some Sense into BERT
Yoav Levine, Barak Lenz, Or Dagan +6
The ability to learn from large unlabeled corpora has allowed neural language models to advance the frontier in natural language understanding. However, existing self-supervision t…
Instability of Supersonic Cold Streams Feeding Galaxies III: Kelvin-Helmholtz Instability in Three Dimensions
Nir Mandelker, Daisuke Nagai, Han Aung +3
We study the effects of Kelvin-Helmholtz instability (KHI) on the cold streams that feed high-redshift galaxies through their hot haloes, generalizing our earlier analyses of a 2D…
Instability of Supersonic Cold Streams Feeding Galaxies II. Nonlinear Evolution of Surface and Body Modes of Kelvin-Helmholtz Instability
Dan Padnos, Nir Mandelker, Yuval Birnboim +3
As part of our long-term campaign to understand how cold streams feed massive galaxies at high redshift, we study the Kelvin-Helmholtz instability (KHI) of a supersonic, cold, dens…