419 citations · 3.1k across the 71 of their papers we have counts for
3 papers · 1 filter
Artificial Expert Intelligence through PAC-reasoning
Shai Shalev-Shwartz, Amnon Shashua, Gal Beniamini +6
Artificial Expert Intelligence (AEI) seeks to transcend the limitations of both Artificial General Intelligence (AGI) and narrow AI by integrating domain-specific expertise with cr…
Untangling Lariats: Subgradient Following of Variationally Penalized Objectives
Kai-Chia Mo, Shai Shalev-Shwartz, Nisæl Shártov
We describe an apparatus for subgradient-following of the optimum of convex problems with variational penalties. In this setting, we receive a sequence and seek a…
Jamba: A Hybrid Transformer-Mamba Language Model
Opher Lieber, Barak Lenz, Hofit Bata +19
We present Jamba, a new base large language model based on a novel hybrid Transformer-Mamba mixture-of-experts (MoE) architecture. Specifically, Jamba interleaves blocks of Transfo…