Super Apriel: One Checkpoint, Many Speeds

SLAM Labs, :, Oleksiy Ostapenko +13

We release Super Apriel, a 15B-parameter supernet in which every decoder layer provides four trained mixer choices -- Full Attention (FA), Sliding Window Attention (SWA), Kimi Delt…