Composer: A Search Framework for Hybrid Neural Architecture Design

Bilge Acun, Prasoon Sinha, Newsha Ardalani +7

Hybrid model architectures that combine computational primitives (e.g., Attention, MLP) in different ratios have shown promising performance beyond Transformers. Some studies have…