The Hyperscale Lottery: How State-Space Models Have Sacrificed Edge Efficiency

Robin Geens, Jonas De Schouwer, Marian Verhelst +1

The Hardware Lottery posits that research directions are dictated by available silicon compute platforms. We identify a derivative phenomenon, the Hyperscale Lottery, where model a…