1 paper
David Hoffmann, Kailash Budhathoki, Matthaeus Kleindessner
The evolving capabilities of large language models are accompanied by growing sizes and deployment costs, necessitating effective inference optimisation techniques. We propose a no…