2 papers
cs.LG2024
Deeploy: Enabling Energy-Efficient Deployment of Small Language Models On Heterogeneous Microcontrollers
Moritz Scherer, Luka Macan, Victor Jung +5
With the rise of Embodied Foundation Models (EFMs), most notably Small Language Models (SLMs), adapting Transformers for edge applications has become a very active field of researc…
cs.LG2024
Optimizing the Deployment of Tiny Transformers on Low-Power MCUs
Victor J. B. Jung, Alessio Burrello, Moritz Scherer +2
Transformer networks are rapidly becoming SotA in many fields, such as NLP and CV. Similarly to CNN, there is a strong push for deploying Transformer models at the extreme edge, ul…