34 citations · 43 across the 8 of their papers we have counts for
6 papers · 1 filter
Accelerated Training on Low-Power Edge Devices
Mohamed Aboelenien Ahmed, Kilian Pfeiffer, Heba Khdr +3
Training on edge devices poses several challenges as these devices are generally resource-constrained, especially in terms of power. State-of-the-art techniques at the device level…
Efficient Zeroth-Order Federated Finetuning of Language Models on Resource-Constrained Devices
Mohamed Aboelenien Ahmed, Kilian Pfeiffer, Ramin Khalili +2
Federated Learning (FL) is a promising paradigm for finetuning Large Language Models (LLMs) across distributed data sources while preserving data privacy. However, finetuning such…
Efficient Federated Finetuning of Tiny Transformers with Resource-Constrained Devices
Kilian Pfeiffer, Mohamed Aboelenien Ahmed, Ramin Khalili +1
In recent years, Large Language Models (LLMs) through Transformer structures have dominated many machine learning tasks, especially text processing. However, these models require m…
TransAxx: Efficient Transformers with Approximate Computing
Dimitrios Danopoulos, Georgios Zervakis, Dimitrios Soudris +1
Vision Transformer (ViT) models which were recently introduced by the transformer architecture have shown to be very competitive and often become a popular alternative to Convoluti…
Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantization
Konstantinos Balaskas, Andreas Karatzas, Christos Sad +4
Deep Neural Networks (DNNs) have shown significant advantages in a wide variety of domains. However, DNNs are becoming computationally intensive and energy hungry at an exponential…
Distributed Learning on Heterogeneous Resource-Constrained Devices
Martin Rapp, Ramin Khalili, Jörg Henkel
We consider a distributed system, consisting of a heterogeneous set of devices, ranging from low-end to high-end. These devices have different profiles, e.g., different energy budg…