106 citations · 259 across the 30 of their papers we have counts for
30 papers
Supercharging Federated Learning with Flower and NVIDIA FLARE
Holger R. Roth, Daniel J. Beutel, Yan Cheng +13
Several open-source systems, such as Flower and NVIDIA FLARE, have been developed in recent years while focusing on different aspects of federated learning (FL). Flower is dedicate…
Recurrent Early Exits for Federated Learning with Heterogeneous Clients
Royson Lee, Javier Fernandez-Marques, Shell Xu Hu +6
Federated learning (FL) has enabled distributed learning of a model across multiple clients in a privacy-preserving manner. One of the main challenges of FL is to accommodate clien…
Enhancing Data Quality in Federated Fine-Tuning of Foundation Models
Wanru Zhao, Yaxin Du, Nicholas Donald Lane +2
In the current landscape of foundation model training, there is a significant reliance on public domain data, which is nearing exhaustion according to recent research. To further s…
How Much Is Hidden in the NAS Benchmarks? Few-Shot Adaptation of a NAS Predictor
Hrushikesh Loya, Łukasz Dudziak, Abhinav Mehrotra +4
Neural architecture search has proven to be a powerful approach to designing and refining neural networks, often boosting their performance and efficiency over manually-designed va…
FedL2P: Federated Learning to Personalize
Royson Lee, Minyoung Kim, Da Li +4
Federated learning (FL) research has made progress in developing algorithms for distributed learning of global models, as well as algorithms for local personalization of those comm…
FDAPT: Federated Domain-adaptive Pre-training for Language Models
Lekang Jiang, Filip Svoboda, Nicholas D. Lane
Foundation models (FMs) have shown prominent success in a wide range of tasks. Their applicability to specific domain-task pairings relies on the availability of, both, high-qualit…
Privacy in Multimodal Federated Human Activity Recognition
Alex Iacob, Pedro P. B. Gusmão, Nicholas D. Lane +5
Human Activity Recognition (HAR) training data is often privacy-sensitive or held by non-cooperative entities. Federated Learning (FL) addresses such concerns by training ML models…
Pollen: High-throughput Federated Learning Simulation via Resource-Aware Client Placement
Lorenzo Sani, Pedro Porto Buarque de Gusmão, Alex Iacob +5
Federated Learning (FL) is a privacy-focused machine learning paradigm that collaboratively trains models directly on edge devices. Simulation plays an essential role in FL adoptio…
Efficient Vertical Federated Learning with Secure Aggregation
Xinchi Qiu, Heng Pan, Wanru Zhao +3
The majority of work in privacy-preserving federated learning (FL) has been focusing on horizontally partitioned datasets where clients share the same sets of features and can trai…
PQA: Exploring the Potential of Product Quantization in DNN Hardware Acceleration
Ahmed F. AbouElhamayed, Angela Cui, Javier Fernandez-Marques +2
Conventional multiply-accumulate (MAC) operations have long dominated computation time for deep neural networks (DNNs), espcially convolutional neural networks (CNNs). Recently, pr…
Secure Vertical Federated Learning Under Unreliable Connectivity
Xinchi Qiu, Heng Pan, Wanru Zhao +5
Most work in privacy-preserving federated learning (FL) has focused on horizontally partitioned datasets where clients hold the same features and train complete client-level models…
Gradient-less Federated Gradient Boosting Trees with Learnable Learning Rates
Chenyang Ma, Xinchi Qiu, Daniel J. Beutel +1
The privacy-sensitive nature of decentralized datasets and the robustness of eXtreme Gradient Boosting (XGBoost) on tabular data raise the needs to train XGBoost in the context of…
A Federated Learning Benchmark for Drug-Target Interaction
Gianluca Mittone, Filip Svoboda, Marco Aldinucci +2
Aggregating pharmaceutical data in the drug-target interaction (DTI) domain has the potential to deliver life-saving breakthroughs. It is, however, notoriously difficult due to reg…
Pex: Memory-efficient Microcontroller Deep Learning through Partial Execution
Edgar Liberis, Nicholas D. Lane
Embedded and IoT devices, largely powered by microcontroller units (MCUs), could be made more intelligent by leveraging on-device deep learning. One of the main challenges of neura…
BLOX: Macro Neural Architecture Search Benchmark and Algorithms
Thomas Chun Pong Chau, Łukasz Dudziak, Hongkai Wen +2
Neural architecture search (NAS) has been successfully used to design numerous high-performance neural networks. However, NAS is typically compute-intensive, so most existing appro…
The Future of Consumer Edge-AI Computing
Stefanos Laskaridis, Stylianos I. Venieris, Alexandros Kouris +2
In the last decade, Deep Learning has rapidly infiltrated the consumer end, mainly thanks to hardware acceleration across devices. However, as we look towards the future, it is evi…
Adaptable Butterfly Accelerator for Attention-based NNs via Hardware and Algorithm Co-design
Hongxiang Fan, Thomas Chau, Stylianos I. Venieris +5
Attention-based neural networks have become pervasive in many AI tasks. Despite their excellent algorithmic performance, the use of the attention mechanism and feed-forward network…
Fluid Batching: Exit-Aware Preemptive Serving of Early-Exit Neural Networks on Edge NPUs
Alexandros Kouris, Stylianos I. Venieris, Stefanos Laskaridis +1
With deep neural networks (DNNs) emerging as the backbone in a multitude of computer vision tasks, their adoption in real-world applications broadens continuously. Given the abunda…
Protea: Client Profiling within Federated Systems using Flower
Wanru Zhao, Xinchi Qiu, Javier Fernandez-Marques +2
Federated Learning (FL) has emerged as a prospective solution that facilitates the training of a high-performing centralised model without compromising the privacy of users. While…
ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity
Xinchi Qiu, Javier Fernandez-Marques, Pedro PB Gusmao +3
When the available hardware cannot meet the memory and compute requirements to efficiently train high performing machine learning models, a compromise in either the training qualit…
Secure Aggregation for Federated Learning in Flower
Kwing Hei Li, Pedro Porto Buarque de Gusmão, Daniel J. Beutel +1
Federated Learning (FL) allows parties to learn a shared prediction model by delegating the training computation to clients and aggregating all the separately trained models on the…
Prospect Pruning: Finding Trainable Weights at Initialization using Meta-Gradients
Milad Alizadeh, Shyam A. Tailor, Luisa M Zintgraf +4
Pruning neural networks at initialization would enable us to find sparse models that retain the accuracy of the original network while consuming fewer computational resources for t…
Defensive Tensorization
Adrian Bulat, Jean Kossaifi, Sourav Bhattacharya +5
We propose defensive tensorization, an adversarial defence technique that leverages a latent high-order factorization of the network. The layers of a network are first expressed as…
Differentiable Network Pruning for Microcontrollers
Edgar Liberis, Nicholas D. Lane
Embedded and personal IoT devices are powered by microcontroller units (MCUs), whose extreme resource scarcity is a major obstacle for applications relying on on-device deep learni…