106 citations · 139 across the 7 of their papers we have counts for
7 papers
BLOX: Macro Neural Architecture Search Benchmark and Algorithms
Thomas Chun Pong Chau, Łukasz Dudziak, Hongkai Wen +2
Neural architecture search (NAS) has been successfully used to design numerous high-performance neural networks. However, NAS is typically compute-intensive, so most existing appro…
Adaptable Butterfly Accelerator for Attention-based NNs via Hardware and Algorithm Co-design
Hongxiang Fan, Thomas Chau, Stylianos I. Venieris +5
Attention-based neural networks have become pervasive in many AI tasks. Despite their excellent algorithmic performance, the use of the attention mechanism and feed-forward network…
Secure Aggregation for Federated Learning in Flower
Kwing Hei Li, Pedro Porto Buarque de Gusmão, Daniel J. Beutel +1
Federated Learning (FL) allows parties to learn a shared prediction model by delegating the training computation to clients and aggregating all the separately trained models on the…
Prospect Pruning: Finding Trainable Weights at Initialization using Meta-Gradients
Milad Alizadeh, Shyam A. Tailor, Luisa M Zintgraf +4
Pruning neural networks at initialization would enable us to find sparse models that retain the accuracy of the original network while consuming fewer computational resources for t…
Defensive Tensorization
Adrian Bulat, Jean Kossaifi, Sourav Bhattacharya +5
We propose defensive tensorization, an adversarial defence technique that leverages a latent high-order factorization of the network. The layers of a network are first expressed as…
Adaptive Inference through Early-Exit Networks: Design, Challenges and Directions
Stefanos Laskaridis, Alexandros Kouris, Nicholas D. Lane
DNNs are becoming less and less over-parametrised due to recent advances in efficient model design, through careful hand-crafted or NAS-based methods. Relying on the fact that not…