4 papers
InhibiDistilbert: Knowledge Distillation for a ReLU and Addition-based Transformer
Tony Zhang, Rickard Brännvall
This work explores optimizing transformer-based language models by integrating model compression techniques with inhibitor attention, a novel alternative attention mechanism. Inhib…
Conditioning on Local Statistics for Scalable Heterogeneous Federated Learning
Rickard Brännvall
Federated learning is a distributed machine learning approach where multiple clients collaboratively train a model without sharing their local data, which contributes to preserving…
A sandbox study proposal for private and distributed health data analysis
Rickard Brännvall, Hanna Svensson, Kannaki Kaliyaperumal +2
This paper presents a sandbox study proposal focused on the distributed processing of personal health data within the Vinnova-funded SARDIN project. The project aims to develop the…
Technical Report for the Forgotten-by-Design Project: Targeted Obfuscation for Machine Learning
Rickard Brännvall, Laurynas Adomaitis, Olof Görnerup +1
The right to privacy, enshrined in various human rights declarations, faces new challenges in the age of artificial intelligence (AI). This paper explores the concept of the Right…