Publications (23)
Balancing Continual Learning and Fine-tuning for Human Activity Recognition
Chi Ian Tang, Lorena Qendro, Dimitris Spathis +3
Wearable-based Human Activity Recognition (HAR) is a key task in human-centric machine learning due to its fundamental understanding of human behaviours. Due to the dynamic nature…
FRuDA: Framework for Distributed Adversarial Domain Adaptation
Shaoduo Gan, Akhil Mathur, Anton Isopoussu +3
Breakthroughs in unsupervised domain adaptation (uDA) can help in adapting models from a label-rich source domain to unlabeled target domains. Despite these advancements, there is…
Flower: A Friendly Federated Learning Research Framework
Daniel J. Beutel, Taner Topal, Akhil Mathur +8
Federated Learning (FL) has emerged as a promising technique for edge devices to collaboratively learn a shared prediction model, while keeping their training data on the device, t…
On-device Federated Learning with Flower
Akhil Mathur, Daniel J. Beutel, Pedro Porto Buarque de Gusmão +6
Federated Learning (FL) allows edge devices to collaboratively learn a shared prediction model while keeping their training data on the device, thereby decoupling the ability to do…
Low-Power Audio Keyword Spotting using Tsetlin Machines
Jie Lei, Tousif Rahman, Rishad Shafik +5
The emergence of Artificial Intelligence (AI) driven Keyword Spotting (KWS) technologies has revolutionized human to machine interaction. Yet, the challenge of end-to-end energy ef…
Scaling Small Agents Through Strategy Auctions
Lisa Alazraki, William F. Shen, Yoram Bachrach +1
Small language models are increasingly viewed as a promising, cost-effective approach to agentic AI, with proponents claiming they are sufficiently capable for agentic workflows. H…
SensiX: A Platform for Collaborative Machine Learning on the Edge
Chulhong Min, Akhil Mathur, Alessandro Montanari +2
The emergence of multiple sensory devices on or near a human body is uncovering new dynamics of extreme edge computing. In this, a powerful and resource-rich edge device such as a…
A first look into the carbon footprint of federated learning
Xinchi Qiu, Titouan Parcollet, Javier Fernandez-Marques +6
Despite impressive results, deep learning-based technologies also raise severe privacy and environmental concerns induced by the training procedure often conducted in data centers.…
Rethinking Rubric Generation for Improving LLM Judge and Reward Modeling for Open-ended Tasks
William F. Shen, Xinchi Qiu, Chenxi Whitehouse +6
Recently, rubrics have been used to guide LLM judges in capturing subjective, nuanced, multi-dimensional human preferences, and have been extended from evaluation to reward signals…
FLAME: Federated Learning Across Multi-device Environments
Hyunsung Cho, Akhil Mathur, Fahim Kawsar
Federated Learning (FL) enables distributed training of machine learning models while keeping personal data on user devices private. While we witness increasing applications of FL…
Can Federated Learning Save The Planet?
Xinchi Qiu, Titouan Parcollet, Daniel J. Beutel +3
Despite impressive results, deep learning-based technologies also raise severe privacy and environmental concerns induced by the training procedure often conducted in data centers.…
Tiny, always-on and fragile: Bias propagation through design choices in on-device machine learning workflows
Wiebke Toussaint, Aaron Yi Ding, Fahim Kawsar +1
Billions of distributed, heterogeneous and resource constrained IoT devices deploy on-device machine learning (ML) for private, fast and offline inference on personal data. On-devi…
Libri-Adapt: A New Speech Dataset for Unsupervised Domain Adaptation
Akhil Mathur, Fahim Kawsar, Nadia Berthouze +1
This paper introduces a new dataset, Libri-Adapt, to support unsupervised domain adaptation research on speech recognition models. Built on top of the LibriSpeech corpus, Libri-Ada…
Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering
Ekdeep Singh Lubana, Chi Ian Tang, Fahim Kawsar +2
Federated learning is generally used in tasks where labels are readily available (e.g., next word prediction). Relaxing this constraint requires design of unsupervised learning tec…
ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Yash Jain, Chi Ian Tang, Chulhong Min +2
A major bottleneck in training robust Human-Activity Recognition models (HAR) is the need for large-scale labeled sensor datasets. Because labeling large amounts of sensor data is…
SensiX++: Bringing MLOPs and Multi-tenant Model Serving to Sensory Edge Devices
Chulhong Min, Akhil Mathur, Utku Gunay Acer +2
We present SensiX++ - a multi-tenant runtime for adaptive model execution with integrated MLOps on edge devices, e.g., a camera, a microphone, or IoT sensors. SensiX++ operates on…
Enhancing Efficiency in Multidevice Federated Learning through Data Selection
Fan Mo, Mohammad Malekzadeh, Soumyajit Chatterjee +2
Ubiquitous wearable and mobile devices provide access to a diverse set of data. However, the mobility demand for our devices naturally imposes constraints on their computational an…
The Llama 3 Herd of Models
Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri +556
Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models th…
Mic2Mic: Using Cycle-Consistent Generative Adversarial Networks to Overcome Microphone Variability in Speech Systems
Akhil Mathur, Anton Isopoussu, Fahim Kawsar +2
Mobile and embedded devices are increasingly using microphones and audio-based computational models to infer user context. A major challenge in building systems that combine audio…
Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuning
Chi Ian Tang, Lorena Qendro, Dimitris Spathis +3
Self-supervised learning (SSL) has shown remarkable performance in computer vision tasks when trained offline. However, in a Continual Learning (CL) scenario where new data is intr…
Leveraging Activity Recognition to Enable Protective Behavior Detection in Continuous Data
Chongyang Wang, Yuan Gao, Akhil Mathur +3
Protective behavior exhibited by people with chronic pain (CP) during physical activities is the key to understanding their physical and emotional states. Existing automatic protec…
CroSSL: Cross-modal Self-Supervised Learning for Time-series through Latent Masking
Shohreh Deldari, Dimitris Spathis, Mohammad Malekzadeh +3
Limited availability of labeled data for machine learning on multimodal time-series extensively hampers progress in the field. Self-supervised learning (SSL) is a promising approac…
Chronic-Pain Protective Behavior Detection with Deep Learning
Chongyang Wang, Temitayo A. Olugbade, Akhil Mathur +3
In chronic pain rehabilitation, physiotherapists adapt physical activity to patients' performance based on their expression of protective behavior, gradually exposing them to feare…