11 papers
Data-driven Clustering and Merging of Adapters for On-device Large Language Models
Ondrej Bohdal, Taha Ceritli, Mete Ozay +4
On-device large language models commonly employ task-specific adapters (e.g., LoRAs) to deliver strong performance on downstream tasks. While storing all available adapters is impr…
On-device System of Compositional Multi-tasking in Large Language Models
Ondrej Bohdal, Konstantinos Theodosiadis, Asterios Mpatziakas +10
Large language models (LLMs) are commonly adapted for diverse downstream tasks via parameter-efficient fine-tuning techniques such as Low-Rank Adapters (LoRA). While adapters can b…
HydraOpt: Navigating the Efficiency-Performance Trade-off of Adapter Merging
Taha Ceritli, Ondrej Bohdal, Mete Ozay +4
Large language models (LLMs) often leverage adapters, such as low-rank-based adapters, to achieve strong performance on downstream tasks. However, storing a separate adapter for ea…
Efficient Compositional Multi-tasking for On-device Large Language Models
Ondrej Bohdal, Mete Ozay, Jijoong Moon +3
Adapter parameters provide a mechanism to modify the behavior of machine learning models and have gained significant popularity in the context of large language models (LLMs) and g…
Controllable Forgetting Mechanism for Few-Shot Class-Incremental Learning
Kirill Paramonov, Mete Ozay, Eunju Yang +2
Class-incremental learning in the context of limited personal labeled samples (few-shot) is critical for numerous real-world applications, such as smart home devices. A key challen…
Swiss DINO: Efficient and Versatile Vision Framework for On-device Personal Object Search
Kirill Paramonov, Jia-Xing Zhong, Umberto Michieli +2
In this paper, we address a recent trend in robotic home appliances to include vision systems on personal devices, capable of personalizing the appliances on the fly. In particular…
Enhanced Model Robustness to Input Corruptions by Per-corruption Adaptation of Normalization Statistics
Elena Camuffo, Umberto Michieli, Simone Milani +2
Developing a reliable vision system is a fundamental challenge for robotic technologies (e.g., indoor service robots and outdoor autonomous robots) which can ensure reliable naviga…
Cross-Architecture Auxiliary Feature Space Translation for Efficient Few-Shot Personalized Object Detection
Francesco Barbato, Umberto Michieli, Jijoong Moon +2
Recent years have seen object detection robotic systems deployed in several personal devices (e.g., home robots and appliances). This has highlighted a challenge in their design, i…
Object-conditioned Bag of Instances for Few-Shot Personalized Instance Recognition
Umberto Michieli, Jijoong Moon, Daehyun Kim +1
Nowadays, users demand for increased personalization of vision systems to localize and identify personal instances of objects (e.g., my dog rather than dog) from a few-shot dataset…
FFT-based Selection and Optimization of Statistics for Robust Recognition of Severely Corrupted Images
Elena Camuffo, Umberto Michieli, Jijoong Moon +2
Improving model robustness in case of corrupted images is among the key challenges to enable robust vision systems on smart devices, such as robotic agents. Particularly, robust te…
Deep Neural Network Models Trained With A Fixed Random Classifier Transfer Better Across Domains
Hafiz Tiomoko Ali, Umberto Michieli, Ji Joong Moon +2
The recently discovered Neural collapse (NC) phenomenon states that the last-layer weights of Deep Neural Networks (DNN), converge to the so-called Equiangular Tight Frame (ETF) si…