25 citations · 32 across the 25 of their papers we have counts for
9 papers · 1 filter
MemLoRA: Distilling Expert Adapters for On-Device Memory Systems
Massimo Bini, Ondrej Bohdal, Umberto Michieli +3
Memory-augmented Large Language Models (LLMs) have demonstrated remarkable consistency during prolonged dialogues by storing relevant memories and incorporating them as context. Su…
Continual Error Correction on Low-Resource Devices
Kirill Paramonov, Mete Ozay, Aristeidis Mystakidis +11
The proliferation of AI models in everyday devices has highlighted a critical challenge: prediction errors that degrade user experience. While existing solutions focus on error det…
CG-TTRL: Context-Guided Test-Time Reinforcement Learning for On-Device Large Language Models
Peyman Hosseini, Ondrej Bohdal, Taha Ceritli +4
Test-time Reinforcement Learning (TTRL) has shown promise in adapting foundation models for complex tasks at test-time, resulting in large performance improvements. TTRL leverages…
On-device System of Compositional Multi-tasking in Large Language Models
Ondrej Bohdal, Konstantinos Theodosiadis, Asterios Mpatziakas +10
Large language models (LLMs) are commonly adapted for diverse downstream tasks via parameter-efficient fine-tuning techniques such as Low-Rank Adapters (LoRA). While adapters can b…
K-Merge: Online Continual Merging of Adapters for On-device Large Language Models
Donald Shenaj, Ondrej Bohdal, Taha Ceritli +3
On-device deployment of Large Language Models (LLMs) frequently leverages Low-Rank Adapters (LoRAs) to support diverse downstream tasks under tight resource constraints. To address…
MOCHA: Multi-modal Objects-aware Cross-arcHitecture Alignment
Elena Camuffo, Francesco Barbato, Mete Ozay +2
Personalized object detection aims to adapt a general-purpose detector to recognize user-specific instances from only a few examples. Lightweight models often struggle in this sett…
HydraOpt: Navigating the Efficiency-Performance Trade-off of Adapter Merging
Taha Ceritli, Ondrej Bohdal, Mete Ozay +4
Large language models (LLMs) often leverage adapters, such as low-rank-based adapters, to achieve strong performance on downstream tasks. However, storing a separate adapter for ea…
Efficient Compositional Multi-tasking for On-device Large Language Models
Ondrej Bohdal, Mete Ozay, Jijoong Moon +3
Adapter parameters provide a mechanism to modify the behavior of machine learning models and have gained significant popularity in the context of large language models (LLMs) and g…
Controllable Forgetting Mechanism for Few-Shot Class-Incremental Learning
Kirill Paramonov, Mete Ozay, Eunju Yang +2
Class-incremental learning in the context of limited personal labeled samples (few-shot) is critical for numerous real-world applications, such as smart home devices. A key challen…