16 papers
K-Merge: Online Continual Merging of Adapters for On-device Large Language Models
Donald Shenaj, Ondrej Bohdal, Taha Ceritli +3
On-device deployment of Large Language Models (LLMs) frequently leverages Low-Rank Adapters (LoRAs) to support diverse downstream tasks under tight resource constraints. To address…
DuoMem: Towards Capable On-Device Memory Agents via Dual-Space Distillation
Peyman Hosseini, Ondrej Bohdal, Ahmed Alajrami +6
Large Language Model (LLM)-based agents can solve complex procedural tasks by interacting with environments over multiple turns, but this ability typically depends on large models,…
MOCHA: Multi-modal Objects-aware Cross-arcHitecture Alignment
Elena Camuffo, Francesco Barbato, Mete Ozay +2
Personalized object detection aims to adapt a general-purpose detector to recognize user-specific instances from only a few examples. Lightweight models often struggle in this sett…
Efficient Compositional Multi-tasking for On-device Large Language Models
Ondrej Bohdal, Mete Ozay, Jijoong Moon +3
Adapter parameters provide a mechanism to modify the behavior of machine learning models and have gained significant popularity in the context of large language models (LLMs) and g…
Diffusion Alignment Beyond KL: Variance Minimisation as Effective Policy Optimiser
Zijing Ou, Jacob Si, Junyi Zhu +4
Diffusion alignment adapts pretrained diffusion models to sample from reward-tilted distributions along the denoising trajectory. This process naturally admits a Sequential Monte C…
Feature-Space Generative Models for One-Shot Class-Incremental Learning
Jack Foster, Kirill Paramonov, Mete Ozay +1
Few-shot class-incremental learning (FSCIL) is a paradigm where a model, initially trained on a dataset of base classes, must adapt to an expanding problem space by recognizing nov…