4 papers
MakeupMirror: Improving Facial Attribute Preservation in Diffusion Models for Makeup Transfer
Nefeli Andreou, Angel MartÃnez-González, Sabine Sternig +3
Makeup transfer models enable fun augmented reality (AR) experiences as well as virtual try-on (VTO) for online makeup shopping. While recent state-of-the-art diffusion based solut…
ToFu: Visual Tokens Reduction via Fusion for Multi-modal, Multi-patch, Multi-image Task
Vittorio Pippi, Matthieu Guillaumin, Silvia Cascianelli +3
Large Multimodal Models (LMMs) are powerful tools that are capable of reasoning and understanding multimodal information beyond text and language. Despite their entrenched impact,…
UniCoRN: Unified Commented Retrieval Network with LMMs
Maximilian Jaritz, Matthieu Guillaumin, Sabine Sternig +1
Multimodal retrieval methods have limitations in handling complex, compositional queries that require reasoning about the visual content of both the query and the retrieved entitie…
LatteCLIP: Unsupervised CLIP Fine-Tuning via LMM-Synthetic Texts
Anh-Quan Cao, Maximilian Jaritz, Matthieu Guillaumin +2
Large-scale vision-language pre-trained (VLP) models (e.g., CLIP) are renowned for their versatility, as they can be applied to diverse applications in a zero-shot setup. However,…