4 papers
BayesPrompt: human readable prompts that make sense
Franky Kevin Nando Tezoh, Ali Hussaini Umar, Alessandro Laio +2
Reconstructing prompts that can elicit a desired answer or behaviour in an LLM is an open and important research topic. Optimisation methods which aim at minimising the perplexity…
CoVAE: correlated multimodal generative modeling
Federico Caretti, Guido Sanguinetti
Multimodal Variational Autoencoders have emerged as a popular tool to extract effective representations from rich multimodal data. However, such models rely on fusion strategies in…
Balanced Multimodal Learning via Mutual Information
Rongrong Xie, Guido Sanguinetti
Multimodal learning has increasingly become a focal point in research, primarily due to its ability to integrate complementary information from diverse modalities. Nevertheless, mo…
Information-Theoretic Criteria for Knowledge Distillation in Multimodal Learning
Rongrong Xie, Yizhou Xu, Guido Sanguinetti
The rapid increase in multimodal data availability has sparked significant interest in cross-modal knowledge distillation (KD) techniques, where richer "teacher" modalities transfe…