4 papers
Demystifying Low-Rank Knowledge Distillation in Large Language Models: Convergence, Generalization, and Information-Theoretic Guarantees
Alberlucia Rafael Soarez, Daniel Kim, Mariana Costa +1
Knowledge distillation has emerged as a powerful technique for compressing large language models (LLMs) into efficient, deployable architectures while preserving their advanced cap…
Adversarial attacks against Modern Vision-Language Models
Alejandro Paredes La Torre
We study adversarial robustness of open-source vision-language model (VLM) agents deployed in a self-contained e-commerce environment built to simulate realistic pre-deployment con…
Diffusion Models for Joint Audio-Video Generation
Alejandro Paredes La Torre
Multimodal generative models have shown remarkable progress in single-modality video and audio synthesis, yet truly joint audio-video generation remains an open challenge. In this…
Knowledge Distillation for Large Language Models
Alejandro Paredes La Torre, Barbara Flores, Diego Rodriguez
We propose a resource-efficient framework for compressing large language models through knowledge distillation, combined with guided chain-of-thought reinforcement learning. Using…