4 papers
SIMPLE: Semantic Structure-Aligned Prompt Learning for Open-Vocabulary Audio-Visual Event Localization
Hanyu Xuan, Haoran Xu, Min Yin +7
Open-vocabulary audio-visual event localization aims to infer explicit segment-level categories for both seen and unseen audio-visual events. Existing solutions rely heavily on han…
Covert Visual Prompt Injection against Commercial Multimodal Large Language Models
Meiwen Ding, Song Xia, Chenqi Kong +1
Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt inject…
Feature-Space Smoothing: Certified Robustness of Deep Representations
Song Xia, Meiwen Ding, Chenqi Kong +2
Modern deep learning models exhibit strong capabilities across diverse applications, yet remain vulnerable to malicious inputs that induce erroneous predictions via feature-space d…
Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systems
Song Xia, Yi Yu, Wenhan Yang +5
By locally encoding raw data into intermediate features, collaborative inference enables end users to leverage powerful deep learning models without exposure of sensitive raw data…