4 papers · 1 filter
SAMPLe: SAM-based Optimizer for Prompt Learning in VLMs
Hossein Rajoli, Fatemeh Lotfi, Niloufar Alipour Talemi +3
Pre-trained Vision-Language Models (VLMs) like CLIP have proven highly effective as foundation models for various downstream applications. However, prompt learning in VLMs encounte…
Modality-Aware SAM: Sharpness-Aware-Minimization Driven Gradient Modulation for Harmonized Multimodal Learning
Hossein R. Nowdeh, Jie Ji, Xiaolong Ma +1
In multimodal learning, dominant modalities often overshadow others, limiting generalization. We propose Modality-Aware Sharpness-Aware Minimization (M-SAM), a model-agnostic frame…
Data Overfitting for On-Device Super-Resolution with Dynamic Algorithm and Compiler Co-Design
Gen Li, Zhihao Shu, Jie Ji +4
Deep neural networks (DNNs) are frequently employed in a variety of computer vision applications. Nowadays, an emerging trend in the current video distribution system is to take ad…
FlameFinder: Illuminating Obscured Fire through Smoke with Attentive Deep Metric Learning
Hossein Rajoli, Sahand Khoshdel, Fatemeh Afghah +1
FlameFinder is a deep metric learning (DML) framework designed to accurately detect flames, even when obscured by smoke, using thermal images from firefighter drones during wildfir…