3 papers
cs.CV2024
EMMA: Efficient Visual Alignment in Multi-Modal LLMs
Sara Ghazanfari, Alexandre Araujo, Prashanth Krishnamurthy +2
Multi-modal Large Language Models (MLLMs) have recently exhibited impressive general-purpose capabilities by leveraging vision foundation models to encode the core concepts of imag…
cs.LG2024
Novel Quadratic Constraints for Extending LipSDP beyond Slope-Restricted Activations
Patricia Pauli, Aaron Havens, Alexandre Araujo +4
Recently, semidefinite programming (SDP) techniques have shown great promise in providing accurate Lipschitz bounds for neural networks. Specifically, the LipSDP approach (Fazlyab…
cs.CV2023
LipSim: A Provably Robust Perceptual Similarity Metric
Sara Ghazanfari, Alexandre Araujo, Prashanth Krishnamurthy +2
Recent years have seen growing interest in developing and applying perceptual similarity metrics. Research has shown the superiority of perceptual metrics over pixel-wise metrics i…