24 citations · 61 across the 13 of their papers we have counts for
5 papers · 1 filter
Masked Vision and Language Modeling for Multi-modal Representation Learning
Gukyeong Kwon, Zhaowei Cai, Avinash Ravichandran +3
In this paper, we study how to use masked signal modeling in vision and language (V+L) representation learning. Instead of developing masked language modeling (MLM) and masked imag…
Patient Aware Active Learning for Fine-Grained OCT Classification
Yash-yee Logan, Ryan Benkert, Ahmad Mustafa +2
This paper considers making active learning more sensible from a medical perspective. In practice, a disease manifests itself in different forms across patient cohorts. Existing fr…
X-DETR: A Versatile Architecture for Instance-wise Vision-Language Tasks
Zhaowei Cai, Gukyeong Kwon, Avinash Ravichandran +4
In this paper, we study the challenging instance-wise vision-language tasks, where the free-form language is required to align with the objects instead of the whole image. To addre…
Multi-Modal Learning Using Physicians Diagnostics for Optical Coherence Tomography Classification
Y. Logan, K. Kokilepersaud, G. Kwon +3
In this paper, we propose a framework that incorporates experts diagnostics and insights into the analysis of Optical Coherence Tomography (OCT) using multi-modal learning. To demo…
A Gating Model for Bias Calibration in Generalized Zero-shot Learning
Gukyeong Kwon, Ghassan AlRegib
Generalized zero-shot learning (GZSL) aims at training a model that can generalize to unseen class data by only using auxiliary information. One of the main challenges in GZSL is a…