849 citations · 1.1k across the 19 of their papers we have counts for
4 papers · 1 filter
Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts
Yan Zeng, Xinsong Zhang, Hang Li
Most existing methods in vision language pre-training rely on object-centric features extracted through object detection and make fine-grained alignments between the extracted feat…
Self-Supervised Learning by Estimating Twin Class Distributions
Feng Wang, Tao Kong, Rufeng Zhang +2
We present TWIST, a simple and theoretically explainable self-supervised representation learning method by classifying large-scale unlabeled datasets in an end-to-end way. We emplo…
The Tensor Brain: A Unified Theory of Perception, Memory and Semantic Decoding
Volker Tresp, Sahand Sharifzadeh, Hang Li +2
We present a unified computational theory of an agent's perception and memory. In our model, perception, episodic memory, and semantic memory are realized by different operational…
Graphhopper: Multi-Hop Scene Graph Reasoning for Visual Question Answering
Rajat Koner, Hang Li, Marcel Hildebrandt +3
Visual Question Answering (VQA) is concerned with answering free-form questions about an image. Since it requires a deep semantic and linguistic understanding of the question and t…