57 citations · 110 across the 23 of their papers we have counts for
24 papers
Remember, Revisit, Revise: Scaffold Memory for Long-Horizon 3D Geometry
Soumick Sarker, Mengmi Zhang
Geometry foundation models estimate camera poses and 3D scene structure from video sequences, but maintaining consistent reconstructions over long horizons remains challenging. Fee…
Training-free Object Counting with Prompts
Zenglin Shi, Ying Sun, Mengmi Zhang
This paper tackles the problem of object counting in images. Existing approaches rely on extensive training data with point annotations for each object, making data collection labo…
Integrating Curricula with Replays: Its Effects on Continual Learning
Ren Jie Tee, Mengmi Zhang
Humans engage in learning and reviewing processes with curricula when acquiring new skills or knowledge. This human learning behavior has inspired the integration of curricula with…
Decoding the Enigma: Benchmarking Humans and AIs on the Many Facets of Working Memory
Ankur Sikarwar, Mengmi Zhang
Working memory (WM), a fundamental cognitive process facilitating the temporary storage, integration, manipulation, and retrieval of information, plays a vital role in reasoning an…
Object-centric Learning with Cyclic Walks between Parts and Whole
Ziyu Wang, Mike Zheng Shou, Mengmi Zhang
Learning object-centric representations from complex natural environments enables both humans and machines with reasoning abilities from low-level perceptual features. To capture c…
Efficient Zero-shot Visual Search via Target and Context-aware Transformer
Zhiwei Ding, Xuezhe Ren, Erwan David +3
Visual search is a ubiquitous challenge in natural vision, including daily tasks such as finding a friend in a crowd or searching for a car in a parking lot. Human rely heavily on…
Learning to Learn: How to Continuously Teach Humans and Machines
Parantak Singh, You Li, Ankur Sikarwar +7
Curriculum design is a fundamental component of education. For example, when we learn mathematics at school, we build upon our knowledge of addition to learn multiplication. These…
Can Machines Imitate Humans? Integrative Turing-like tests for Language and Vision Demonstrate a Narrowing Gap
Mengmi Zhang, Elisa Pavarino, Xiao Liu +20
As AI becomes increasingly embedded in daily life, ascertaining whether an agent is human is critical. We systematically benchmark AI's ability to imitate humans in three language…
Learning to See the Elephant in the Room: Self-Supervised Context Reasoning in Humans and AI
Xiao Liu, Soumick Sarker, Ankur Sikarwar +4
Humans rarely perceive objects in isolation but interpret scenes through relationships among co-occurring elements. How such contextual knowledge is acquired without explicit super…
Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning
Zenglin Shi, Jing Jie, Ying Sun +2
In AI, generalization refers to a model's ability to perform well on out-of-distribution data related to the given task, beyond the data it was trained on. For an AI agent to excel…
Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task
Stan Weixian Lei, Difei Gao, Jay Zhangjie Wu +4
VQA is an ambitious task aiming to answer any image-related question. However, in reality, it is hard to build such a system once for all since the needs of users are continuously…
Improving generalization by mimicking the human visual diet
Spandan Madan, You Li, Mengmi Zhang +2
We present a new perspective on bridging the generalization gap between biological and computer vision -- mimicking the human visual diet. While computer vision models rely on inte…
Label-Efficient Online Continual Object Detection in Streaming Video
Jay Zhangjie Wu, David Junhao Zhang, Wynne Hsu +2
Humans can watch a continuous video stream and effortlessly perform continual acquisition and transfer of new knowledge with minimal supervision yet retaining previously learnt exp…
Visual Search Asymmetry: Deep Nets and Humans Share Similar Inherent Biases
Shashi Kant Gupta, Mengmi Zhang, Chia-Chien Wu +2
Visual search is a ubiquitous and often challenging daily task, exemplified by looking for the car keys at home or a friend in a crowd. An intriguing property of some classical sea…
When Pigs Fly: Contextual Reasoning in Synthetic and Natural Scenes
Philipp Bomatter, Mengmi Zhang, Dimitar Karev +3
Context is of fundamental importance to both human and machine vision; e.g., an object in the air is more likely to be an airplane than a pig. The rich notion of context incorporat…
Tuned Compositional Feature Replays for Efficient Stream Learning
Morgan B. Talbot, Rushikesh Zawar, Rohil Badkundri +2
Our brains extract durable, generalizable knowledge from transient experiences of the world. Artificial neural networks come nowhere close to this ability. When tasked with learnin…
Look Twice: A Generalist Computational Model Predicts Return Fixations across Tasks and Species
Mengmi Zhang, Marcelo Armendariz, Will Xiao +5
Primates constantly explore their surroundings via saccadic eye movements that bring different parts of an image into high resolution. In addition to exploring new regions in the v…
What am I Searching for: Zero-shot Target Identity Inference in Visual Search
Mengmi Zhang, Gabriel Kreiman
Can we infer intentions from a person's actions? As an example problem, here we consider how to decipher what a person is searching for by decoding their eye movement behavior. We…
Putting visual object recognition in context
Mengmi Zhang, Claire Tseng, Gabriel Kreiman
Context plays an important role in visual recognition. Recent studies have shown that visual recognition networks can be fooled by placing objects in inconsistent contexts (e.g., a…
Variational Prototype Replays for Continual Learning
Mengmi Zhang, Tao Wang, Joo Hwee Lim +2
Continual learning refers to the ability to acquire and transfer knowledge without catastrophically forgetting what was previously learned. In this work, we consider \emph{few-shot…
Lift-the-flap: what, where and when for context reasoning
Mengmi Zhang, Claire Tseng, Karla Montejo +2
Context reasoning is critical in a wide variety of applications where current inputs need to be interpreted in the light of previous experience and knowledge. Both spatial and temp…
Egocentric Spatial Memory
Mengmi Zhang, Keng Teck Ma, Shih-Cheng Yen +3
Egocentric spatial memory (ESM) defines a memory system with encoding, storing, recognizing and recalling the spatial information about the environment from an egocentric perspecti…
Finding any Waldo: zero-shot invariant and efficient visual search
Mengmi Zhang, Jiashi Feng, Keng Teck Ma +3
Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distr…
What am I Searching for: Zero-shot Target Identity Inference in Visual Search
Mengmi Zhang, Gabriel Kreiman
Can we infer intentions from a person's actions? As an example problem, here we consider how to decipher what a person is searching for by decoding their eye movement behavior. We…