51 citations · 64 across the 17 of their papers we have counts for
8 papers · 1 filter
MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs
Jiarui Zhang, Mahyar Khayatkhoei, Prateek Chhikara +1
Multimodal Large Language Models (MLLMs) have experienced rapid progress in visual recognition tasks in recent years. Given their potential integration into many critical applicati…
Look, Learn and Leverage (L): Mitigating Visual-Domain Shift and Discovering Intrinsic Relations via Symbolic Alignment
Hanchen Xie, Jiageng Zhu, Mahyar Khayatkhoei +2
Modern deep learning models have demonstrated outstanding performance on discovering the underlying mechanisms when both visual appearance and intrinsic relations (e.g., causal str…
An Investigation on The Position Encoding in Vision-Based Dynamics Prediction
Jiageng Zhu, Hanchen Xie, Jiazhi Li +2
Despite the success of vision-based dynamics prediction models, which predict object states by utilizing RGB images and simple object descriptions, they were challenged by environm…
Exploring Perceptual Limitation of Multimodal Large Language Models
Jiarui Zhang, Jinyi Hu, Mahyar Khayatkhoei +2
Multimodal Large Language Models (MLLMs) have recently shown remarkable perceptual capability in answering visual questions, however, little is known about the limits of their perc…
Unsupervised Multimodal Deepfake Detection Using Intra- and Cross-Modal Inconsistencies
Mulin Tian, Mahyar Khayatkhoei, Joe Mathai +1
Deepfake videos present an increasing threat to society with potentially negative impact on criminal justice, democracy, and personal safety and privacy. Meanwhile, detecting deepf…
Towards Perceiving Small Visual Details in Zero-shot Visual Question Answering with Multimodal LLMs
Jiarui Zhang, Mahyar Khayatkhoei, Prateek Chhikara +1
Multimodal Large Language Models (MLLMs) have recently achieved promising zero-shot accuracy on visual question answering (VQA) -- a fundamental task affecting various downstream a…
A Critical View of Vision-Based Long-Term Dynamics Prediction Under Environment Misalignment
Hanchen Xie, Jiageng Zhu, Mahyar Khayatkhoei +3
Dynamics prediction, which is the problem of predicting future states of scene objects based on current and prior states, is drawing increasing attention as an instance of learning…
Using Visual Cropping to Enhance Fine-Detail Question Answering of BLIP-Family Models
Jiarui Zhang, Mahyar Khayatkhoei, Prateek Chhikara +1
Visual Question Answering is a challenging task, as it requires seamless interaction between perceptual, linguistic, and background knowledge systems. While the recent progress of…