11 papers
SapiensID 2.0: Aligning Human Recognition Foundation Models with Human Perception
Yiyang Su, Jie Zhu, Feng Liu +2
While foundation models have significantly advanced human recognition across diverse modalities, they predominantly rely on static, geometric feature extraction. This approach fund…
Subtoken Vision Transformer for Fine-grained Recognition
Jie Zhu, Ivy Zhang, Minchul Kim +1
We present Subtoken Vision Transformer (SubViT), a selective image tokenization method for fine-grained visual recognition. Standard Vision Transformers compress each fixed-size pa…
FusionAgent: A Multimodal Agent with Dynamic Model Selection for Human Recognition
Jie Zhu, Xiao Guo, Yiyang Su +2
Model fusion is a key strategy for robust recognition in unconstrained scenarios, as different models provide complementary strengths. This is especially important for whole-body h…
Interpretable Perception and Reasoning for Audiovisual Geolocation
Yiyang Su, Xiaoming Liu
While recent advances in Multimodal Large Language Models (MLLMs) have improved image-based localization, precise global geolocation remains a formidable challenge due to the inher…
LocalScore: Local Density-Aware Similarity Scoring for Biometrics
Yiyang Su, Minchul Kim, Jie Zhu +4
Open-set biometrics faces challenges with probe subjects who may not be enrolled in the gallery, as traditional biometric systems struggle to detect these non-mated probes. Despite…
Can Textual Reasoning Improve the Performance of MLLMs on Fine-grained Visual Classification?
Jie Zhu, Yiyang Su, Xiaoming Liu
Multi-modal large language models (MLLMs) exhibit strong general-purpose capabilities, yet still struggle on Fine-Grained Visual Classification (FGVC), a core perception task that…
A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognition
Jie Zhu, Yiyang Su, Minchul Kim +2
Whole-body biometric recognition is a challenging multimodal task that integrates various biometric modalities, including face, gait, and body. This integration is essential for ov…
Person Recognition at Altitude and Range: Fusion of Face, Body Shape and Gait
Feng Liu, Nicholas Chimitt, Lanqing Guo +16
We address the problem of whole-body person recognition in unconstrained environments. This problem arises in surveillance scenarios such as those in the IARPA Biometric Recognitio…
50 Years of Automated Face Recognition
Minchul Kim, Anil Jain, Xiaoming Liu
Over the past five decades, automated face recognition (FR) has progressed from handcrafted geometric and statistical approaches to advanced deep learning architectures that now ap…
SapiensID: Foundation for Human Recognition
Minchul Kim, Dingqiang Ye, Yiyang Su +2
Existing human recognition systems often rely on separate, specialized models for face and body analysis, limiting their effectiveness in real-world scenarios where pose, visibilit…
BigGait: Learning Gait Representation You Want by Large Vision Models
Dingqiang Ye, Chao Fan, Jingzhe Ma +2
Gait recognition stands as one of the most pivotal remote identification technologies and progressively expands across research and industry communities. However, existing gait rec…