4 citations · 9 across the 21 of their papers we have counts for
11 papers · 1 filter
CST-WM: A Causally Structured World Model for Embodied Visual Tracking
Junyi Hu, Shuaihang Yuan, Yi Fang +1
Embodied visual tracking requires a robot to choose actions that keep a moving target observable at a suitable distance, and to recover it after occlusion, out-of-view drift, or di…
DINO Eats Geometry: Self-Supervised Sign Representations that Absorb Articulated Hand Geometry
Junyi Hu, Zhewen He, Haomian Huang +4
Handshape and orientation are geometric components of sign language, yet many sign encoders learn from appearance alone. We introduce SignDEG (DINO Eats Geometry), a temporal sign…
Focus Where It Counts: A Salience-Driven Vision-Language Model for Low Vision Assistance
Jiazhao Liang, Hao Huang, Shuaihang Yuan +8
Vision-language models (VLMs) are rapidly progressing and offer promising capabilities for assistive technologies supporting persons with blindness or low vision. However, existing…
VTaMo: Video-Text Alignment Model for Sign Language Translation
Junyi Hu, Zhewen He, Haomian Huang +2
Sign language translation (SLT) converts continuous sign videos into spoken language text. Gloss-free approaches leverage pre-trained visual encoders and language models but rely o…
VCS-SLAM: Geometry-Validated Semantic Evidence Fusion for 3D Gaussian SLAM
Raman Jha, Shuaihang Yuan, Yi Fang
Visual SLAM performance often deteriorates in complex real-world applications. Semantic 3D Gaussian SLAM commonly fuses 2D semantic priors into a persistent 3D map using uniform op…
SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks
Zhewen He, Junyi Hu, Haomian Huang +3
Sign language models are typically trained on datasets captured under constrained conditions, with limited viewpoint, background, and signer-identity diversity, leading to poor rob…
Hierarchical Scoring with 3D Gaussian Splatting for Instance Image-Goal Navigation
Yijie Deng, Shuaihang Yuan, Geeta Chandra Raju Bethala +3
Instance Image-Goal Navigation (IIN) requires autonomous agents to identify and navigate to a target object or location depicted in a reference image captured from any viewpoint. W…
A Chain-of-Thought Subspace Meta-Learning for Few-shot Image Captioning with Large Vision and Language Models
Hao Huang, Shuaihang Yuan, Yu Hao +2
A large-scale vision and language model that has been pretrained on massive data encodes visual and linguistic prior, which makes it easier to generate images and language that are…
Curvature Diversity-Driven Deformation and Domain Alignment for Point Cloud
Mengxi Wu, Hao Huang, Yi Fang +1
Unsupervised Domain Adaptation (UDA) is crucial for reducing the need for extensive manual data annotation when training deep networks on point cloud data. A significant challenge…
A Multi-Modal Foundation Model to Assist People with Blindness and Low Vision in Environmental Interaction
Yu Hao, Fan Yang, Hao Huang +5
People with blindness and low vision (pBLV) encounter substantial challenges when it comes to comprehensive scene recognition and precise object identification in unfamiliar enviro…
Meta-Learning 3D Shape Segmentation Functions
Yu Hao, Hao Huang, Shuaihang Yuan +1
Learning robust 3D shape segmentation functions with deep neural networks has emerged as a powerful paradigm, offering promising performance in producing a consistent part segmenta…