10 citations · 22 across the 31 of their papers we have counts for
36 papers
SpatialTrust: A Benchmark for Environmental Risk Recognition in Secure Authentication
Junbin Lu, Hsiang-Wei Huang, Saesha Wadhwa +2
Visual environmental risk recognition plays an important role in secure authentication, where a user's surroundings may reveal sensitive information or introduce potential security…
LeFlow: Generative Latent Flow Planning for World Models
Hsiang-Wei Huang, Jianxu Shangguan, Junbin Lu +1
Latent world models are inherently strong encoders that transform image pixel to latent embedding, yet existing world models still rely on online trajectory optimization for action…
Memory Tree Guided Key Frame Querying for Efficient 3D Question Answering
Hsiang-Wei Huang, Fu-Chen Chen, Li-Wu Tsao +7
Answering questions accurately and efficiently in embodied scenarios presents significant challenges due to limited computational and memory resources for Vision Language Model (VL…
CaMo: Camera Motion Grounded Evaluation and Training for Vision-Language Models
Hsiang-Wei Huang, Junbin Lu, Kuang-Ming Chen +3
Vision-Language Models (VLMs) achieve strong performance on spatial question answering benchmarks, yet it remains unclear whether such gains reflect genuine spatial intelligence. W…
RAM: Recover Any 3D Human Motion in-the-Wild
Sen Jia, Ning Zhu, Jinqin Zhong +4
RAM incorporates a motion-aware semantic tracker with adaptive Kalman filtering to achieve robust identity association under severe occlusions and dynamic interactions. A memory-au…
Detector-in-the-Loop Tracking: Active Memory Rectification for Stable Glottic Opening Localization
Huayu Wang, Bahaa Alattar, Cheng-Yen Yang +5
Temporal stability in glottic opening localization remains challenging due to the complementary weaknesses of single-frame detectors and foundation-model trackers: the former lacks…
UniHPR: Unified Human Pose Representation via Singular Value Contrastive Learning
Zhongyu Jiang, Wenhao Chai, Lei Li +3
In recent years, there has been a growing interest in developing effective alignment pipelines to generate unified representations from different modalities for multi-modal fusion…
Attention Consistency for LLMs Explanation
Tian Lan, Jinyuan Xu, Xue He +2
Understanding the decision-making processes of large language models (LLMs) is essential for their trustworthy development and deployment. However, current interpretability methods…
Causal Reasoning Elicits Controllable 3D Scene Generation
Shen Chen, Ruiyu Zhao, Jiale Zhou +3
Existing 3D scene generation methods often struggle to model the complex logical dependencies and physical constraints between objects, limiting their ability to adapt to dynamic a…
Is Meta-Learning Out? Rethinking Unsupervised Few-Shot Classification with Limited Entropy
Yunchuan Guan, Yu Liu, Ke Zhou +4
Meta-learning is a powerful paradigm for tackling few-shot tasks. However, recent studies indicate that models trained with the whole-class training strategy can achieve comparable…
Warehouse Spatial Question Answering with LLM Agent
Hsiang-Wei Huang, Jen-Hao Cheng, Kuang-Ming Chen +8
Spatial understanding has been a challenging task for existing Multi-modal Large Language Models~(MLLMs). Previous methods leverage large-scale MLLM finetuning to enhance MLLM's sp…
Memory-Efficient Visual Autoregressive Modeling with Scale-Aware KV Cache Compression
Kunjun Li, Zigeng Chen, Cheng-Yen Yang +1
Visual Autoregressive (VAR) modeling has garnered significant attention for its innovative next-scale prediction approach, which yields substantial improvements in efficiency, scal…
Adapting SAM 2 for Visual Object Tracking: 1st Place Solution for MMVPR Challenge Multi-Modal Tracking
Cheng-Yen Yang, Hsiang-Wei Huang, Pyong-Kun Kim +5
We present an effective approach for adapting the Segment Anything Model 2 (SAM2) to the Visual Object Tracking (VOT) task. Our method leverages the powerful pre-trained capabiliti…
Technical Report for ReID-SAM on SkiTB Visual Tracking Challenge 2025
Kunjun Li, Cheng-Yen Yang, Hsiang-Wei Huang +1
This report introduces ReID-SAM, a novel model developed for the SkiTB Challenge that addresses the complexities of tracking skier appearance. Our approach integrates the SAMURAI t…
Gradient Imbalance in Direct Preference Optimization
Qinwei Ma, Jingzhe Shi, Can Jin +3
Direct Preference Optimization (DPO) has been proposed as a promising alternative to Proximal Policy Optimization (PPO) based Reinforcement Learning with Human Feedback (RLHF). How…
ChatMotion: A Multimodal Multi-Agent for Human Motion Analysis
Lei Li, Sen Jia, Jianhao Wang +4
Advancements in Multimodal Large Language Models (MLLMs) have improved human motion understanding. However, these models remain constrained by their "instruct-only" nature, lacking…
Bayesian Optimization for Controlled Image Editing via LLMs
Chengkun Cai, Haoliang Liu, Xu Zhao +6
In the rapidly evolving field of image generation, achieving precise control over generated content and maintaining semantic consistency remain significant limitations, particularl…
Learning to Learn Weight Generation via Local Consistency Diffusion
Yunchuan Guan, Yu Liu, Ke Zhou +3
Diffusion-based algorithms have emerged as promising techniques for weight generation. However, existing solutions are limited by two challenges: generalizability and local target…
PackDiT: Joint Human Motion and Text Generation via Mutual Prompting
Zhongyu Jiang, Wenhao Chai, Zhuoran Zhou +3
Human motion generation has advanced markedly with the advent of diffusion models. Most recent studies have concentrated on generating motion sequences based on text prompts, commo…
Graph Canvas for Controllable 3D Scene Generation
Libin Liu, Shen Chen, Sen Jia +6
Spatial intelligence is foundational to AI systems that interact with the physical world, particularly in 3D scene generation and spatial comprehension. Current methodologies for 3…
3DSceneEditor: Controllable 3D Scene Editing with Gaussian Splatting
Ziyang Yan, Yihua Shao, Minwen Liao +7
The creation of 3D scenes has traditionally been both labor-intensive and costly, requiring designers to meticulously configure 3D assets and environments. Recent advancements in g…
SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memory
Cheng-Yen Yang, Hsiang-Wei Huang, Wenhao Chai +2
The Segment Anything Model 2 (SAM 2) has demonstrated strong performance in object segmentation tasks but faces challenges in visual object tracking, particularly when managing cro…
GTA: Global Tracklet Association for Multi-Object Tracking in Sports
Jiacheng Sun, Hsiang-Wei Huang, Cheng-Yen Yang +2
Multi-object tracking in sports scenarios has become one of the focal points in computer vision, experiencing significant advancements through the integration of deep learning tech…
Human Motion Instruction Tuning
Lei Li, Sen Jia, Jianhao Wang +6
This paper presents LLaMo (Large Language and Human Motion Assistant), a multimodal framework for human motion instruction tuning. In contrast to conventional instruction-tuning ap…