1 citations · 1 across the 5 of their papers we have counts for
8 papers
Paraphrase Consensus Is Not Self-Consistency: Instruction Reliance and Robustness in VLA Policies
Hanlong Li, Sihan Tan, Takeshi Ashizawa +2
Vision-language-action (VLA) policies fine-tuned on LIBERO are trained and evaluated on the same ten instruction strings, and rewording the instruction changes base OpenVLA's succe…
SignFLIP: A Unified Model for Sign Language Translation and Generation via Stage-wise Alignment at Scale
Zhaoyi An, Sihan Tan, Youngbae Hwang +2
Sign language translation and generation share the goal of bidirectional alignment between text and sign representations. However, existing approaches either treat them as isolated…
AMBIT: Anticipatory Multimodal Body Recruitment for Bimanual Tracking on a Humanoid
Hanlong Li, Sihan Tan, Takeshi Ashizawa +2
A humanoid with 5-DoF arms cannot track generic bimanual end-effector trajectories with its arms alone; pelvis and waist motion must be recruited, but which motion, and when, is no…
UNITE-AUDIO: Joint Learning of Continuous Tokenization and Latent Flow Matching for Text-to-Audio Generation
Runwu Shi, Kai Li, Yujin Wang +8
Text-to-audio (TTA) generation aims to synthesize realistic audio that faithfully reflects natural-language descriptions. Most TTA systems adopt a two-stage latent paradigm: an aud…
From Sign Language Generation to Humanoid Execution: Vision-Language Guided Retargeting with Collision Mitigation
Nabeela Khan, Bowen Wu, Runwu Shi +5
Recent sign language generation (SLG) systems increasingly output dense 3D body representations, which better preserve full-body kinematics and geometry for downstream embodiment o…
Unsupervised Single-Channel Speech Separation with Diffusion under Speaker-Embedding Guidance
Runwu Shi, Kai Li, Yiyan Wang +5
Speech separation is a fundamental task in audio processing, typically addressed with fully supervised systems trained on paired mixtures. While effective, such systems typically r…
Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation Model
Sihan Tan, Taro Miyazaki, Kazuhiro Nakadai
Sign Language Translation (SLT) aims to convert sign language (SL) videos into spoken language text, thereby bridging the communication gap between the sign and the spoken communit…
Improvement in Sign Language Translation Using Text CTC Alignment
Sihan Tan, Taro Miyazaki, Nabeela Khan +1
Current sign language translation (SLT) approaches often rely on gloss-based supervision with Connectionist Temporal Classification (CTC), limiting their ability to handle non-mono…