4 papers
Keep the Effect, Drop the Actor: Programmable Effect-to-Execution World-Action Models
Junyi Hu, Zhewen He, Zhenhua Li +1
A robot demonstration records two things in the same frames: what happened to the objects, and how one particular arm made it happen. We condition on the first. A demonstration is…
SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance
Zhewen He, Junyi Yu, Haomian Huang +2
We study the challenge of sign language video mimicking: given a driving video and a single reference frame, synthesize a video where the target signer reproduces the source motion…
DINO Eats Geometry: Self-Supervised Sign Representations that Absorb Articulated Hand Geometry
Junyi Hu, Zhewen He, Haomian Huang +4
Handshape and orientation are geometric components of sign language, yet many sign encoders learn from appearance alone. We introduce SignDEG (DINO Eats Geometry), a temporal sign…
SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks
Zhewen He, Junyi Hu, Haomian Huang +3
Sign language models are typically trained on datasets captured under constrained conditions, with limited viewpoint, background, and signer-identity diversity, leading to poor rob…