8 papers
Engagement Process: Rethinking the Temporal Interface of Action and Observation
Jialian Li, Yuchen Cao, Junhong Liu +5
Task completion in digital and physical environments increasingly involves complex temporal interaction, where actions and observations unfold over different time scales rather tha…
Bayesian Gated Non-Negative Contrastive Learning
Peng Cui, Jiahao Zhang, Lijie Hu
While Contrastive Learning (CL) has revolutionized self-supervised representation learning, its latent representations remain highly entangled and opaque, limiting their interpreta…
RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generation
Jiahao Zhang, Joseph Liu, Young-Yoon Lee +9
Success in generative modeling across language, image, and video demonstrates that large, well-curated datasets are the key driver for building capable models. 3D Human motion, how…
From Instance Selection to Fixed-Pool Data Recipe Search for Supervised Fine-Tuning
Haodong Wu, Jiahao Zhang, Lijie Hu +1
Supervised fine-tuning (SFT) data selection is commonly formulated as instance ranking: score each example and retain a top- subset. However, effective SFT training subsets are…
AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects
Danrui Li, Jiahao Zhang, Bernhard Egger +4
Assembling objects from parts requires understanding multimodal instructions, linking them to 3D components, and predicting physically plausible 6-DoF motions for each assembly ste…
Manual-PA: Learning 3D Part Assembly from Instruction Diagrams
Jiahao Zhang, Anoop Cherian, Cristian Rodriguez +2
Assembling furniture amounts to solving the discrete-continuous optimization task of selecting the furniture parts to assemble and estimating their connecting poses in a physically…