6 papers
CA-World: Multi-Object Counterfactual Alignment for Efficient Interactive-Ready Reconstruction
Xin Dong, Weijian Deng, Lihan Zhang +3
Reconstructing interaction-ready 3D worlds is essential for physical simulation, virtual reality, robotics, and autonomous driving. However, existing methods mainly optimize static…
Manual-PA: Learning 3D Part Assembly from Instruction Diagrams
Jiahao Zhang, Anoop Cherian, Cristian Rodriguez +2
Assembling furniture amounts to solving the discrete-continuous optimization task of selecting the furniture parts to assemble and estimating their connecting poses in a physically…
Confidence and Dispersity as Signals: Unsupervised Model Evaluation and Ranking
Weijian Deng, Weijie Tu, Ibrahim Radwan +3
Assessing model generalization under distribution shift is essential for real-world deployment, particularly when labeled test data is unavailable. This paper presents a unified an…
Ranked from Within: Ranking Large Multimodal Models Without Labels
Weijie Tu, Weijian Deng, Dylan Campbell +4
Can the relative performance of a pre-trained large multimodal model (LMM) be predicted without access to labels? As LMMs proliferate, it becomes increasingly important to develop…
Toward a Holistic Evaluation of Robustness in CLIP Models
Weijie Tu, Weijian Deng, Tom Gedeon
Contrastive Language-Image Pre-training (CLIP) models have shown significant potential, particularly in zero-shot classification across diverse distribution shifts. Building on exi…
RefRef: A Synthetic Dataset and Benchmark for Reconstructing Refractive and Reflective Objects
Yue Yin, Enze Tao, Weijian Deng +1
Modern 3D reconstruction and novel view synthesis approaches have demonstrated strong performance on scenes with opaque Lambertian objects. However, most assume straight light path…