4 papers
DeFacto: Counterfactual Thinking with Images for Enforcing Evidence-Grounded and Faithful Reasoning
Tianrun Xu, Haoda Jing, Ye Li +6
Recent advances in multimodal language models (MLLMs) have made thinking with images a dominant paradigm for multimodal reasoning. However, existing methods still fail to ensure ev…
Coarse-to-Fine Joint Registration of MR and Ultrasound Images via Imaging Style Transfer
Junyi Wang, Xi Zhu, Yikun Guo +4
We developed a pipeline for registering pre-surgery Magnetic Resonance (MR) images and post-resection Ultrasound (US) images. Our approach leverages unpaired style transfer using 3…
Learning Invariable Semantical Representation from Language for Extensible Policy Generalization
Yihan Li, Jinsheng Ren, Tianrun Xu +3
Recently, incorporating natural language instructions into reinforcement learning (RL) to learn semantically meaningful representations and foster generalization has caught many co…
CRIL: Continual Robot Imitation Learning via Generative and Prediction Model
Chongkai Gao, Haichuan Gao, Shangqi Guo +2
Imitation learning (IL) algorithms have shown promising results for robots to learn skills from expert demonstrations. However, they need multi-task demonstrations to be provided a…