5 papers
Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications
Xianghao Zang, Zijian Jiang, Jiarong Cheng +8
Instruction-based Image Editing (IIE) aims to transform a given image into a new one based on textual instructions. Advances in Large Language Models (LLMs) and Vision-Language Mod…
W2T: LoRA Weights Already Know What They Can Do
Xiaolong Han, Ferrante Neri, Zijian Jiang +4
Each LoRA checkpoint compactly stores task-specific updates in low-rank weight matrices, offering an efficient way to adapt large language models to new tasks and domains. In princ…
Proteus-ID: ID-Consistent and Motion-Coherent Video Customization
Guiyu Zhang, Chen Shi, Zijian Jiang +4
Video identity customization seeks to synthesize realistic, temporally coherent videos of a specific subject, given a single reference image and a text prompt. This task presents t…
PUGS: Zero-shot Physical Understanding with Gaussian Splatting
Yinghao Shuai, Ran Yu, Yuantao Chen +9
Current robotic systems can understand the categories and poses of objects well. But understanding physical properties like mass, friction, and hardness, in the wild, remains chall…
Ctrl-U: Robust Conditional Image Generation via Uncertainty-aware Reward Modeling
Guiyu Zhang, Huan-ang Gao, Zijian Jiang +2
In this paper, we focus on the task of conditional image generation, where an image is synthesized according to user instructions. The critical challenge underpinning this task is…