4 papers
Dynamic Training-Free Fusion of Subject and Style LoRAs
Qinglong Cao, Yuntian Chen, Chao Ma +1
Recent studies have explored the combination of multiple LoRAs to simultaneously generate user-specified subjects and styles. However, most existing approaches fuse LoRA weights us…
Learning Domain Knowledge in Multimodal Large Language Models through Reinforcement Fine-Tuning
Qinglong Cao, Yuntian Chen, Chao Ma +1
Multimodal large language models (MLLMs) have shown remarkable capabilities in multimodal perception and understanding tasks. However, their effectiveness in specialized domains, s…
Latent Knowledge-Guided Video Diffusion for Scientific Phenomena Generation from a Single Initial Frame
Qinglong Cao, Xirui Li, Ding Wang +3
Video diffusion models have achieved impressive results in natural scene generation, yet they struggle to generalize to scientific phenomena such as fluid simulations and meteorolo…
Neural Material Adaptor for Visual Grounding of Intrinsic Dynamics
Junyi Cao, Shanyan Guan, Yanhao Ge +3
While humans effortlessly discern intrinsic dynamics and adapt to new scenarios, modern AI systems often struggle. Current methods for visual grounding of dynamics either use pure…