6 papers
Object-Aware 4D Human Motion Generation
Shurui Gui, Deep Anil Patel, Xiner Li +1
Recent advances in video diffusion models have enabled the generation of high-quality videos. However, these videos still suffer from unrealistic deformations, semantic violations,…
PPDiff: Diffusing in Hybrid Sequence-Structure Space for Protein-Protein Complex Design
Zhenqiao Song, Tiaoxiao Li, Lei Li +1
Designing protein-binding proteins with high affinity is critical in biomedical research and biotechnology. Despite recent advancements targeting specific proteins, the ability to…
Group Relative Augmentation for Data Efficient Action Detection
Deep Anil Patel, Iain Melvin, Zachary Izzo +1
Adapting large Video-Language Models (VLMs) for action detection using only a few examples poses challenges like overfitting and the granularity mismatch between scene-level pre-tr…
Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approach
Haoxuan Chen, Yinuo Ren, Martin Renqiang Min +2
Diffusion models (DMs) have proven to be effective in modeling high-dimensional distributions, leading to their widespread adoption for representing complex priors in Bayesian inve…
Planner3D: LLM-enhanced graph prior meets 3D indoor scene explicit regularization
Yao Wei, Martin Renqiang Min, George Vosselman +2
Compositional 3D scene synthesis has diverse applications across a spectrum of industries such as robotics, films, and video games, as it closely mirrors the complexity of real-wor…
Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos
Kumaranage Ravindu Yasas Nagasinghe, Honglu Zhou, Malitha Gunawardhana +3
In this paper, we explore the capability of an agent to construct a logical sequence of action steps, thereby assembling a strategic procedural plan. This plan is crucial for navig…