27 citations · 69 across the 34 of their papers we have counts for
35 papers
Gaussian Stippling: Efficient Sorting-Free 3D Gaussian Rendering through Hybrid Sampling and Spatiotemporal Reconstruction
Zijian Huang, Suiliang Mai, Chuankun Zheng +2
Conventional 3D Gaussian Splatting (3DGS) requires depth sorting and ordered alpha blending to correctly render overlapping Gaussian primitives. Stochastic transparency enables sor…
GeRM: A Generative Rendering Model From Physically Realistic to Photorealistic
Jiayuan Lu, Rengan Xie, Xuancheng Jin +5
While physically-based rendering (PBR) simulates light transport that guarantees physical realism, achieving true photorealistic rendering (PRR) demands prohibitive time and labor,…
Fuse3D: Generating 3D Assets Controlled by Multi-Image Fusion
Xuancheng Jin, Rengan Xie, Wenting Zheng +3
Recently, generating 3D assets with the control of condition images has achieved impressive quality. However, existing 3D generation methods are limited to handling a single contro…
DISK: Differentiable Sparse Kernel Complex for Efficient Spatially-Variant Convolution
Zhizhen Wu, Zhe Cao, Yuchi Huo
Image convolution with complex kernels is a fundamental operation in photography, scientific imaging, and animation effects, yet direct dense convolution is computationally prohibi…
CtrlVDiff: Controllable Video Generation via Unified Multimodal Video Diffusion
Dianbing Xi, Jiepeng Wang, Yuanzhi Liang +8
We tackle the dual challenges of video understanding and controllable video generation within a unified diffusion framework. Our key insights are two-fold: geometry-only cues (e.g.…
PFAvatar: Pose-Fusion 3D Personalized Avatar Reconstruction from Real-World Outfit-of-the-Day Photos
Dianbing Xi, Guoyuan An, Jingsen Zhu +6
We propose PFAvatar (Pose-Fusion Avatar), a new method that reconstructs high-quality 3D avatars from Outfit of the Day(OOTD) photos, which exhibit diverse poses, occlusions, and c…
LangPert: Detecting and Handling Task-level Perturbations for Robust Object Rearrangement
Xu Yin, Min-Sung Yoon, Yuchi Huo +2
Task execution for object rearrangement could be challenged by Task-Level Perturbations (TLP), i.e., unexpected object additions, removals, and displacements that can disrupt under…
OmniVDiff: Omni Controllable Video Diffusion for Generation and Understanding
Dianbing Xi, Jiepeng Wang, Yuanzhi Liang +5
In this paper, we propose a novel framework for controllable video diffusion, OmniVDiff , aiming to synthesize and comprehend multiple video visual content in a single diffusion mo…
OpenSlot: Mixed Open-Set Recognition with Object-Centric Learning
Xu Yin, Fei Pan, Guoyuan An +3
Existing open-set recognition (OSR) studies typically assume that each image contains only one class label, with the unknown test set (negative) having a disjoint label space from…
Fine-grained Background Representation for Weakly Supervised Semantic Segmentation
Xu Yin, Woobin Im, Dongbo Min +3
Generating reliable pseudo masks from image-level labels is challenging in the weakly supervised semantic segmentation (WSSS) task due to the lack of spatial information. Prevalent…
Accurate and Fast Pixel Retrieval with Spatial and Uncertainty Aware Hypergraph Diffusion
Guoyuan An, Yuchi Huo, Sung-Eui Yoon
This paper presents a novel method designed to enhance the efficiency and accuracy of both image retrieval and pixel retrieval. Traditional diffusion methods struggle to propagate…
Neural Rendering and Its Hardware Acceleration: A Review
Xinkai Yan, Jieting Xu, Yuchi Huo +1
Neural rendering is a new image and video generation method based on deep learning. It combines the deep learning model with the physical knowledge of computer graphics, to obtain…
Holistic Inverse Rendering of Complex Facade via Aerial 3D Scanning
Zixuan Xie, Rengan Xie, Rong Li +8
In this work, we use multi-view aerial images to reconstruct the geometry, lighting, and material of facades using neural signed distance fields (SDFs). Without the requirement of…
FuseSR: Super Resolution for Real-time Rendering through Efficient Multi-resolution Fusion
Zhihua Zhong, Jingsen Zhu, Yuxin Dai +5
The workload of real-time rendering is steeply increasing as the demand for high resolution, high refresh rates, and high realism rises, overwhelming most graphics cards. To mitiga…
Topological RANSAC for instance verification and retrieval without fine-tuning
Guoyuan An, Juhyung Seon, Inkyu An +2
This paper presents an innovative approach to enhancing explainable image retrieval, particularly in situations where a fine-tuning set is unavailable. The widely-used SPatial veri…
Towards Content-based Pixel Retrieval in Revisited Oxford and Paris
Guoyuan An, Woo Jae Kim, Saelyne Yang +3
This paper introduces the first two pixel retrieval benchmarks. Pixel retrieval is segmented instance retrieval. Like semantic segmentation extends classification to the pixel leve…
Seal-3D: Interactive Pixel-Level Editing for Neural Radiance Fields
Xiangyu Wang, Jingsen Zhu, Qi Ye +4
With the popularity of implicit neural representations, or neural radiance fields (NeRF), there is a pressing need for editing methods to interact with the implicit 3D models for t…
I-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFs
Jingsen Zhu, Yuchi Huo, Qi Ye +8
In this work, we present I-SDF, a new method for intrinsic indoor scene reconstruction and editing using differentiable Monte Carlo raytracing on neural signed distance fields…
Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracing
Jingsen Zhu, Fujun Luan, Yuchi Huo +7
Indoor scenes typically exhibit complex, spatially-varying appearance from global illumination, making inverse rendering a challenging ill-posed problem. This work presents an end-…
Contact2Grasp: 3D Grasp Synthesis via Hand-Object Contact Constraint
Haoming Li, Xinzhuo Lin, Yang Zhou +4
3D grasp synthesis generates grasping poses given an input object. Existing works tackle the problem by learning a direct mapping from objects to the distributions of grasping pose…
ImmFusion: Robust mmWave-RGB Fusion for 3D Human Body Reconstruction in All Weather Conditions
Anjun Chen, Xiangyu Wang, Kun Shi +6
3D human reconstruction from RGB images achieves decent results in good weather conditions but degrades dramatically in rough weather. Complementary, mmWave radars have been employ…
Contour-Aware Equipotential Learning for Semantic Segmentation
Xu Yin, Dongbo Min, Yuchi Huo +1
With increasing demands for high-quality semantic segmentation in the industry, hard-distinguishing semantic boundaries have posed a significant threat to existing solutions. Inspi…
Rule-based Procedural Tree Modeling Approach
Yinhui Yang, Rui Wang, Yuchi Huo
In some entertainment and virtual reality applications, it is necessary to model and draw the real world realistically, so as to improve the fidelity of natural scenes and make use…
An Interactive Image-based Modeling System
Zhi He, Rui Wang, Wei Hua +1
This paper propose a interactive 3D modeling method and corresponding system based on single or multiple uncalibrated images. The main feature of this method is that, according to…