97 citations · 291 across the 34 of their papers we have counts for
34 papers
Surface Geometry Processing: An Efficient Normal-based Detail Representation
Wuyuan Xie, Miaohui Wang, Di Lin +2
With the rapid development of high-resolution 3D vision applications, the traditional way of manipulating surface detail requires considerable memory and computing time. To address…
L-CAD: Language-based Colorization with Any-level Descriptions using Diffusion Priors
Zheng Chang, Shuchen Weng, Peixuan Zhang +3
Language-based colorization produces plausible and visually pleasing colors under the guidance of user-friendly natural language descriptions. Previous methods implicitly assume th…
Self-Supervised Scene Dynamic Recovery from Rolling Shutter Images and Events
Yangguang Wang, Xiang Zhang, Mingyuan Lin +4
Scene Dynamic Recovery (SDR) by inverting distorted Rolling Shutter (RS) images to an undistorted high frame-rate Global Shutter (GS) video is a severely ill-posed problem due to t…
Spike Stream Denoising via Spike Camera Simulation
Liwen hu, Lei Ma, Zhaofei Yu +2
As a neuromorphic sensor with high temporal resolution, the spike camera shows enormous potential in high-speed visual tasks. However, the high-speed sampling of light propagation…
DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Rendering
Zongrui Li, Qian Zheng, Boxin Shi +2
Uncalibrated photometric stereo (UPS) is challenging due to the inherent ambiguity brought by the unknown light. Although the ambiguity is alleviated on non-Lambertian objects, the…
EvHandPose: Event-based 3D Hand Pose Estimation with Sparse Supervision
Jianping Jiang, Jiahe Li, Baowen Zhang +2
Event camera shows great potential in 3D hand pose estimation, especially addressing the challenges of fast motion and high dynamic range in a low-power way. However, due to the as…
Deep Learning Methods for Calibrated Photometric Stereo and Beyond
Yakun Ju, Kin-Man Lam, Wuyuan Xie +3
Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e., modeling the relationship between surface orientation and intensi…
NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral Reflectance Decomposition
Jipeng Lv, Heng Guo, Guanying Chen +2
Multispectral photometric stereo(MPS) aims at recovering the surface normal of a scene from a single-shot multispectral image captured under multispectral illuminations. Existing M…
NeIF: Representing General Reflectance as Neural Intrinsics Fields for Uncalibrated Photometric Stereo
Zongrui Li, Qian Zheng, Feishi Wang +3
Uncalibrated photometric stereo (UPS) is challenging due to the inherent ambiguity brought by unknown light. Existing solutions alleviate the ambiguity by either explicitly associa…
Edge-preserving Near-light Photometric Stereo with Neural Surfaces
Heng Guo, Hiroaki Santo, Boxin Shi +1
This paper presents a near-light photometric stereo method that faithfully preserves sharp depth edges in the 3D reconstruction. Unlike previous methods that rely on finite differe…
1000x Faster Camera and Machine Vision with Ordinary Devices
Tiejun Huang, Yajing Zheng, Zhaofei Yu +13
In digital cameras, we find a major limitation: the image and video form inherited from a film camera obstructs it from capturing the rapidly changing photonic world. Here, we pres…
Optical Flow Estimation for Spiking Camera
Liwen Hu, Rui Zhao, Ziluo Ding +4
As a bio-inspired sensor with high temporal resolution, the spiking camera has an enormous potential in real applications, especially for motion estimation in high-speed scenes. Ho…
Label Distribution Amendment with Emotional Semantic Correlations for Facial Expression Recognition
Shasha Mao, Guanghui Shi, Licheng Jiao +4
By utilizing label distribution learning, a probability distribution is assigned for a facial image to express a compound emotion, which effectively improves the problem of label u…
DeRenderNet: Intrinsic Image Decomposition of Urban Scenes with Shape-(In)dependent Shading Rendering
Yongjie Zhu, Jiajun Tang, Si Li +1
We propose DeRenderNet, a deep neural network to decompose the albedo and latent lighting, and render shape-(in)dependent shadings, given a single image of an outdoor urban scene,…
Spatially-Varying Outdoor Lighting Estimation from Intrinsics
Yongjie Zhu, Yinda Zhang, Si Li +1
We present SOLID-Net, a neural network for spatially-varying outdoor lighting estimation from a single outdoor image for any 2D pixel location. Previous work has used a unified sky…
Deep Photometric Stereo for Non-Lambertian Surfaces
Guanying Chen, Kai Han, Boxin Shi +2
This paper addresses the problem of photometric stereo, in both calibrated and uncalibrated scenarios, for non-Lambertian surfaces based on deep learning. We first introduce a full…
A Semi-Supervised Assessor of Neural Architectures
Yehui Tang, Yunhe Wang, Yixing Xu +6
Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficient…
Learning to Deblur and Generate High Frame Rate Video with an Event Camera
Chen Haoyu, Teng Minggui, Shi Boxin +2
Event cameras are bio-inspired cameras which can measure the change of intensity asynchronously with high temporal resolution. One of the event cameras' advantages is that they do…
Distilling portable Generative Adversarial Networks for Image Translation
Hanting Chen, Yunhe Wang, Han Shu +5
Despite Generative Adversarial Networks (GANs) have been widely used in various image-to-image translation tasks, they can be hardly applied on mobile devices due to their heavy co…
Beyond Dropout: Feature Map Distortion to Regularize Deep Neural Networks
Yehui Tang, Yunhe Wang, Yixing Xu +4
Deep neural networks often consist of a great number of trainable parameters for extracting powerful features from given datasets. On one hand, massive trainable parameters signifi…
On Positive-Unlabeled Classification in GAN
Tianyu Guo, Chang Xu, Jiajun Huang +4
This paper defines a positive and unlabeled classification problem for standard GANs, which then leads to a novel technique to stabilize the training of the discriminator in GANs.…
Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materials
Min Li, Zhenglong Zhou, Zhe Wu +3
We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo (MVPS) technique that works for general isotropic materials. Our…
AdderNet: Do We Really Need Multiplications in Deep Learning?
Hanting Chen, Yunhe Wang, Chunjing Xu +4
Compared with cheap addition operation, multiplication operation is of much higher computation complexity. The widely-used convolutions in deep neural networks are exactly cross-co…
DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracing
Shaohui Liu, Yinda Zhang, Songyou Peng +3
We propose a differentiable sphere tracing algorithm to bridge the gap between inverse graphics methods and the recently proposed deep learning based implicit signed distance funct…