940 citations · 1.4k across the 43 of their papers we have counts for
39 papers · 1 filter
Parameter is Not All You Need: Starting from Non-Parametric Networks for 3D Point Cloud Analysis
Renrui Zhang, Liuhui Wang, Ziyu Guo +4
We present a Non-parametric Network for 3D point cloud analysis, Point-NN, which consists of purely non-learnable components: farthest point sampling (FPS), k-nearest neighbors (k-…
Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis
Renrui Zhang, Liuhui Wang, Ziyu Guo +1
Performances on standard 3D point cloud benchmarks have plateaued, resulting in oversized models and complex network design to make a fractional improvement. We present an alternat…
iQuery: Instruments as Queries for Audio-Visual Sound Separation
Jiaben Chen, Renrui Zhang, Dongze Lian +3
Current audio-visual separation methods share a standard architecture design where an audio encoder-decoder network is fused with visual encoding features at the encoder bottleneck…
HashEncoding: Autoencoding with Multiscale Coordinate Hashing
Lukas Zhornyak, Zhengjie Xu, Haoran Tang +1
We present HashEncoding, a novel autoencoding architecture that leverages a non-parametric multiscale coordinate hash function to facilitate a per-pixel decoder without convolution…
Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applications
Lingzhi Zhang, Shenghao Zhou, Simon Stent +1
Egocentric videos offer fine-grained information for high-fidelity modeling of human behaviors. Hands and interacting objects are one crucial aspect of understanding a viewer's beh…
DSPoint: Dual-scale Point Cloud Recognition with High-frequency Fusion
Renrui Zhang, Ziyao Zeng, Ziyu Guo +3
Point cloud processing is a challenging task due to its sparsity and irregularity. Prior works introduce delicate designs on either local feature aggregator or global geometric arc…
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Kristen Grauman, Andrew Westbury, Eugene Byrne +82
We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household, outd…
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions
Yang Wu, Dingheng Wang, Xiaotong Lu +4
Visual recognition is currently one of the most important and active research areas in computer vision, pattern recognition, and even the general field of artificial intelligence.…
Convolutional Ordinal Regression Forest for Image Ordinal Estimation
Haiping Zhu, Hongming Shan, Yuheng Zhang +5
Image ordinal estimation is to predict the ordinal label of a given image, which can be categorized as an ordinal regression problem. Recent methods formulate an ordinal regression…
Nested Scale Editing for Conditional Image Synthesis
Lingzhi Zhang, Jiancong Wang, Yinshuang Xu +4
We propose an image synthesis approach that provides stratified navigation in the latent code space. With a tiny amount of partial or very low-resolution image, our approach can co…
Potential Field: Interpretable and Unified Representation for Trajectory Prediction
Shan Su, Cheng Peng, Jianbo Shi +1
Predicting an agent's future trajectory is a challenging task given the complicated stimuli (environmental/inertial/social) of motion. Prior works learn individual stimulus from di…
SegSort: Segmentation by Discriminative Sorting of Segments
Jyh-Jing Hwang, Stella X. Yu, Jianbo Shi +4
Almost all existing deep learning approaches for semantic segmentation tackle this task as a pixel-wise classification problem. Yet humans understand a scene not in terms of pixels…
Deep Image Blending
Lingzhi Zhang, Tarmily Wen, Jianbo Shi
Image composition is an important operation to create visual content. Among image composition tasks, image blending aims to seamlessly blend an object from a source image onto a ta…
Multimodal Image Outpainting With Regularized Normalized Diversification
Lingzhi Zhang, Jiancong Wang, Jianbo Shi
In this paper, we study the problem of generating a set ofrealistic and diverse backgrounds when given only a smallforeground region. We refer to this task as image outpaint-ing. T…
Image-based marker tracking and registration for intraoperative 3D image-guided interventions using augmented reality
Andong Cao, Ali Dhanaliwala, Jianbo Shi +2
Augmented reality has the potential to improve operating room workflow by allowing physicians to "see" inside a patient through the projection of imaging directly onto the surgical…
Learning Temporal Pose Estimation from Sparsely-Labeled Videos
Gedas Bertasius, Christoph Feichtenhofer, Du Tran +2
Modern approaches for multi-person pose estimation in video require large amounts of dense annotations. However, labeling every frame in a video is costly and labor intensive. To r…
FoveaBox: Beyond Anchor-based Object Detector
Tao Kong, Fuchun Sun, Huaping Liu +3
We present FoveaBox, an accurate, flexible, and completely anchor-free framework for object detection. While almost all state-of-the-art object detectors utilize predefined anchors…
Normalized Diversification
Shaohui Liu, Xiao Zhang, Jianqiao Wangni +1
Generating diverse yet specific data is the goal of the generative adversarial network (GAN), but it suffers from the problem of mode collapse. We introduce the concept of normaliz…
Consistent Optimization for Single-Shot Object Detection
Tao Kong, Fuchun Sun, Huaping Liu +2
We present consistent optimization for single stage object detection. Previous works of single stage object detectors usually rely on the regular, dense sampled anchors to generate…
Monocular 3D Pose Recovery via Nonconvex Sparsity with Theoretical Analysis
Jianqiao Wangni, Dahua Lin, Ji Liu +2
For recovering 3D object poses from 2D images, a prevalent method is to pre-train an over-complete dictionary of 3D basis poses. During testing, the detect…
Learning Discriminative Motion Features Through Detection
Gedas Bertasius, Christoph Feichtenhofer, Du Tran +2
Despite huge success in the image domain, modern detection models such as Faster R-CNN have not been used nearly as much for video analysis. This is arguably due to the fact that d…
Zoom-In-to-Check: Boosting Video Interpolation via Instance-level Discrimination
Liangzhe Yuan, Yibo Chen, Hantian Liu +2
We propose a light-weight video frame interpolation algorithm. Our key innovation is an instance-level supervision that allows information to be learned from the high-resolution ve…
Adversarial Structure Matching for Structured Prediction Tasks
Jyh-Jing Hwang, Tsung-Wei Ke, Jianbo Shi +1
Pixel-wise losses, e.g., cross-entropy or L2, have been widely used in structured prediction tasks as a spatial extension of generic image classification or regression. However, it…
Egocentric Basketball Motion Planning from a Single First-Person Image
Gedas Bertasius, Aaron Chan, Jianbo Shi
We present a model that uses a single first-person image to generate an egocentric basketball motion sequence in the form of a 12D camera configuration trajectory, which encodes a…