940 citations · 1.4k across the 43 of their papers we have counts for
44 papers
Parameter is Not All You Need: Starting from Non-Parametric Networks for 3D Point Cloud Analysis
Renrui Zhang, Liuhui Wang, Ziyu Guo +4
We present a Non-parametric Network for 3D point cloud analysis, Point-NN, which consists of purely non-learnable components: farthest point sampling (FPS), k-nearest neighbors (k-…
Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis
Renrui Zhang, Liuhui Wang, Ziyu Guo +1
Performances on standard 3D point cloud benchmarks have plateaued, resulting in oversized models and complex network design to make a fractional improvement. We present an alternat…
iQuery: Instruments as Queries for Audio-Visual Sound Separation
Jiaben Chen, Renrui Zhang, Dongze Lian +3
Current audio-visual separation methods share a standard architecture design where an audio encoder-decoder network is fused with visual encoding features at the encoder bottleneck…
HashEncoding: Autoencoding with Multiscale Coordinate Hashing
Lukas Zhornyak, Zhengjie Xu, Haoran Tang +1
We present HashEncoding, a novel autoencoding architecture that leverages a non-parametric multiscale coordinate hash function to facilitate a per-pixel decoder without convolution…
Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applications
Lingzhi Zhang, Shenghao Zhou, Simon Stent +1
Egocentric videos offer fine-grained information for high-fidelity modeling of human behaviors. Hands and interacting objects are one crucial aspect of understanding a viewer's beh…
DSPoint: Dual-scale Point Cloud Recognition with High-frequency Fusion
Renrui Zhang, Ziyao Zeng, Ziyu Guo +3
Point cloud processing is a challenging task due to its sparsity and irregularity. Prior works introduce delicate designs on either local feature aggregator or global geometric arc…
SoGCN: Second-Order Graph Convolutional Networks
Peihao Wang, Yuehao Wang, Hua Lin +1
Graph Convolutional Networks (GCN) with multi-hop aggregation is more expressive than one-hop GCN but suffers from higher model complexity. Finding the shortest aggregation range t…
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Kristen Grauman, Andrew Westbury, Eugene Byrne +82
We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household, outd…
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions
Yang Wu, Dingheng Wang, Xiaotong Lu +4
Visual recognition is currently one of the most important and active research areas in computer vision, pattern recognition, and even the general field of artificial intelligence.…
Convolutional Ordinal Regression Forest for Image Ordinal Estimation
Haiping Zhu, Hongming Shan, Yuheng Zhang +5
Image ordinal estimation is to predict the ordinal label of a given image, which can be categorized as an ordinal regression problem. Recent methods formulate an ordinal regression…
Nested Scale Editing for Conditional Image Synthesis
Lingzhi Zhang, Jiancong Wang, Yinshuang Xu +4
We propose an image synthesis approach that provides stratified navigation in the latent code space. With a tiny amount of partial or very low-resolution image, our approach can co…
Potential Field: Interpretable and Unified Representation for Trajectory Prediction
Shan Su, Cheng Peng, Jianbo Shi +1
Predicting an agent's future trajectory is a challenging task given the complicated stimuli (environmental/inertial/social) of motion. Prior works learn individual stimulus from di…
SegSort: Segmentation by Discriminative Sorting of Segments
Jyh-Jing Hwang, Stella X. Yu, Jianbo Shi +4
Almost all existing deep learning approaches for semantic segmentation tackle this task as a pixel-wise classification problem. Yet humans understand a scene not in terms of pixels…
Deep Image Blending
Lingzhi Zhang, Tarmily Wen, Jianbo Shi
Image composition is an important operation to create visual content. Among image composition tasks, image blending aims to seamlessly blend an object from a source image onto a ta…
Multimodal Image Outpainting With Regularized Normalized Diversification
Lingzhi Zhang, Jiancong Wang, Jianbo Shi
In this paper, we study the problem of generating a set ofrealistic and diverse backgrounds when given only a smallforeground region. We refer to this task as image outpaint-ing. T…
Image-based marker tracking and registration for intraoperative 3D image-guided interventions using augmented reality
Andong Cao, Ali Dhanaliwala, Jianbo Shi +2
Augmented reality has the potential to improve operating room workflow by allowing physicians to "see" inside a patient through the projection of imaging directly onto the surgical…
Enhanced generative adversarial network for 3D brain MRI super-resolution
Jiancong Wang, Yuhua Chen, Yifan Wu +2
Single image super-resolution (SISR) reconstruction for magnetic resonance imaging (MRI) has generated significant interest because of its potential to not only speed up imaging bu…
Neural Embedding for Physical Manipulations
Lingzhi Zhang, Andong Cao, Rui Li +1
In common real-world robotic operations, action and state spaces can be vast and sometimes unknown, and observations are often relatively sparse. How do we learn the full topology…
Learning Temporal Pose Estimation from Sparsely-Labeled Videos
Gedas Bertasius, Christoph Feichtenhofer, Du Tran +2
Modern approaches for multi-person pose estimation in video require large amounts of dense annotations. However, labeling every frame in a video is costly and labor intensive. To r…
EncryptGAN: Image Steganography with Domain Transform
Ziqiang Zheng, Hongzhi Liu, Zhibin Yu +4
We propose an image steganographic algorithm called EncryptGAN, which disguises private image communication in an open communication channel. The insight is that content transform…
FoveaBox: Beyond Anchor-based Object Detector
Tao Kong, Fuchun Sun, Huaping Liu +3
We present FoveaBox, an accurate, flexible, and completely anchor-free framework for object detection. While almost all state-of-the-art object detectors utilize predefined anchors…
Normalized Diversification
Shaohui Liu, Xiao Zhang, Jianqiao Wangni +1
Generating diverse yet specific data is the goal of the generative adversarial network (GAN), but it suffers from the problem of mode collapse. We introduce the concept of normaliz…
Trajectory Normalized Gradients for Distributed Optimization
Jianqiao Wangni, Ke Li, Jianbo Shi +1
Recently, researchers proposed various low-precision gradient compression, for efficient communication in large-scale distributed optimization. Based on these work, we try to reduc…
Consistent Optimization for Single-Shot Object Detection
Tao Kong, Fuchun Sun, Huaping Liu +2
We present consistent optimization for single stage object detection. Previous works of single stage object detectors usually rely on the regular, dense sampled anchors to generate…