activity
20212023
most citedOpen-vocabulary Object Detection via Vision and Language Knowledge Distillation

281 citations · 425 across the 14 of their papers we have counts for

collaborators

14 papers

cs.LG2023

ATT3D: Amortized Text-to-3D Object Synthesis

Jonathan Lorraine, Kevin Xie, Xiaohui Zeng +7

Text-to-3D modelling has seen exciting progress by combining generative text-to-image models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently achieved hig…

cs.CV2023★ 6 cited

Motion-Conditioned Diffusion Model for Controllable Video Synthesis

Tsai-Shien Chen, Chieh Hubert Lin, Hung-Yu Tseng +2

Recent advancements in diffusion models have greatly improved the quality and diversity of synthesized content. To harness the expressive power of diffusion models, researchers hav…

cs.CV2022★ 25 cited

Magic3D: High-Resolution Text-to-3D Content Creation

Chen-Hsuan Lin, Jun Gao, Luming Tang +7

DreamFusion has recently demonstrated the utility of a pre-trained text-to-image diffusion model to optimize Neural Radiance Fields (NeRF), achieving remarkable text-to-3D synthesi…

cs.CV2022★ 1 cited

Optimizing Anchor-based Detectors for Autonomous Driving Scenes

Xianzhi Du, Wei-Chih Hung, Tsung-Yi Lin

This paper summarizes model improvements and inference-time optimizations for the popular anchor-based detectors in the scenes of autonomous driving. Based on the high-performing R…

cs.CV2022★ 2 cited

Vision Transformer for NeRF-Based View Synthesis from a Single Input Image

Kai-En Lin, Lin Yen-Chen, Wei-Sheng Lai +3

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate…

cs.CV2022★ 49 cited

A Unified Sequence Interface for Vision Tasks

Ting Chen, Saurabh Saxena, Lala Li +3

While language tasks are naturally expressed in a single, unified, modeling framework, i.e., generating sequences of tokens, this has not been the case in computer vision. As a res…

cs.RO2022

NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields

Lin Yen-Chen, Pete Florence, Jonathan T. Barron +3

Thin, reflective objects such as forks and whisks are common in our daily lives, but they are particularly challenging for robot perception because it is hard to reconstruct them u…

cs.CV2021★ 10 cited

Scaling Open-Vocabulary Image Segmentation with Image-Level Labels

Golnaz Ghiasi, Xiuye Gu, Yin Cui +1

We design an open-vocabulary image segmentation model to organize an image into meaningful regions indicated by arbitrary texts. Recent works (CLIP and ALIGN), despite attaining im…

cs.CV2021★ 12 cited

A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation

Wuyang Chen, Xianzhi Du, Fan Yang +8

This work presents a simple vision transformer design as a strong baseline for object localization and instance segmentation tasks. Transformers recently demonstrate competitive pe…

cs.CV2021★ 5 cited

Multi-Task Self-Training for Learning General Representations

Golnaz Ghiasi, Barret Zoph, Ekin D. Cubuk +2

Despite the fast progress in training specialized models for various tasks, learning a single general model that works well for many tasks is still challenging for computer vision.…

cs.CV2021

Patch2CAD: Patchwise Embedding Learning for In-the-Wild Shape Retrieval from a Single Image

Weicheng Kuo, Anelia Angelova, Tsung-Yi Lin +1

3D perception of object shapes from RGB image input is fundamental towards semantic scene understanding, grounding image-based perception in our spatially 3-dimensional real-world…

cs.CV2021★ 7 cited

Learning Open-World Object Proposals without Learning to Classify

Dahun Kim, Tsung-Yi Lin, Anelia Angelova +2

Object proposals have become an integral preprocessing steps of many vision pipelines including object detection, weakly supervised detection, object discovery, tracking, etc. Comp…

cs.CV2021★ 27 cited

Simple Training Strategies and Model Scaling for Object Detection

Xianzhi Du, Barret Zoph, Wei-Chih Hung +1

The speed-accuracy Pareto curve of object detection systems have advanced through a combination of better model architectures, training and inference methods. In this paper, we met…

cs.CV2021★ 281 cited

Open-vocabulary Object Detection via Vision and Language Knowledge Distillation

Xiuye Gu, Tsung-Yi Lin, Weicheng Kuo +1

We aim at advancing open-vocabulary object detection, which detects objects described by arbitrary text inputs. The fundamental challenge is the availability of training data. It i…