216 citations · 802 across the 61 of their papers we have counts for
13 papers · 1 filter
A Benchmark and Baseline for Language-Driven Image Editing
Jing Shi, Ning Xu, Trung Bui +3
Language-driven image editing can significantly save the laborious image editing work and be friendly to the photography novice. However, most similar work can only deal with a spe…
Cubic Spline Smoothing Compensation for Irregularly Sampled Sequences
Jing Shi, Jing Bi, Yingru Liu +1
The marriage of recurrent neural networks and neural ordinary differential networks (ODE-RNN) is effective in modeling irregularly-observed sequences. While ODE produces the smooth…
Actor-Action Video Classification CSC 249/449 Spring 2020 Challenge Report
Jing Shi, Zhiheng Li, Haitian Zheng +30
This technical report summarizes submissions and compiles from Actor-Action video classification challenge held as a final project in CSC 249/449 Machine Vision course (Spring 2020…
Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing
Yapeng Tian, Dingzeyu Li, Chenliang Xu
In this paper, we introduce a new problem, named audio-visual video parsing, which aims to parse a video into temporal event segments and label them as either audible, visible, or…
Talking-head Generation with Rhythmic Head Motion
Lele Chen, Guofeng Cui, Celong Liu +4
When people deliver a speech, they naturally move heads, and this rhythmic head motion conveys prosodic information. However, generating a lip-synced video while moving head natura…
Graph Neural Network Based Coarse-Grained Mapping Prediction
Zhiheng Li, Geemi P. Wellawatte, Maghesree Chakraborty +3
The selection of coarse-grained (CG) mapping operators is a critical step for CG molecular dynamics (MD) simulation. It is still an open question about what is optimal for this cho…
Explaining Local, Global, And Higher-Order Interactions In Deep Learning
Samuel Lerman, Chenliang Xu, Charles Venuto +1
We present a simple yet highly generalizable method for explaining interacting parts within a neural network's reasoning process. First, we design an algorithm based on cross deriv…
What comprises a good talking-head video generation?: A Survey and Benchmark
Lele Chen, Guofeng Cui, Ziyi Kou +2
Over the years, performance evaluation has become essential in computer vision, enabling tangible progress in many sub-fields. While talking-head video generation has become an eme…
Learning a Weakly-Supervised Video Actor-Action Segmentation Model with a Wise Selection
Jie Chen, Zhiheng Li, Jiebo Luo +1
We address weakly-supervised video actor-action segmentation (VAAS), which extends general video object segmentation (VOS) to additionally consider action labels of the actors. The…
Deep Grouping Model for Unified Perceptual Parsing
Zhiheng Li, Wenxuan Bao, Jiayang Zheng +1
The perceptual-based grouping process produces a hierarchical and compositional image representation that helps both human and machine vision systems recognize heterogeneous visual…
Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution
Xiaoyu Xiang, Yapeng Tian, Yulun Zhang +3
In this paper, we explore the space-time video super-resolution task, which aims to generate a high-resolution (HR) slow-motion video from a low frame rate (LFR), low-resolution (L…
Assembling Semantically-Disentangled Representations for Predictive-Generative Models via Adaptation from Synthetic Domain
Burkay Donderici, Caleb New, Chenliang Xu
Deep neural networks can form high-level hierarchical representations of input data. Various researchers have demonstrated that these representations can be used to enable a variet…
TailorGAN: Making User-Defined Fashion Designs
Lele Chen, Justin Tian, Guo Li +5
Attribute editing has become an important and emerging topic of computer vision. In this paper, we consider a task: given a reference garment image A and another image B with targe…