36 citations · 102 across the 15 of their papers we have counts for
19 papers
Learning Fine-Grained Visual Understanding for Video Question Answering via Decoupling Spatial-Temporal Modeling
Hsin-Ying Lee, Hung-Ting Su, Bing-Chen Tsai +3
While recent large-scale video-language pre-training made great progress in video question answering, the design of spatial modeling of video-language models is less fine-grained t…
Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning
Ligong Han, Jian Ren, Hsin-Ying Lee +5
Most methods for conditional video synthesis use a single modality as the condition. This comes with major limitations. For example, it is problematic for a model conditioned on an…
StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGAN
Min Jin Chong, Hsin-Ying Lee, David Forsyth
Recently, StyleGAN has enabled various image manipulation and editing tasks thanks to the high-quality generation and the disentangled latent space. However, additional architectur…
In&Out : Diverse Image Outpainting via GAN Inversion
Yen-Chi Cheng, Chieh Hubert Lin, Hsin-Ying Lee +3
Image outpainting seeks for a semantically consistent extension of the input image beyond its available content. Compared to inpainting -- filling in missing pixels in a way cohere…
Unsupervised Sound Localization via Iterative Contrastive Learning
Yan-Bo Lin, Hung-Yu Tseng, Hsin-Ying Lee +2
Sound localization aims to find the source of the audio signal in the visual scene. However, it is labor-intensive to annotate the correlations between the signals sampled from the…
Unsupervised Discovery of Disentangled Manifolds in GANs
Yu-Ding Lu, Hsin-Ying Lee, Hung-Yu Tseng +1
As recent generative models can generate photo-realistic images, people seek to understand the mechanism behind the generation process. Interpretable generation process is benefici…