30 citations · 173 across the 35 of their papers we have counts for
35 papers
MPE4G: Multimodal Pretrained Encoder for Co-Speech Gesture Generation
Gwantae Kim, Seonghyeok Noh, Insung Ham +1
When virtual agents interact with humans, gestures are crucial to delivering their intentions with speech. Previous multimodal co-speech gesture generation models required encoded…
Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognition
Yifan Jiang, Han Chen, Hanseok Ko
Recently, skeleton-based human action has become a hot research topic because the compact representation of human skeletons brings new blood to this research domain. As a result, r…
DIFAI: Diverse Facial Inpainting using StyleGAN Inversion
Dongsik Yoon, Jeong-gi Kwak, Yuanming Li +2
Image inpainting is an old problem in computer vision that restores occluded regions and completes damaged images. In the case of facial image inpainting, most of the methods gener…
Reference Guided Image Inpainting using Facial Attributes
Dongsik Yoon, Jeonggi Kwak, Yuanming Li +3
Image inpainting is a technique of completing missing pixels such as occluded region restoration, distracting objects removal, and facial completion. Among these inpainting tasks,…
Single Cell Training on Architecture Search for Image Denoising
Bokyeung Lee, Kyungdeuk Ko, Jonghwan Hong +1
Neural Architecture Search (NAS) for automatically finding the optimal network architecture has shown some success with competitive performances in various computer vision tasks. H…
3d human motion generation from the text via gesture action classification and the autoregressive model
Gwantae Kim, Youngsuk Ryu, Junyeop Lee +3
In this paper, a deep learning-based model for 3D human motion generation from the text is proposed via gesture action classification and an autoregressive model. The model focuses…
Discriminatory and orthogonal feature learning for noise robust keyword spotting
Donghyeon Kim, Kyungdeuk Ko, David K. Han +1
Keyword Spotting (KWS) is an essential component in a smart device for alerting the system when a user prompts it with a command. As these devices are typically constrained by comp…
Pose-Guided Graph Convolutional Networks for Skeleton-Based Action Recognition
Han Chen, Yifan Jiang, Hanseok Ko
Graph convolutional networks (GCNs), which can model the human body skeletons as spatial and temporal graphs, have shown remarkable potential in skeleton-based action recognition.…
Controllable Face Manipulation and UV Map Generation by Self-supervised Learning
Yuanming Li, Jeong-gi Kwak, David Han +1
Although manipulating facial attributes by Generative Adversarial Networks (GANs) has been remarkably successful recently, there are still some challenges in explicit control of fe…
Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesis
Jeong-gi Kwak, Yuanming Li, Dongsik Yoon +3
Over the years, 2D GANs have achieved great successes in photorealistic portrait generation. However, they lack 3D understanding in the generation process, thus they suffer from mu…
Generate and Edit Your Own Character in a Canonical View
Jeong-gi Kwak, Yuanming Li, Dongsik Yoon +2
Recently, synthesizing personalized characters from a single user-given portrait has received remarkable attention as a drastic popularization of social media and the metaverse. Th…
Efficient dynamic filter for robust and low computational feature extraction
Donghyeon Kim, Gwantae Kim, Bokyeung Lee +3
Unseen noise signal which is not considered in a model training process is difficult to anticipate and would lead to performance degradation. Various methods have been investigated…
Adverse Weather Image Translation with Asymmetric and Uncertainty-aware GAN
Jeong-gi Kwak, Youngsaeng Jin, Yuanming Li +3
Adverse weather image translation belongs to the unsupervised image-to-image (I2I) translation task which aims to transfer adverse condition domain (eg, rainy night) to standard do…
Action Recognition with Domain Invariant Features of Skeleton Image
Han Chen, Yifan Jiang, Hanseok Ko
Due to the fast processing-speed and robustness it can achieve, skeleton-based action recognition has recently received the attention of the computer vision community. The recent C…
A Teacher-Student Framework with Fourier Augmentation for COVID-19 Infection Segmentation in CT Images
Han Chen, Yifan Jiang, Hanseok Ko +1
Automatic segmentation of infected regions in computed tomography (CT) images is necessary for the initial diagnosis of COVID-19. Deep-learning-based methods have the potential to…
A Lightweight dynamic filter for keyword spotting
Donghyeon Kim, Kyungdeuk Ko, Jeonggi Kwak +2
Keyword Spotting (KWS) from speech signals is widely applied to perform fully hands-free speech recognition. The KWS network is designed as a small-footprint model so it can contin…
Memory-based Semantic Segmentation for Off-road Unstructured Natural Environments
Youngsaeng Jin, David K. Han, Hanseok Ko
With the availability of many datasets tailored for autonomous driving in real-world urban scenes, semantic segmentation for urban driving scenes achieves significant progress. How…
SpecMix : A Mixed Sample Data Augmentation method for Training withTime-Frequency Domain Features
Gwantae Kim, David K. Han, Hanseok Ko
A mixed sample data augmentation strategy is proposed to enhance the performance of models on audio scene classification, sound event classification, and speech enhancement tasks.…
CaraNet: Context Axial Reverse Attention Network for Segmentation of Small Medical Objects
Ange Lou, Shuyue Guan, Hanseok Ko +1
Segmenting medical images accurately and reliably is important for disease diagnosis and treatment. It is a challenging task because of the wide variety of objects' sizes, shapes,…
CPNet: Cross-Parallel Network for Efficient Anomaly Detection
Youngsaeng Jin, Jonghwan Hong, David Han +1
Anomaly detection in video streams is a challenging problem because of the scarcity of abnormal events and the difficulty of accurately annotating them. To alleviate these issues,…
Few-shot Learning for CT Scan based COVID-19 Diagnosis
Yifan Jiang, Han Chen, David K. Han +1
Coronavirus disease 2019 (COVID-19) is a Public Health Emergency of International Concern infecting more than 40 million people across 188 countries and territories. Chest computed…
CAFE-GAN: Arbitrary Face Attribute Editing with Complementary Attention Feature
Jeong-gi Kwak, David K. Han, Hanseok Ko
The goal of face attribute editing is altering a facial image according to given target attributes such as hair color, mustache, gender, etc. It belongs to the image-to-image domai…
Unsupervised domain adaptation based COVID-19 CT infection segmentation network
Han Chen, Yifan Jiang, Murray Loew +1
Automatic segmentation of infection areas in computed tomography (CT) images has proven to be an effective diagnosis approach for COVID-19. However, due to the limited number of pi…
COVID-19 CT Image Synthesis with a Conditional Generative Adversarial Network
Yifan Jiang, Han Chen, Murray Loew +1
Coronavirus disease 2019 (COVID-19) is an ongoing global pandemic that has spread rapidly since December 2019. Real-time reverse transcription polymerase chain reaction (rRT-PCR) a…