42 citations · 318 across the 30 of their papers we have counts for
33 papers
Selective compression learning of latent representations for variable-rate image compression
Jooyoung Lee, Seyoon Jeong, Munchurl Kim
Recently, many neural network-based image compression methods have shown promising results superior to the existing tool-based conventional codecs. However, most of them are often…
Realistic Bokeh Effect Rendering on Mobile GPUs, Mobile AI & AIM 2022 challenge: Report
Andrey Ignatov, Radu Timofte, Jin Zhang +21
As mobile cameras with compact optics are unable to produce a strong bokeh effect, lots of interest is now devoted to deep learning-based solutions for this task. In this Mobile AI…
Layered Depth Refinement with Mask Guidance
Soo Ye Kim, Jianming Zhang, Simon Niklaus +4
Depth maps are used in a wide range of applications from 3D rendering to 2D image effects such as Bokeh. However, those predicted by single image depth estimation (SIDE) models oft…
Positional Information is All You Need: A Novel Pipeline for Self-Supervised SVDE from Videos
Juan Luis Gonzalez Bello, Jaeho Moon, Munchurl Kim
Recently, much attention has been drawn to learning the underlying 3D structures of a scene from monocular videos in a fully self-supervised fashion. One of the most challenging as…
DeMFI: Deep Joint Deblurring and Multi-Frame Interpolation with Flow-Guided Attentive Correlation and Recursive Boosting
Jihyong Oh, Munchurl Kim
In this paper, we propose a novel joint deblurring and multi-frame interpolation (DeMFI) framework, called DeMFI-Net, which accurately converts blurry videos of lower-frame-rate to…
SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery
Jaehyup Lee, Soomin Seo, Munchurl Kim
Pan-sharpening is a process of merging a high-resolution (HR) panchromatic (PAN) image and its corresponding low-resolution (LR) multi-spectral (MS) image to create an HR-MS and pa…
Exploiting Global and Local Attentions for Heavy Rain Removal on Single Images
Dac Tung Vu, Juan Luis Gonzalez, Munchurl Kim
Heavy rain removal from a single image is the task of simultaneously eliminating rain streaks and fog, which can dramatically degrade the quality of captured images. Most existing…
PeaceGAN: A GAN-based Multi-Task Learning Method for SAR Target Image Generation with a Pose Estimator and an Auxiliary Classifier
Jihyong Oh, Munchurl Kim
Although Generative Adversarial Networks (GANs) are successfully applied to diverse fields, training GANs on synthetic aperture radar (SAR) data is a challenging task mostly due to…
PLADE-Net: Towards Pixel-Level Accuracy for Self-Supervised Single-View Depth Estimation with Neural Positional Encoding and Distilled Matting Loss
Juan Luis Gonzalez Bello, Munchurl Kim
In this paper, we propose a self-supervised single-view pixel-level accurate depth estimation network, called PLADE-Net. The PLADE-Net is the first work that shows unprecedented ac…
XVFI: eXtreme Video Frame Interpolation
Hyeonjun Sim, Jihyong Oh, Munchurl Kim
In this paper, we firstly present a dataset (X4K1000FPS) of 4K videos of 1000 fps with the extreme motion to the research community for video frame interpolation (VFI), and propose…
Zoom-to-Inpaint: Image Inpainting with High-Frequency Details
Soo Ye Kim, Kfir Aberman, Nori Kanazawa +6
Although deep learning has enabled a huge leap forward in image inpainting, current methods are often unable to synthesize realistic high-frequency details. In this paper, we propo…
KOALAnet: Blind Super-Resolution using Kernel-Oriented Adaptive Local Adjustment
Soo Ye Kim, Hyeonjun Sim, Munchurl Kim
Blind super-resolution (SR) methods aim to generate a high quality high resolution image from a low resolution image containing unknown degradations. However, natural images contai…
Forget About the LiDAR: Self-Supervised Depth Estimators with MED Probability Volumes
Juan Luis Gonzalez, Munchurl Kim
Self-supervised depth estimators have recently shown results comparable to the supervised methods on the challenging single image depth estimation (SIDE) task, by exploiting the ge…
Pan-Sharpening with Color-Aware Perceptual Loss and Guided Re-Colorization
Juan Luis Gonzalez Bello, Soomin Seo, Munchurl Kim
We present a novel color-aware perceptual (CAP) loss for learning the task of pan-sharpening. Our CAP loss is designed to focus on the deep features of a pre-trained VGG network th…
NTIRE 2020 Challenge on NonHomogeneous Dehazing
Codruta O. Ancuti, Cosmin Ancuti, Florin-Alexandru Vasluianu +49
This paper reviews the NTIRE 2020 Challenge on NonHomogeneous Dehazing of images (restoration of rich details in hazy image). We focus on the proposed solutions and their results e…
AIM 2019 Challenge on Video Temporal Super-Resolution: Methods and Results
Seungjun Nah, Sanghyun Son, Radu Timofte +1
Videos contain various types and strengths of motions that may look unnaturally discontinuous in time when the recorded frame rate is low. This paper reviews the first AIM challeng…
An End-to-End Joint Learning Scheme of Image Compression and Quality Enhancement with Improved Entropy Minimization
Jooyoung Lee, Seunghyun Cho, Munchurl Kim
Recently, learned image compression methods have been actively studied. Among them, entropy-minimization based approaches have achieved superior results compared to conventional im…
FISR: Deep Joint Frame Interpolation and Super-Resolution with a Multi-scale Temporal Loss
Soo Ye Kim, Jihyong Oh, Munchurl Kim
Super-resolution (SR) has been widely used to convert low-resolution legacy videos to high-resolution (HR) ones, to suit the increasing resolution of displays (e.g. UHD TVs). Howev…
Deep 3D Pan via adaptive "t-shaped" convolutions with global and local adaptive dilations
Juan Luis Gonzalez Bello, Munchurl Kim
Recent advances in deep learning have shown promising results in many low-level vision tasks. However, solving the single-image-based view synthesis is still an open problem. In pa…
Deep 3D-Zoom Net: Unsupervised Learning of Photo-Realistic 3D-Zoom
Juan Luis Gonzalez Bello, Munchurl Kim
The 3D-zoom operation is the positive translation of the camera in the Z-axis, perpendicular to the image plane. In contrast, the optical zoom changes the focal length and the digi…
JSI-GAN: GAN-Based Joint Super-Resolution and Inverse Tone-Mapping with Pixel-Wise Task-Specific Filters for UHD HDR Video
Soo Ye Kim, Jihyong Oh, Munchurl Kim
Joint learning of super-resolution (SR) and inverse tone-mapping (ITM) has been explored recently, to convert legacy low resolution (LR) standard dynamic range (SDR) videos to high…
S3: A Spectral-Spatial Structure Loss for Pan-Sharpening Networks
Jae-Seok Choi, Yongwoo Kim, Munchurl Kim
Recently, many deep-learning-based pan-sharpening methods have been proposed for generating high-quality pan-sharpened (PS) satellite images. These methods focused on various types…
Deep Predictive Video Compression with Bi-directional Prediction
Woonsung Park, Munchurl Kim
Recently, deep image compression has shown a big progress in terms of coding efficiency and image quality improvement. However, relatively less attention has been put on video comp…
Deep SR-ITM: Joint Learning of Super-Resolution and Inverse Tone-Mapping for 4K UHD HDR Applications
Soo Ye Kim, Jihyong Oh, Munchurl Kim
Recent modern displays are now able to render high dynamic range (HDR), high resolution (HR) videos of up to 8K UHD (Ultra High Definition). Consequently, UHD HDR broadcasting and…