5 citations · 20 across the 22 of their papers we have counts for
23 papers
Color Pass-Through via Camera-Display Coupling
Ruikang Li, Molin Li, Jiarui Wu +3
When a real-world scene is captured by a smartphone camera and viewed on its screen, the displayed image often differs noticeably from the original scene in color, brightness, and…
Scaling Parallel Sequence Models to Foundation-Scale Vision Encoders
Yitong Jiang, Hongjun Wang, Collin McCarthy +15
Vision foundation models are bottlenecked by the quadratic cost of self-attention, which limits usable resolution and increases the cost of large-scale pretraining. Subquadratic al…
CubeComposer: Spatio-Temporal Autoregressive 4K 360° Video Generation from Perspective Video
Lingen Li, Guangzhi Wang, Xiaoyu Li +5
Generating high-quality 360° panoramic videos from perspective input is one of the crucial applications for virtual reality (VR), whereby high-resolution videos are especially impo…
AdaptiveAE: An Adaptive Exposure Strategy for HDR Capturing in Dynamic Scenes
Tianyi Xu, Fan Zhang, Boxin Shi +2
Mainstream high dynamic range imaging techniques typically rely on fusing multiple images captured with different exposure setups (shutter speed and ISO). A good balance between sh…
ToonComposer: Streamlining Cartoon Production with Generative Post-Keyframing
Lingen Li, Guangzhi Wang, Zhaoyang Zhang +6
Traditional cartoon and anime production involves keyframing, inbetweening, and colorization stages, which require intensive manual effort. Despite recent advances in AI, existing…
4DSloMo: 4D Reconstruction for High Speed Scene with Asynchronous Capture
Yutian Chen, Shi Guo, Tianshuo Yang +4
Reconstructing fast-dynamic scenes from multi-view videos is crucial for high-speed motion analysis and realistic 4D reconstruction. However, the majority of 4D capture systems are…
S2R-HDR: A Large-Scale Rendered Dataset for HDR Fusion
Yujin Wang, Jiarui Wu, Yichen Bian +2
The generalization of learning-based high dynamic range (HDR) fusion is often limited by the availability of training data, as collecting large-scale HDR images from dynamic scenes…
EGVD: Event-Guided Video Diffusion Model for Physically Realistic Large-Motion Frame Interpolation
Ziran Zhang, Xiaohui Li, Yihao Liu +4
Video frame interpolation (VFI) in scenarios with large motion remains challenging due to motion ambiguity between frames. While event cameras can capture high temporal resolution…
PolarFree: Polarization-based Reflection-free Imaging
Mingde Yao, Menglu Wang, King-Man Tam +3
Reflection removal is challenging due to complex light interactions, where reflections obscure important details and hinder scene understanding. Polarization naturally provides a p…
Goal Conditioned Reinforcement Learning for Photo Finishing Tuning
Jiarui Wu, Yujin Wang, Lingen Li +2
Photo finishing tuning aims to automate the manual tuning process of the photo finishing pipeline, like Adobe Lightroom or Darktable. Previous works either use zeroth-order optimiz…
A Physics-Informed Blur Learning Framework for Imaging Systems
Liqun Chen, Yuxuan Li, Jun Dai +2
Accurate blur estimation is essential for high-performance imaging across various applications. Blur is typically represented by the point spread function (PSF). In this paper, we…
Tolerance-Aware Deep Optics
Jun Dai, Liqun Chen, Xinge Yang +3
Deep optics has emerged as a promising approach by co-designing optical elements with deep learning algorithms. However, current research typically overlooks the analysis and optim…
Event-assisted 12-stop HDR Imaging of Dynamic Scene
Shi Guo, Zixuan Chen, Ziran Zhang +3
High dynamic range (HDR) imaging is a crucial task in computational photography, which captures details across diverse lighting conditions. Traditional HDR fusion methods face limi…
NVComposer: Boosting Generative Novel View Synthesis with Multiple Sparse and Unposed Images
Lingen Li, Zhaoyang Zhang, Yaowei Li +7
Recent advancements in generative models have significantly improved novel view synthesis (NVS) from multi-view data. However, existing methods depend on external multi-view alignm…
AdaptiveISP: Learning an Adaptive Image Signal Processor for Object Detection
Yujin Wang, Tianyi Xu, Fan Zhang +2
Image Signal Processors (ISPs) convert raw sensor signals into digital images, which significantly influence the image quality and the performance of downstream computer vision tas…
DualDn: Dual-domain Denoising via Differentiable ISP
Ruikang Li, Yujin Wang, Shiqi Chen +3
Image denoising is a critical component in a camera's Image Signal Processing (ISP) pipeline. There are two typical ways to inject a denoiser into the ISP pipeline: applying a deno…
LenslessFace: An End-to-End Optimized Lensless System for Privacy-Preserving Face Verification
Xin Cai, Hailong Zhang, Chenchen Wang +3
Lensless cameras, innovatively replacing traditional lenses for ultra-thin, flat optics, encode light directly onto sensors, producing images that are not immediately recognizable.…
From Sim-to-Real: Toward General Event-based Low-light Frame Interpolation with Per-scene Optimization
Ziran Zhang, Yongrui Ma, Yueting Chen +4
Video Frame Interpolation (VFI) is important for video enhancement, frame rate up-conversion, and slow-motion generation. The introduction of event cameras, which capture per-pixel…
Uni-ISP: Toward Unifying the Learning of ISPs from Multiple Mobile Cameras
Lingen Li, Mingde Yao, Xingyu Meng +3
Modern end-to-end image signal processors (ISPs) can learn complex mappings from RAW/XYZ data to sRGB (and vice versa), opening new possibilities in image processing. However, the…
HDRFlow: Real-Time HDR Video Reconstruction with Large Motions
Gangwei Xu, Yujin Wang, Jinwei Gu +2
Reconstructing High Dynamic Range (HDR) video from image sequences captured with alternating exposures is challenging, especially in the presence of large camera or object motion.…
Event-Based Motion Magnification
Yutian Chen, Shi Guo, Fangzheng Yu +3
Detecting and magnifying imperceptible high-frequency motions in real-world scenarios has substantial implications for industrial and medical applications. These motions are charac…
AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion
Yitong Jiang, Zhaoyang Zhang, Tianfan Xue +1
We present AutoDIR, an innovative all-in-one image restoration system incorporating latent diffusion. AutoDIR excels in its ability to automatically identify and restore images suf…
Reconstruct-and-Generate Diffusion Model for Detail-Preserving Image Denoising
Yujin Wang, Lingen Li, Tianfan Xue +1
Image denoising is a fundamental and challenging task in the field of computer vision. Most supervised denoising methods learn to reconstruct clean images from noisy inputs, which…