Publications (23)
Deep Probabilistic Unfolding for Quantized Compressive Sensing
Gang Qu, Ping Wang, Siming Zheng +1
We propose a deep probabilistic unfolding model to address the classical quantized compressive sensing problem that leverages an unfolding framework to enhance the reconstruction a…
RED: Robust Event-Guided Motion Deblurring with Modality-Specific Disentanglement
Yihong Leng, Siming Zheng, Jinwei Chen +3
Event-guided motion deblurring reconstructs sharp images using the high-temporal-resolution motion cues from event cameras. However, in real capture, thresholding-induced event und…
Two-Stage is Enough: A Concise Deep Unfolding Reconstruction Network for Flexible Video Compressive Sensing
Siming Zheng, Xiaoyu Yang, Xin Yuan
We consider the reconstruction problem of video compressive sensing (VCS) under the deep unfolding/rolling structure. Yet, we aim to build a flexible and concise model using minimu…
Sparse Transformer for Ultra-sparse Sampled Video Compressive Sensing
Miao Cao, Siming Zheng, Lishun Wang +3
Digital cameras consume ~0.1 microjoule per pixel to capture and encode video, resulting in a power usage of ~20W for a 4K sensor operating at 30 fps. Imagining gigapixel cameras o…
A Conditional Distribution Equality Testing Framework using Deep Generative Learning
Siming Zheng, Tong Wang, Meifang Lan +1
In this paper, we propose a general framework for testing the conditional distribution equality in a two-sample problem, which is most relevant to covariate shift and causal discov…
Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imaging
Siming Zheng, Xin Yuan
We consider the problem of video snapshot compressive imaging (SCI), where sequential high-speed frames are modulated by different masks and captured by a single measurement. The u…
Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modeling
Yuan Wang, Yuhao Wan, Siming Zheng +3
Recent works have explored reference-based super-resolution (RefSR) to mitigate hallucinations in diffusion-based image restoration. A key challenge is that real-world degradations…
SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing
Ying Zeng, Miaosen Luo, Guangyuan Li +10
Traditional photographic image editing typically requires users to possess sufficient aesthetic understanding to provide appropriate instructions for adjusting image quality and ca…
Learning scale-variant features for robust iris authentication with deep learning based ensemble framework
Siming Zheng, Rahmita Wirza O. K. Rahmat, Fatimah Khalid +1
In recent years, mobile Internet has accelerated the proliferation of smart mobile development. The mobile payment, mobile security and privacy protection have become the focus of…
Photography Perspective Composition: Towards Aesthetic Perspective Recommendation
Lujian Yao, Siming Zheng, Xinbin Yuan +5
Traditional photography composition approaches are dominated by 2D cropping-based methods. However, these methods fall short when scenes contain poorly arranged subjects. Professio…
Realism Control One-step Diffusion for Real-World Image Super-Resolution
Zongliang Wu, Siming Zheng, Peng-Tao Jiang +1
Pre-trained diffusion models have shown great potential in real-world image super-resolution (Real-ISR) tasks by enabling high-resolution reconstructions. While one-step diffusion…
Any-to-Bokeh: Arbitrary-Subject Video Refocusing with Video Diffusion Model
Yang Yang, Siming Zheng, Qirui Yang +6
Diffusion models have recently emerged as powerful tools for camera simulation, enabling both geometric transformations and realistic optical effects. Among these, image-based boke…
Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platforms
Siming Zheng, Yujia Xue, Waleed Tahir +6
We consider the image and video compression on resource limited platforms. An ultra low-cost image encoder, named Block Modulating Video Compression (BMVC) with an encoding complex…
Deep Sufficient Representation Learning via Mutual Information
Siming Zheng, Yuanyuan Lin, Jian Huang
We propose a mutual information-based sufficient representation learning (MSRL) approach, which uses the variational formulation of the mutual information and leverages the approxi…
Deep Equilibrium Models for Video Snapshot Compressive Imaging
Yaping Zhao, Siming Zheng, Xin Yuan
The ability of snapshot compressive imaging (SCI) systems to efficiently capture high-dimensional (HD) data has led to an inverse problem, which consists of recovering the HD signa…
A Multi-View Consistency Framework with Semi-Supervised Domain Adaptation
Yuting Hong, Li Dong, Xiaojie Qiu +4
Semi-Supervised Domain Adaptation (SSDA) leverages knowledge from a fully labeled source domain to classify data in a partially labeled target domain. Due to the limited number of…
HyperMotionX: The Dataset and Benchmark with DiT-Based Pose-Guided Human Image Animation of Complex Motions
Shuolin Xu, Siming Zheng, Ziyi Wang +7
Recent advances in diffusion models have significantly improved conditional video generation, particularly in the pose-guided human image animation task. Although existing methods…
MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer
Ziyi Wang, Siming Zheng, Yang Yang +5
Makeup-transfer applies the reference makeup to the source face while preserving the source identity. Despite advances in full-face editing by diffusion-based methods, strong regio…
Towards Photorealistic and Efficient Bokeh Rendering via Diffusion Framework
Linxiao Shi, Siming Zheng, Zerong Wang +5
Existing mobile devices are constrained by compact optical designs, such as small apertures, which make it difficult to produce natural, optically realistic bokeh effects. Although…
MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on
Guangyuan Li, Siming Zheng, Hao Zhang +6
Video Virtual Try-On (VVT) aims to synthesize garments that appear natural across consecutive video frames, capturing both their dynamics and interactions with human motion. Despit…
Transformer-Enhanced Variational Autoencoder for Crystal Structure Prediction
Ziyi Chen, Yang Yuan, Siming Zheng +4
Crystal structure forms the foundation for understanding the physical and chemical properties of materials. Generative models have emerged as a new paradigm in crystal structure pr…
Physics-guided Deep Unfolding Network for Enhanced Kronecker Compressive sensing
Gang Qu, Ping Wang, Siming Zheng +1
Deep networks have achieved remarkable success in image compressed sensing (CS) task, namely reconstructing a high-fidelity image from its compressed measurement. However, existing…
Addressing the Accuracy-Cost Tradeoff in Material Property Prediction: A Teacher-Student Strategy
Dong Zhu, Zhikuang xin, Siming Zheng +2
Deep learning has revolutionized the process of new material discovery, with state-of-the-art models now able to predict material properties based solely on chemical compositions,…