462 citations · 629 across the 30 of their papers we have counts for
32 papers
MindWorldBench: Evaluating Mental-State-to-Behavior Reasoning in Image-to-Video Generation
Ruiqi Li, Xuanyi Liu, Sijia Li +9
Current image-to-video models achieve visual realism and physical plausibility, but reasoning about mental states remains unexplored. Actions are driven by belief, desire, and perc…
Overview of Cross-Component In-loop Filters in Video Coding Standards
Zhaoyu Li, Xuewei Meng, Jiaqi Zhang +4
In-loop filters have been comprehensively explored during the development of video coding standards due to their remarkable noise-reduction capability. In the early stage of video…
Optimized Adaptive Loop Filter in Versatile Video Coding
Xuewei Meng, Jiaqi Zhang, Chuanmin Jia +3
In the Versatile Video Coding~(VVC) standard, adaptive loop filter~(ALF), including Geometry transformation-based Adaptive Loop Filter~(GALF) and Cross Component Adaptive Loop Filt…
Spatio-Temporal Correlation Guided Geometric Partitioning for Versatile Video Coding
Xuewei Meng, Chuanmin Jia, Xinfeng Zhang +2
Geometric partitioning has attracted increasing attention by its remarkable motion field description capability in the hybrid video coding framework. However, the existing geometri…
Edge-directed geometric partitioning for versatile video coding
Xuewei Meng, Xinfeng Zhang, Chuanmin Jia +3
To improve the coding performance, geometric partition (GEO) was proposed for the upcoming VVC standard. GEO provides 140 partition candidates. The index of optimal GEO mode needs…
Deformable Wiener Filter for Future Video Coding
Xuewei Meng, Chuanmin Jia, Xinfeng Zhang +2
In-loop filters have attracted increasing attention due to the remarkable noise-reduction capability in the hybrid video coding framework. However, the existing in-loop filters in…
HGC-Avatar: Hierarchical Gaussian Compression for Streamable Dynamic 3D Avatars
Haocheng Tang, Ruoke Yan, Xinhui Yin +5
Recent advances in 3D Gaussian Splatting (3DGS) have enabled fast, photorealistic rendering of dynamic 3D scenes, showing strong potential in immersive communication. However, in d…
Enhanced Template-based Intra Mode Derivation with Adaptive Block Vector Replacement
Jiaqi Zhang, Jiaye Fu, Chuanmin Jia +5
Intra prediction is a crucial component in traditional video coding frameworks, aiming to eliminate spatial redundancy within frames. In recent years, an increasing number of decod…
MAFS: Masked Autoencoder for Infrared-Visible Image Fusion and Semantic Segmentation
Liying Wang, Xiaoli Zhang, Chuanmin Jia +1
Infrared-visible image fusion methods aim at generating fused images with good visual quality and also facilitate the performance of high-level tasks. Indeed, existing semantic-dri…
TinySplat: Feedforward Approach for Generating Compact 3D Scene Representation
Zetian Song, Jiaye Fu, Jiaqi Zhang +4
The recent development of feedforward 3D Gaussian Splatting (3DGS) presents a new paradigm to reconstruct 3D scenes. Using neural networks trained on large-scale multi-view dataset…
ProSplat: Improved Feed-Forward 3D Gaussian Splatting for Wide-Baseline Sparse Views
Xiaohan Lu, Jiaye Fu, Jiaqi Zhang +3
Feed-forward 3D Gaussian Splatting (3DGS) has recently demonstrated promising results for novel view synthesis (NVS) from sparse input views, particularly under narrow-baseline con…
Emerging Advances in Learned Video Compression: Models, Systems and Beyond
Chuanmin Jia, Feng Ye, Siwei Ma +3
Video compression is a fundamental topic in the visual intelligence, bridging visual signal sensing/capturing and high-level visual analytics. The broad success of artificial intel…
ShiftLIC: Lightweight Learned Image Compression with Spatial-Channel Shift Operations
Youneng Bao, Wen Tan, Chuanmin Jia +3
Learned Image Compression (LIC) has attracted considerable attention due to their outstanding rate-distortion (R-D) performance and flexibility. However, the substantial computatio…
A Joint Visual Compression and Perception Framework for Neuralmorphic Spiking Camera
Kexiang Feng, Chuanmin Jia, Siwei Ma +1
The advent of neuralmorphic spike cameras has garnered significant attention for their ability to capture continuous motion with unparalleled temporal resolution.However, this imag…
Advanced Learning-Based Inter Prediction for Future Video Coding
Yanchen Zhao, Wenhong Duan, Chuanmin Jia +2
In the fourth generation Audio Video coding Standard (AVS4), the Inter Prediction Filter (INTERPF) reduces discontinuities between prediction and adjacent reconstructed pixels in i…
Rethinking Bjøntegaard Delta for Compression Efficiency Evaluation: Are We Calculating It Precisely and Reliably?
Xinyu Hang, Shenpeng Song, Zhimeng Huang +3
For decades, the Bjøntegaard Delta (BD) has been the metric for evaluating codec Rate-Distortion (R-D) performance. Yet, in most studies, BD is determined using just 4-5 R-D data p…
A Neural-network Enhanced Video Coding Framework beyond ECM
Yanchen Zhao, Wenxuan He, Chuanmin Jia +7
In this paper, a hybrid video compression framework is proposed that serves as a demonstrative showcase of deep learning-based approaches extending beyond the confines of tradition…
MPAI-EEV: Standardization Efforts of Artificial Intelligence based End-to-End Video Coding
Chuanmin Jia, Feng Ye, Fanke Dong +5
The rapid advancement of artificial intelligence (AI) technology has led to the prioritization of standardizing the processing, coding, and transmission of video using neural netwo…
SpikeCodec: An End-to-end Learned Compression Framework for Spiking Camera
Kexiang Feng, Chuanmin Jia, Siwei Ma +1
Recently, the bio-inspired spike camera with continuous motion recording capability has attracted tremendous attention due to its ultra high temporal resolution imaging characteris…
Machine Perception-Driven Image Compression: A Layered Generative Approach
Yuefeng Zhang, Chuanmin Jia, Jiannhui Chang +1
In this age of information, images are a critical medium for storing and transmitting information. With the rapid growth of image data amount, visual compression and visual data pe…
Learning to Compress Unmanned Aerial Vehicle (UAV) Captured Video: Benchmark and Analysis
Chuanmin Jia, Feng Ye, Huifang Sun +2
During the past decade, the Unmanned-Aerial-Vehicles (UAVs) have attracted increasing attention due to their flexible, extensive, and dynamic space-sensing capabilities. The volume…
Perceptual Video Coding for Machines via Satisfied Machine Ratio Modeling
Qi Zhang, Shanshe Wang, Xinfeng Zhang +4
Video Coding for Machines (VCM) aims to compress visual signals for machine analysis. However, existing methods only consider a few machines, neglecting the majority. Moreover, the…
Cross Modal Compression: Towards Human-comprehensible Semantic Compression
Jiguo Li, Chuanmin Jia, Xinfeng Zhang +2
Traditional image/video compression aims to reduce the transmission/storage cost with signal fidelity as high as possible. However, with the increasing demand for machine analysis…
Rate Distortion Characteristic Modeling for Neural Image Compression
Chuanmin Jia, Ziqing Ge, Shanshe Wang +2
End-to-end optimized neural image compression (NIC) has obtained superior lossy compression performance recently. In this paper, we consider the problem of rate-distortion (R-D) ch…