10 papers
HybridPrompt: Bridging Generative Priors and Traditional Codecs for Mobile Streaming
Liming Liu, Jiangkai Wu, Haoyang Wang +3
In Video on Demand (VoD) scenarios, traditional codecs are the industry standard due to their high decoding efficiency. However, they suffer from severe quality degradation under l…
Artic: AI-oriented Real-time Communication for MLLM Video Assistant
Jiangkai Wu, Zhiyuan Ren, Junquan Zhong +2
AI Video Assistant emerges as a new paradigm for Real-time Communication (RTC), where one peer is a Multimodal Large Language Model (MLLM) deployed in the cloud. This makes interac…
MalMoE: Mixture-of-Experts Enhanced Encrypted Malicious Traffic Detection Under Graph Drift
Yunpeng Tan, Qingyang Li, Mingxin Yang +3
Encryption has been commonly used in network traffic to secure transmission, but it also brings challenges for malicious traffic detection, due to the invisibility of the packet pa…
Camel: Frame-Level Bandwidth Estimation for Low-Latency Live Streaming under Video Bitrate Undershooting
Liming Liu, Zhidong Jia, Li Jiang +10
Low-latency live streaming (LLS) has emerged as a popular web application, with many platforms adopting real-time protocols such as WebRTC to minimize end-to-end latency. However,…
Smaller is Better: Generative Models Can Power Short Video Preloading
Liming Liu, Jiangkai Wu, Xinggong Zhang
Preloading is widely used in short video platforms to minimize playback stalls by downloading future content in advance. However, existing strategies face a tradeoff. Aggressive pr…
Morphe: High-Fidelity Generative Video Streaming with Vision Foundation Model
Tianyi Gong, Zijian Cao, Zixing Zhang +4
Video streaming is a fundamental Internet service, while the quality still cannot be guaranteed especially in poor network conditions such as bandwidth-constrained and remote areas…
Chat with AI: The Surprising Turn of Real-time Video Communication from Human to AI
Jiangkai Wu, Zhiyuan Ren, Liming Liu +1
AI Video Chat emerges as a new paradigm for Real-time Communication (RTC), where one peer is not a human, but a Multimodal Large Language Model (MLLM). This makes interaction betwe…
GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting
Junlin Hao, Peiheng Wang, Haoyang Wang +2
Single-image 3D scene reconstruction presents significant challenges due to its inherently ill-posed nature and limited input constraints. Recent advances have explored two promisi…
MCBlock: Boosting Neural Radiance Field Training Speed by MCTS-based Dynamic-Resolution Ray Sampling
Yunpeng Tan, Junlin Hao, Jiangkai Wu +3
Neural Radiance Field (NeRF) is widely known for high-fidelity novel view synthesis. However, even the state-of-the-art NeRF model, Gaussian Splatting, requires minutes for trainin…
R-Meshfusion: Reinforcement Learning Powered Sparse-View Mesh Reconstruction with Diffusion Priors
Haoyang Wang, Liming Liu, Peiheng Wang +3
Mesh reconstruction from multi-view images is a fundamental problem in computer vision, but its performance degrades significantly under sparse-view conditions, especially in unsee…