15 papers
Outcome-Guided On-Policy Self-Distillation
ZheXu Wang, Mao-Lin Luo, Yankun Hong +6
On-policy self-distillation (OPSD) provides denser token-level supervision and better computational efficiency than Reinforcement Learning with Verifiable Rewards (RLVR). However,…
Learning Process Rewards via Reasoning State Propagation
Kai Gan, Zi-Hao Zhou, Bo Ye +3
Process reward models (PRMs) have demonstrated notable effectiveness in test-time scaling and reinforcement learning by providing fine-grained signals for evaluating intermediate r…
RL Forgets! Towards Continual Policy Optimization
Mao-Lin Luo, Zhe-Xu Wang, Zi-Hao Zhou +4
Continual post-training is becoming a central paradigm for adapting vision-language models to evolving tasks. Recent studies report that reinforcement learning is less prone to for…
TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction
Weijie Wang, Zimu Li, Jinchuan Shi +5
Sparse-view 3D reconstruction is increasingly addressed with feed-forward splatting networks that predict explicit primitives directly from images. Yet most existing methods remain…
TIE: Time Interval Encoding for Video Generation over Events
Zhilei Shu, Shangwen Zhu, Zihang Liang +10
Director-style prompting, robotic action prediction, and interactive video agents demand temporal grounding over concurrent events -- a regime in which 68% of general clips and ove…
Sparsity Hurts: Simple Linear Adapter Can Boost Generalized Category Discovery
Bo Ye, Kai Gan, Tong Wei +1
Generalized Category Discovery (GCD) seeks to identify novel categories from unlabeled data while retaining the classification ability of seen categories. Prior GCD methods commonl…
DySink: Dynamic Frame Sinks for Autoregressive Long Video Generation
Bo Ye, Xinyu Cui, Jian Zhao +2
Autoregressive long video generation often adopts bounded-memory streaming for efficiency, typically combining local windows for short-term continuity with static early-frame sinks…
Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Joints
Chenyangguang Zhang, Botao Ye, Boqi Chen +4
Controllable video generation for complex hand-object interactions is a critical step toward building visual world models. However, existing methods often struggle to achieve fine-…
ReCoSplat: Online Feed-Forward Gaussian Splatting via Render-and-Compare
Freeman Cheng, Botao Ye, Xueting Li +3
Online novel view synthesis requires a model to reconstruct a scene causally from a stream of observations while keeping it renderable at every moment. We present ReCoSplat, an onl…
YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting
Botao Ye, Boqi Chen, Haofei Xu +2
Fast and flexible 3D scene reconstruction from unstructured image collections remains a significant challenge. We present YoNoSplat, a feedforward model that reconstructs high-qual…
HoliGS: Holistic Gaussian Splatting for Embodied View Synthesis
Xiaoyuan Wang, Yizhou Zhao, Botao Ye +6
We propose HoliGS, a novel deformable Gaussian splatting framework that addresses embodied view synthesis from long monocular RGB videos. Unlike prior 4D Gaussian splatting and dyn…
Window Token Concatenation for Efficient Visual Large Language Models
Yifan Li, Wentao Bao, Botao Ye +4
To effectively reduce the visual tokens in Visual Large Language Models (VLLMs), we propose a novel approach called Window Token Concatenation (WiCo). Specifically, we employ a sli…
Synthesizing Consistent Novel Views via 3D Epipolar Attention without Re-Training
Botao Ye, Sifei Liu, Xueting Li +2
Large diffusion models demonstrate remarkable zero-shot capabilities in novel view synthesis from a single image. However, these models often face challenges in maintaining consist…
GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Control
Mariam Hassan, Sebastian Stapf, Ahmad Rahimi +17
We present GEM, a Generalizable Ego-vision Multimodal world model that predicts future frames using a reference frame, sparse features, human poses, and ego-trajectories. Hence, ou…
No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images
Botao Ye, Sifei Liu, Haofei Xu +4
We introduce NoPoSplat, a feed-forward model capable of reconstructing 3D scenes parameterized by 3D Gaussians from \textit{unposed} sparse multi-view images. Our model, trained ex…