5 papers
PIVOT: Pivot-Aware On Policy Self Distillation for Multi-Turn VLM Agents
Jiazhou Zhou, Hu Zhou, Yucheng Chen +3
Reinforcement learning with verifiable rewards (RLVR) via Group-Relative Policy Optimization (GRPO) is widely used for multi-turn VLM agent training, yet it suffers from zero-gradi…
SegVGGT: Joint 3D Reconstruction and Instance Segmentation from Multi-View Images
Jinyuan Qu, Hongyang Li, Lei Zhang
3D instance segmentation methods typically rely on high-quality point clouds or posed RGB-D scans, requiring complex multi-stage processing pipelines, and are highly sensitive to r…
OVSeg3R: Learn Open-vocabulary Instance Segmentation from 2D via 3D Reconstruction
Hongyang Li, Jinyuan Qu, Lei Zhang
In this paper, we propose a training scheme called OVSeg3R to learn open-vocabulary 3D instance segmentation from well-studied 2D perception models with the aid of 3D reconstructio…
SegDINO3D: 3D Instance Segmentation Empowered by Both Image-Level and Object-Level 2D Features
Jinyuan Qu, Hongyang Li, Xingyu Chen +5
In this paper, we present SegDINO3D, a novel Transformer encoder-decoder framework for 3D instance segmentation. As 3D training data is generally not as sufficient as 2D training i…
TAPTRv3: Spatial and Temporal Context Foster Robust Tracking of Any Point in Long Video
Jinyuan Qu, Hongyang Li, Shilong Liu +3
In this paper, built upon TAPTRv2, we present TAPTRv3. TAPTRv2 is a simple yet effective DETR-like point tracking framework that works fine in regular videos but tends to fail in l…