2 citations · 2 across the 29 of their papers we have counts for
12 papers · 1 filter
ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery
Yufei Liu, Xixi Wang, Hao Li +8
Egocentric video offers scalable manipulation data for embodied AI, yet recovering metric 3D hand trajectories remains challenging due to severe object occlusion and frequent out-o…
Process-of-Thought Reasoning for Videos
Jusheng Zhang, Kaitong Cai, Jian Wang +3
Video understanding requires not only recognizing visual content but also performing temporally grounded, multi-step reasoning over long and noisy observations. We propose Process-…
Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domains
Jesen Zhang, Ningyuan Liu, Kaitong Cai +5
Multimodal LLMs often produce fluent yet unreliable reasoning, exhibiting weak step-to-step coherence and insufficient visual grounding, largely because existing alignment approach…
CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation
Qinglin Zeng, Kaitong Cai, Ruiqi Chen +2
Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independentl…
FlashVLM: Text-Guided Visual Token Selection for Large Multimodal Models
Kaitong Cai, Jusheng Zhang, Jing Yang +4
Large vision-language models (VLMs) typically process hundreds or thousands of visual tokens per image or video frame, incurring quadratic attention cost and substantial redundancy…
SirenPose: Dynamic Scene Reconstruction via Geometric Supervision
Kaitong Cai, Jensen Zhang, Jing Yang +1
We introduce SirenPose, a geometry-aware loss formulation that integrates the periodic activation properties of sinusoidal representation networks with keypoint-based geometric sup…
PTTA: A Pure Text-to-Animation Framework for High-Quality Creation
Ruiqi Chen, Kaitong Cai, Yijia Fan +1
Traditional animation production involves complex pipelines and significant manual labor cost. While recent video generation models such as Sora, Kling, and CogVideoX achieve impre…
MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models
Jusheng Zhang, Kaitong Cai, Xiaoyang Guo +10
The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critica…
Hybrid Token Compression for Vision-Language Models
Jusheng Zhang, Xiaoyang Guo, Tongyu Mo +5
Vision-language models (VLMs) rely on hundreds of visual tokens, leading to high computational and memory costs. Existing compression methods face a trade-off: continuous compressi…
3DAlign-DAER: Dynamic Attention Policy and Efficient Retrieval Strategy for Fine-grained 3D-Text Alignment at Scale
Yijia Fan, Jusheng Zhang, Kaitong Cai +3
Despite recent advancements in 3D-text cross-modal alignment, existing state-of-the-art methods still struggle to align fine-grained textual semantics with detailed geometric struc…
MAT-Agent: Adaptive Multi-Agent Training Optimization
Jusheng Zhang, Kaitong Cai, Yijia Fan +2
Multi-label image classification demands adaptive training strategies to navigate complex, evolving visual-semantic landscapes, yet conventional methods rely on static configuratio…
Top-Down Semantic Refinement for Image Captioning
Jusheng Zhang, Kaitong Cai, Jing Yang +3
Large Vision-Language Models (VLMs) face an inherent contradiction in image captioning: their powerful single-step generation capabilities often lead to a myopic decision-making pr…