6 citations · 13 across the 17 of their papers we have counts for
17 papers
OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention
Zhangquan Chen, Jiale Tao, Ruihuang Li +10
While humans perceive the world through diverse modalities that operate synergistically to support a holistic understanding of their surroundings, existing omnivideo models still f…
RISE-T2V: Rephrasing and Injecting Semantics with LLM for Expansive Text-to-Video Generation
Xiangjun Zhang, Litong Gong, Yinglin Zheng +6
Most text-to-video(T2V) diffusion models depend on pre-trained text encoders for semantic alignment, yet they often fail to maintain video quality when provided with concise prompt…
VC4VG: Optimizing Video Captions for Text-to-Video Generation
Yang Du, Zhuoran Lin, Kaiqiang Song +5
Recent advances in text-to-video (T2V) generation highlight the critical role of high-quality video-text pairs in training models capable of producing coherent and instruction-alig…
R1-Track: Direct Application of MLLMs to Visual Object Tracking via Reinforcement Learning
Biao Wang, Wenwen Li, Jiawei Ge
Visual single object tracking aims to continuously localize and estimate the scale of a target in subsequent video frames, given only its initial state in the first frame. This tas…
Enhancing Taobao Display Advertising with Multimodal Representations: Challenges, Approaches and Insights
Xiang-Rong Sheng, Feifan Yang, Litong Gong +10
Despite the recognized potential of multimodal data to improve model accuracy, many large-scale industrial recommendation systems, including Taobao display advertising system, pred…
Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline
Dingyi Yang, Chunru Zhan, Ziheng Wang +4
Video storytelling is engaging multimedia content that utilizes video and its accompanying narration to attract the audience, where a key challenge is creating narrations for recor…
Tuning-Free Noise Rectification for High Fidelity Image-to-Video Generation
Weijie Li, Litong Gong, Yiran Zhu +4
Image-to-video (I2V) generation tasks always suffer from keeping high fidelity in the open domains. Traditional image animation techniques primarily focus on specific domains such…
AtomoVideo: High Fidelity Image-to-Video Generation
Litong Gong, Yiran Zhu, Weijie Li +4
Recently, video generation has achieved significant rapid development based on superior text-to-image generation techniques. In this work, we propose a high fidelity framework for…
Hierarchical Masked 3D Diffusion Model for Video Outpainting
Fanda Fan, Chaoxu Guo, Litong Gong +5
Video outpainting aims to adequately complete missing areas at the edges of video frames. Compared to image outpainting, it presents an additional challenge as the model should mai…
Video Object of Interest Segmentation
Siyuan Zhou, Chunru Zhan, Biao Wang +3
In this work, we present a new computer vision task named video object of interest segmentation (VOIS). Given a video and a target image of interest, our objective is to simultaneo…
Motion and Appearance Adaptation for Cross-Domain Motion Transfer
Borun Xu, Biao Wang, Jinhong Deng +5
Motion transfer aims to transfer the motion of a driving video to a source image. When there are considerable differences between object in the driving video and that in the source…
Motion Transformer for Unsupervised Image Animation
Jiale Tao, Biao Wang, Tiezheng Ge +3
Image animation aims to animate a source image by using motion learned from a driving video. Current state-of-the-art methods typically use convolutional neural networks (CNNs) to…
Spatio-Temporal Relation Learning for Video Anomaly Detection
Hui Lv, Zhen Cui, Biao Wang +1
Anomaly identification is highly dependent on the relationship between the object and the scene, as different/same object actions in same/different scenes may lead to various degre…
Structure-Aware Motion Transfer with Deformable Anchor Model
Jiale Tao, Biao Wang, Borun Xu +4
Given a source image and a driving video depicting the same object type, the motion transfer task aims to generate a video by learning the motion from the driving video while prese…
Learning Pixel-Level Distinctions for Video Highlight Detection
Fanyue Wei, Biao Wang, Tiezheng Ge +3
The goal of video highlight detection is to select the most attractive segments from a long video to depict the most interesting parts of the video. Existing methods typically focu…
Estimation of Reliable Proposal Quality for Temporal Action Detection
Junshan Hu, Chaoxu guo, Liansheng Zhuang +4
Temporal action detection (TAD) aims to locate and recognize the actions in an untrimmed video. Anchor-free methods have made remarkable progress which mainly formulate TAD into tw…
Move As You Like: Image Animation in E-Commerce Scenario
Borun Xu, Biao Wang, Jiale Tao +4
Creative image animations are attractive in e-commerce applications, where motion transfer is one of the import ways to generate animations from static images. However, existing me…