382 citations · 399 across the 12 of their papers we have counts for
13 papers
dRAE: Representation Autoencoder with Hyper-Spherical Codes
Tianren Ma, Lin Long, Chuyan Chen +4
In this work, we aim to discretize the high-dimensional visual representations to bridge the gap with language models - a non-trivial challenge, as existing quantization methods su…
AceTone: Bridging Words and Colors for Conditional Image Grading
Tianren Ma, Mingxiang Liao, Xijin Zhang +1
Color affects how we interpret image style and emotion. Previous color grading methods rely on patch-wise recoloring or fixed filter banks, struggling to generalize across creative…
LongVideo-R1: Smart Navigation for Low-cost Long Video Understanding
Jihao Qiu, Lingxi Xie, Xinyue Huo +2
This paper addresses the critical and underexplored challenge of long video understanding with low computational budgets. We propose LongVideo-R1, an active, reasoning-equipped mul…
ReDDiT: Rehashing Noise for Discrete Visual Generation
Tianren Ma, Xiaosong Zhang, Boyu Yang +2
In the visual generative area, discrete diffusion models are gaining traction for their efficiency and compatibility. However, pioneered attempts still fall behind their continuous…
Adaptive Keyframe Sampling for Long Video Understanding
Xi Tang, Jihao Qiu, Lingxi Xie +3
Multimodal large language models (MLLMs) have enabled open-world visual understanding by injecting visual input as extra tokens into large language models (LLMs) as contexts. Howev…
YOLOv12: Attention-Centric Real-Time Object Detectors
Yunjie Tian, Qixiang Ye, David Doermann
Enhancing the network architecture of the YOLO framework has been crucial for a long time, but has focused on CNN-based improvements despite the proven superiority of attention mec…
ClawMachine: Learning to Fetch Visual Tokens for Referential Comprehension
Tianren Ma, Lingxi Xie, Yunjie Tian +2
Aligning vision and language concepts at a finer level remains an essential topic of multimodal large language models (MLLMs), particularly for tasks such as referring and groundin…
Artemis: Towards Referential Understanding in Complex Videos
Jihao Qiu, Yuan Zhang, Xi Tang +6
Videos carry rich visual information including object description, action, interaction, etc., but the existing multimodal large language models (MLLMs) fell short in referential un…
Building Vision Models upon Heat Conduction
Zhaozhi Wang, Yue Liu, Yunjie Tian +3
Visual representation models leveraging attention mechanisms are challenged by significant computational overhead, particularly when pursuing large receptive fields. In this study,…
Virtual Classification: Modulating Domain-Specific Knowledge for Multidomain Crowd Counting
Mingyue Guo, Binghui Chen, Zhaoyi Yan +2
Multidomain crowd counting aims to learn a general model for multiple diverse datasets. However, deep networks prefer modeling distributions of the dominant domains instead of all…
ChatterBox: Multi-round Multimodal Referring and Grounding
Yunjie Tian, Tianren Ma, Lingxi Xie +6
In this study, we establish a baseline for a new task named multimodal multi-round referring and grounding (MRG), opening up a promising direction for instance-level multimodal dia…
VMamba: Visual State Space Model
Yue Liu, Yunjie Tian, Yuzhong Zhao +6
Designing computationally efficient network architectures remains an ongoing necessity in computer vision. In this paper, we adapt Mamba, a state-space language model, into VMamba,…
Fast-iTPN: Integrally Pre-Trained Transformer Pyramid Network with Token Migration
Yunjie Tian, Lingxi Xie, Jihao Qiu +4
We propose integrally pre-trained transformer pyramid network (iTPN), towards jointly optimizing the network backbone and the neck, so that transfer gap between representation mode…