18 citations · 20 across the 19 of their papers we have counts for
22 papers
Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models
Yiyang Huang, Zhaowen Wang, Simon Jenni +4
Layout understanding, or the interpretation of element organization, is essential for document analysis, user interface (UI) creation, and graphic design. While recent vision-langu…
Post-Training in End-to-End Autonomous Driving
Ruining Yang, Muxing Wang, Yixiao Chen +8
End-to-end models that map multimodal inputs directly to future trajectories/maneuvers have emerged as an increasingly prominent research paradigm in autonomous driving. This class…
Distorted or Fabricated? A Survey on Hallucination in Video LLMs
Yiyang Huang, Yitian Zhang, Yizhou Wang +4
Despite significant progress in video-language modeling, hallucinations remain a persistent challenge in Video Large Language Models (Vid-LLMs), referring to outputs that appear pl…
The Indra Representation Hypothesis for Multimodal Alignment
Jianglin Lu, Hailing Wang, Kuo Yang +3
Recent studies have uncovered an interesting phenomenon: unimodal foundation models tend to learn convergent representations, regardless of differences in architecture, training ob…
Ref-Adv: Exploring MLLM Visual Reasoning in Referring Expression Tasks
Qihua Dong, Kuo Yang, Lin Ju +6
Referring Expression Comprehension (REC) links language to region level visual perception. Standard benchmarks (RefCOCO, RefCOCO+, RefCOCOg) have progressed rapidly with multimodal…
Fine-T2I: An Open, Large-Scale, and Diverse Dataset for High-Quality T2I Fine-Tuning
Xu Ma, Yitian Zhang, Qihua Dong +1
High-quality and open datasets remain a major bottleneck for text-to-image (T2I) fine-tuning. Despite rapid progress in model architectures and training pipelines, most publicly av…
Any Orthogonal Transform Will Do: Range Reduction Explains Rotation-Based Quantization for Super-Resolution
Dorsa Zeinali, Hailing Wang, Yitian Zhang +1
Rotation-based quantization -- multiplying weights and activations by a Hadamard matrix before quantizing -- is now standard, but why it works is explained informally, via incohere…
Outlier-Aware Post-Training Quantization for Image Super-Resolution
Hailing Wang, jianglin Lu, Yitian Zhang +1
Quantization techniques, including quantization-aware training (QAT) and post-training quantization (PTQ), have become essential for inference acceleration of image super-resolutio…
SHIELD: Suppressing Hallucinations In LVLM Encoders via Bias and Vulnerability Defense
Yiyang Huang, Liang Shi, Yitian Zhang +2
Large Vision-Language Models (LVLMs) excel in diverse cross-modal tasks. However, object hallucination, where models produce plausible but inaccurate object descriptions, remains a…
MTS-DMAE: Dual-Masked Autoencoder for Unsupervised Multivariate Time Series Representation Learning
Yi Xu, Yitian Zhang, Yun Fu
Unsupervised multivariate time series (MTS) representation learning aims to extract compact and informative representations from raw sequences without relying on labels, enabling e…
SKOLR: Structured Koopman Operator Linear RNN for Time-Series Forecasting
Yitian Zhang, Liheng Ma, Antonios Valkanas +2
Koopman operator theory provides a framework for nonlinear dynamical system analysis and time-series forecasting by mapping dynamics to a space of real-valued measurement functions…
Trajectory Prediction Meets Large Language Models: A Survey
Yi Xu, Ruining Yang, Yitian Zhang +5
Recent advances in large language models (LLMs) have sparked growing interest in integrating language-driven techniques into trajectory prediction. By leveraging their semantic and…
REGEN: Learning Compact Video Embedding with (Re-)Generative Decoder
Yitian Zhang, Long Mai, Aniruddha Mahapatra +5
We present a novel perspective on learning video embedders for generative modeling: rather than requiring an exact reproduction of an input video, an effective embedder should focu…
GmNet: Revisiting Gating Mechanisms From A Frequency View
Yifan Wang, Xu Ma, Yitian Zhang +5
Gating mechanisms have emerged as an effective strategy integrated into model designs beyond recurrent neural networks for addressing long-range dependency problems. In a broad und…
Scale-Free Graph-Language Models
Jianglin Lu, Yixuan Liu, Yitian Zhang +1
Graph-language models (GLMs) have demonstrated great potential in graph-based semi-supervised learning. A typical GLM consists of two key stages: graph generation and text embeddin…
Progressive Growing of Video Tokenizers for Temporally Compact Latent Spaces
Aniruddha Mahapatra, Long Mai, David Bourgin +2
Video tokenizers are essential for latent video diffusion models, converting raw video data into spatiotemporally compressed latent spaces for efficient training. However, extendin…
Slicing Vision Transformer for Flexible Inference
Yitian Zhang, Huseyin Coskun, Xu Ma +6
Vision Transformers (ViT) is known for its scalability. In this work, we target to scale down a ViT to fit in an environment with dynamic-changing resource constraints. We observe…
Accessing Vision Foundation Models via ImageNet-1K
Yitian Zhang, Xu Ma, Yue Bai +2
Vision foundation models are renowned for the generalization ability due to massive training data. Nevertheless, they demand tremendous training resources, and the training data is…
CKGConv: General Graph Convolution with Continuous Kernels
Liheng Ma, Soumyasundar Pal, Yitian Zhang +3
The existing definitions of graph convolution, either from spatial or spectral perspectives, are inflexible and not unified. Defining a general convolution operator in the graph do…
Don't Judge by the Look: Towards Motion Coherent Video Representation
Yitian Zhang, Yue Bai, Huan Wang +2
Current training pipelines in object recognition neglect Hue Jittering when doing data augmentation as it not only brings appearance changes that are detrimental to classification,…
Multi-resolution Time-Series Transformer for Long-term Forecasting
Yitian Zhang, Liheng Ma, Soumyasundar Pal +2
The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patche…
Contrastive Learning for Time Series on Dynamic Graphs
Yitian Zhang, Florence Regol, Antonios Valkanas +1
There have been several recent efforts towards developing representations for multivariate time-series in an unsupervised learning framework. Such representations can prove benefic…