9 citations · 9 across the 7 of their papers we have counts for
4 papers · 1 filter
A Unified Rate-Distortion Perspective on Vector, Product, and Scalar Quantization
Xianghong Fang, Wenlong Mou, Yuan Yuan +2
Discrete visual tokenization, predominantly driven by vector, scalar, and product quantization, lacks a unified conceptual framework for understanding quantization tradeoffs. In th…
Rethinking The Uniformity Metric in Self-Supervised Learning
Xianghong Fang, Jian Li, Qiang Sun +1
Uniformity plays an important role in evaluating learned representations, providing insights into self-supervised learning. In our quest for effective uniformity metrics, we pinpoi…
Discrete Auto-regressive Variational Attention Models for Text Modeling
Xianghong Fang, Haoli Bai, Jian Li +3
Variational autoencoders (VAEs) have been widely applied for text modeling. In practice, however, they are troubled by two challenges: information underrepresentation and posterior…
Discrete Variational Attention Models for Language Generation
Xianghong Fang, Haoli Bai, Zenglin Xu +2
Variational autoencoders have been widely applied for natural language generation, however, there are two long-standing problems: information under-representation and posterior col…