35 citations · 42 across the 11 of their papers we have counts for
12 papers
FigAct: Turning Scientific Figures into Active Canvases for Explanation
Shishi Xiao, Zichao Wang, Alexa Siu +2
Scientific figures are designed to communicate information visually, yet MLLMs typically explain them by translating their visual content back into text. This requires readers to m…
ChArtist: Generating Pictorial Charts with Unified Spatial and Subject Control
Shishi Xiao, Tongyu Zhou, David Laidlaw +1
A pictorial chart is an effective medium for visual storytelling, seamlessly integrating visual elements with data charts. However, creating such images is challenging because the…
VizTA: Enhancing Comprehension of Distributional Visualization with Visual-Lexical Fused Conversational Interface
Liangwei Wang, Zhan Wang, Shishi Xiao +3
Comprehending visualizations requires readers to interpret visual encoding and the underlying meanings actively. This poses challenges for visualization novices, particularly when…
BizGen: Advancing Article-level Visual Text Rendering for Infographics Generation
Yuyang Peng, Shishi Xiao, Keming Wu +6
Recently, state-of-the-art text-to-image generation models, such as Flux and Ideogram 2.0, have made significant progress in sentence-level visual text rendering. In this paper, we…
CinePreGen: Camera Controllable Video Previsualization via Engine-powered Diffusion
Yiran Chen, Anyi Rao, Xuekun Jiang +5
With advancements in video generative AI models (e.g., SORA), creators are increasingly using these techniques to enhance video previsualization. However, they face challenges with…
ModalChorus: Visual Probing and Alignment of Multi-modal Embeddings via Modal Fusion Map
Yilin Ye, Shishi Xiao, Xingchen Zeng +1
Multi-modal embeddings form the foundation for vision-language models, such as CLIP embeddings, the most widely used text-image embeddings. However, these embeddings are vulnerable…
Generative AI for Visualization: State of the Art and Future Directions
Yilin Ye, Jianing Hao, Yihan Hou +4
Generative AI (GenAI) has witnessed remarkable progress in recent years and demonstrated impressive performance in various generation tasks in different domains such as computer vi…
TypeDance: Creating Semantic Typographic Logos from Image through Personalized Generation
Shishi Xiao, Liangwei Wang, Xiaojuan Ma +1
Semantic typographic logos harmoniously blend typeface and imagery to represent semantic concepts while maintaining legibility. Conventional methods using spatial composition and s…
The Contemporary Art of Image Search: Iterative User Intent Expansion via Vision-Language Model
Yilin Ye, Qian Zhu, Shishi Xiao +2
Image search is an essential and user-friendly method to explore vast galleries of digital images. However, existing image search methods heavily rely on proximity measurements lik…
WYTIWYR: A User Intent-Aware Framework with Multi-modal Inputs for Visualization Retrieval
Shishi Xiao, Yihan Hou, Cheng Jin +1
Retrieving charts from a large corpus is a fundamental task that can benefit numerous applications such as visualization recommendations.The retrieved results are expected to confo…
Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Model
Shishi Xiao, Suizi Huang, Yue Lin +2
Pictorial visualization seamlessly integrates data and semantic context into visual representation, conveying complex information in a manner that is both engaging and informative.…
Label Name is Mantra: Unifying Point Cloud Segmentation across Heterogeneous Datasets
Yixun Liang, Hao He, Shishi Xiao +2
Point cloud segmentation is a fundamental task in 3D vision that serves a wide range of applications. Although great progresses have been made these years, its practical usability…