58 citations · 161 across the 37 of their papers we have counts for
29 papers · 1 filter
Ctrl-Z Sampling: Scaling Diffusion Sampling with Controlled Random Zigzag Explorations
Shunqi Mao, Wei Guo, Chaoyi Zhang +3
Diffusion models generate conditional samples by progressively denoising Gaussian noise, yet the denoising trajectory can stall at visually plausible but low-quality outcomes with…
Through the Magnifying Glass: Adaptive Perception Magnification for Hallucination-Free VLM Decoding
Shunqi Mao, Chaoyi Zhang, Weidong Cai
Existing vision-language models (VLMs) often suffer from visual hallucination, where the generated responses contain inaccuracies that are not grounded in the visual input. Efforts…
RealSyn: An Effective and Scalable Multimodal Interleaved Document Transformation Paradigm
Tiancheng Gu, Kaicheng Yang, Chaoyi Zhang +6
After pre-training on extensive image-text pairs, Contrastive Language-Image Pre-training (CLIP) demonstrates promising performance on a wide variety of benchmarks. However, a subs…
Learning to Synthesize Graphics Programs for Geometric Artworks
Qi Bing, Chaoyi Zhang, Weidong Cai
Creating and understanding art has long been a hallmark of human ability. When presented with finished digital artwork, professional graphic artists can intuitively deconstruct and…
DeepIcon: A Hierarchical Network for Layer-wise Icon Vectorization
Qi Bing, Chaoyi Zhang, Weidong Cai
In contrast to the well-established technique of rasterization, vectorization of images poses a significant challenge in the field of computer graphics. Recent learning-based metho…
Enhancing Advanced Visual Reasoning Ability of Large Language Models
Zhiyuan Li, Dongnan Liu, Chaoyi Zhang +3
Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-La…
Multimodal Causal Reasoning Benchmark: Challenging Vision Large Language Models to Discern Causal Links Across Modalities
Zhiyuan Li, Heng Wang, Dongnan Liu +4
Multimodal Large Language Models (MLLMs) have showcased exceptional Chain-of-Thought (CoT) reasoning ability in complex textual inference tasks including causal reasoning. However,…
Controllable Contextualized Image Captioning: Directing the Visual Narrative through User-Defined Highlights
Shunqi Mao, Chaoyi Zhang, Hang Su +3
Contextualized Image Captioning (CIC) evolves traditional image captioning into a more complex domain, necessitating the ability for multimodal reasoning. It aims to generate image…
Enhancing Robustness to Noise Corruption for Point Cloud Recognition via Spatial Sorting and Set-Mixing Aggregation Module
Dingxin Zhang, Jianhui Yu, Tengfei Xue +3
Current models for point cloud recognition demonstrate promising performance on synthetic datasets. However, real-world point cloud data inevitably contains noise, impacting model…
TractGraphFormer: Anatomically Informed Hybrid Graph CNN-Transformer Network for Interpretable Sex and Age Prediction from Diffusion MRI Tractography
Yuqian Chen, Fan Zhang, Meng Wang +10
The relationship between brain connections and non-imaging phenotypes is increasingly studied using deep neural networks. However, the local and global properties of brain white ma…
TractCloud: Registration-free tractography parcellation with a novel local-global streamline point cloud representation
Tengfei Xue, Yuqian Chen, Chaoyi Zhang +6
Diffusion MRI tractography parcellation classifies streamlines into anatomical fiber tracts to enable quantification and visualization for clinical and scientific applications. Cur…
TractGeoNet: A geometric deep learning framework for pointwise analysis of tract microstructure to predict language assessment performance
Yuqian Chen, Leo R. Zekelman, Chaoyi Zhang +8
We propose a geometric deep-learning-based framework, TractGeoNet, for performing regression using diffusion magnetic resonance imaging (dMRI) tractography and associated pointwise…
Exploring Annotation-free Image Captioning with Retrieval-augmented Pseudo Sentence Generation
Zhiyuan Li, Dongnan Liu, Heng Wang +2
Recently, training an image captioner without annotated image-sentence pairs has gained traction. Previous methods have faced limitations due to either using mismatched corpora for…
PaRot: Patch-Wise Rotation-Invariant Network via Feature Disentanglement and Pose Restoration
Dingxin Zhang, Jianhui Yu, Chaoyi Zhang +1
Recent interest in point cloud analysis has led rapid progress in designing deep learning methods for 3D models. However, state-of-the-art models are not robust to rotations, which…
Rethinking Rotation Invariance with Point Cloud Registration
Jianhui Yu, Chaoyi Zhang, Weidong Cai
Recent investigations on rotation invariance for 3D point clouds have been devoted to devising rotation-invariant feature descriptors or learning canonical spaces where objects are…
PointNeuron: 3D Neuron Reconstruction via Geometry and Topology Learning of Point Clouds
Runkai Zhao, Heng Wang, Chaoyi Zhang +1
Digital neuron reconstruction from 3D microscopy images is an essential technique for investigating brain connectomics and neuron morphology. Existing reconstruction frameworks use…
Unsupervised Domain Adaptive Fundus Image Segmentation with Few Labeled Source Data
Qianbi Yu, Dongnan Liu, Chaoyi Zhang +2
Deep learning-based segmentation methods have been widely employed for automatic glaucoma diagnosis and prognosis. In practice, fundus images obtained by different fundus cameras v…
TractoSCR: A Novel Supervised Contrastive Regression Framework for Prediction of Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI Tractography
Tengfei Xue, Fan Zhang, Leo R. Zekelman +9
Neuroimaging-based prediction of neurocognitive measures is valuable for studying how the brain's structure relates to cognitive function. However, the accuracy of prediction using…
White Matter Tracts are Point Clouds: Neuropsychological Score Prediction and Critical Region Localization via Geometric Deep Learning
Yuqian Chen, Fan Zhang, Chaoyi Zhang +9
White matter tract microstructure has been shown to influence neuropsychological scores of cognitive performance. However, prediction of these scores from white matter tract data h…
Deep fiber clustering: Anatomically informed fiber clustering with self-supervised deep learning for fast and effective tractography parcellation
Yuqian Chen, Chaoyi Zhang, Tengfei Xue +6
White matter fiber clustering is an important strategy for white matter parcellation, which enables quantitative analysis of brain connections in health and disease. In combination…
Spatiality-guided Transformer for 3D Dense Captioning on Point Clouds
Heng Wang, Chaoyi Zhang, Jianhui Yu +1
Dense captioning in 3D point clouds is an emerging vision-and-language task involving object-level 3D scene understanding. Apart from coarse semantic class prediction and bounding…
Towards Bi-directional Skip Connections in Encoder-Decoder Architectures and Beyond
Tiange Xiang, Chaoyi Zhang, Xinyi Wang +4
U-Net, as an encoder-decoder architecture with forward skip connections, has achieved promising results in various medical image analysis tasks. Many recent approaches have also ex…
SupWMA: Consistent and Efficient Tractography Parcellation of Superficial White Matter with Deep Learning
Tengfei Xue, Fan Zhang, Chaoyi Zhang +6
White matter parcellation classifies tractography streamlines into clusters or anatomically meaningful tracts to enable quantification and visualization. Most parcellation methods…
Decompose to Adapt: Cross-domain Object Detection via Feature Disentanglement
Dongnan Liu, Chaoyi Zhang, Yang Song +4
Recent advances in unsupervised domain adaptation (UDA) techniques have witnessed great success in cross-domain computer vision tasks, enhancing the generalization ability of data-…