45 citations · 171 across the 21 of their papers we have counts for
21 papers
A Unified Geometric Space for Topological Alignment Between Transformer-Based Models and Human Brain Networks
Silin Chen, Yuzhong Chen, Caiwei Wang +9
Whether artificial neural networks organize information comparably to the human brain remains unclear. Prior brain--AI alignment studies are constrained by specific inputs and task…
A Comprehensive Review of Multimodal Large Language Models: Performance and Challenges Across Different Tasks
Jiaqi Wang, Hanqi Jiang, Yiheng Liu +21
In an era defined by the explosive growth of data and rapid technological advancements, Multimodal Large Language Models (MLLMs) stand at the forefront of artificial intelligence (…
Potential of Multimodal Large Language Models for Data Mining of Medical Images and Free-text Reports
Yutong Zhang, Yi Pan, Tianyang Zhong +11
Medical images and radiology reports are crucial for diagnosing medical conditions, highlighting the importance of quantitative analysis for clinical decision-making. However, the…
Adaptive Critical Subgraph Mining for Cognitive Impairment Conversion Prediction with T1-MRI-based Brain Network
Yilin Leng, Wenju Cui, Bai Chen +3
Prediction the conversion to early-stage dementia is critical for mitigating its progression but remains challenging due to subtle cognitive impairments and structural brain change…
Ophtha-LLaMA2: A Large Language Model for Ophthalmology
Huan Zhao, Qian Ling, Yi Pan +14
In recent years, pre-trained large language models (LLMs) have achieved tremendous success in the field of Natural Language Processing (NLP). Prior studies have primarily focused o…
Holistic Evaluation of GPT-4V for Biomedical Imaging
Zhengliang Liu, Hanqi Jiang, Tianyang Zhong +47
In this paper, we present a large-scale evaluation probing GPT-4V's capabilities and limitations for biomedical image analysis. GPT-4V represents a breakthrough in artificial gener…
Evaluating Large Language Models in Ophthalmology
Jason Holmes, Shuyuan Ye, Yiwei Li +11
Purpose: The performance of three different large language models (LLMS) (GPT-3.5, GPT-4, and PaLM2) in answering ophthalmology professional questions was evaluated and compared wi…
Evaluating multiple large language models in pediatric ophthalmology
Jason Holmes, Rui Peng, Yiwei Li +10
IMPORTANCE The response effectiveness of different large language models (LLMs) and various individuals, including medical students, graduate students, and practicing physicians, i…
ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data
Tianyang Zhong, Wei Zhao, Yutong Zhang +39
Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels. However, complex and d…
Review of Large Vision Models and Visual Prompt Engineering
Jiaqi Wang, Zhengliang Liu, Lin Zhao +18
Visual prompt engineering is a fundamental technology in the field of visual and image Artificial General Intelligence, serving as a key component for achieving zero-shot capabilit…
Evaluating Large Language Models for Radiology Natural Language Processing
Zhengliang Liu, Tianyang Zhong, Yiwei Li +43
The rise of large language models (LLMs) has marked a pivotal shift in the field of natural language processing (NLP). LLMs have revolutionized a multitude of domains, and they hav…
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT
Zhenxiang Xiao, Yuzhong Chen, Lu Zhang +14
Prompts have been proven to play a crucial role in large language models, and in recent years, vision models have also been using prompts to improve scalability for multiple downst…
ChatABL: Abductive Learning via Natural Language Interaction with ChatGPT
Tianyang Zhong, Yaonai Wei, Li Yang +13
Large language models (LLMs) such as ChatGPT have recently demonstrated significant potential in mathematical abilities, providing valuable reasoning paradigm consistent with human…
When Brain-inspired AI Meets AGI
Lin Zhao, Lu Zhang, Zihao Wu +11
Artificial General Intelligence (AGI) has been a long-standing goal of humanity, with the aim of creating machines capable of performing any intellectual task that humans can do. T…
Mask-guided BERT for Few Shot Text Classification
Wenxiong Liao, Zhengliang Liu, Haixing Dai +11
Transformer-based language models have achieved significant success in various domains. However, the data-intensive nature of the transformer architecture requires much labeled dat…
Coupling Visual Semantics of Artificial Neural Networks and Human Brain Function via Synchronized Activations
Lin Zhao, Haixing Dai, Zihao Wu +8
Artificial neural networks (ANNs), originally inspired by biological neural networks (BNNs), have achieved remarkable successes in many tasks such as visual representation learning…
Rectify ViT Shortcut Learning by Visual Saliency
Chong Ma, Lin Zhao, Yuzhong Chen +7
Shortcut learning is common but harmful to deep learning models, leading to degenerated feature representations and consequently jeopardizing the model's generalizability and inter…
Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning
Chong Ma, Lin Zhao, Yuzhong Chen +15
Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and useful representations, thus jeopardizing the gen…
A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformers
Yuzhong Chen, Yu Du, Zhenxiang Xiao +8
Vision transformer (ViT) and its variants have achieved remarkable successes in various visual tasks. The key characteristic of these ViT models is to adopt different aggregation s…
Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning
Yuzhong Chen, Zhenxiang Xiao, Lin Zhao +10
Learning with little data is challenging but often inevitable in various application scenarios where the labeled data is limited and costly. Recently, few-shot learning (FSL) gaine…
Bilinear pooling and metric learning network for early Alzheimer's disease identification with FDG-PET images
Wenju Cui, Caiying Yan, Zhuangzhi Yan +5
FDG-PET reveals altered brain metabolism in individuals with mild cognitive impairment (MCI) and Alzheimer's disease (AD). Some biomarkers derived from FDG-PET by computer-aided-di…