6 papers
Learning from Medical Entity Trees: An Entity-Centric Medical Data Engineering Framework for MLLMs
Jianghang Lin, Haihua Yang, Deli Yu +6
Multimodal Large Language Models (MLLMs) have shown transformative potential in medical applications, yet their performance is hindered by conventional data curation strategies tha…
SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation
Grace Jiarui Fan, Chengpiao Huang, Tianyi Peng +2
AI-based persona simulation -- often referred to as digital twin simulation -- is increasingly used for market research, recommender systems, and social sciences. Despite their fle…
Seeing through the Conflict: Transparent Knowledge Conflict Handling in Retrieval-Augmented Generation
Hua Ye, Siyuan Chen, Ziqi Zhong +4
Large language models (LLMs) equipped with retrieval--the Retrieval-Augmented Generation (RAG) paradigm--should combine their parametric knowledge with external evidence, yet in pr…
Characterising Toxicity in Generative Large Language Models
Zhiyao Zhang, Yazan Mash'Al, Yuhan Wu
In recent years, the advent of the attention mechanism has significantly advanced the field of natural language processing (NLP), revolutionizing text processing and text generatio…
HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performance
Hao Zhang, Zhenjia Li, Runfeng Bao +8
Parameter-Efficient Fine-Tuning (PEFT), especially Low-Rank Adaptation (LoRA), has emerged as a promising approach to fine-tuning large language models(LLMs) while reducing computa…
UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding
Shuquan Lian, Yuhang Wu, Jia Ma +6
The emergence of Multimodal Large Language Models (MLLMs) has driven significant advances in Graphical User Interface (GUI) agent capabilities. Nevertheless, existing GUI agent tra…