10 papers
Spotlight and Shadow: Attention-Guided Dual-Anchor Introspective Decoding for MLLM Hallucination Mitigation
Yebo Wu, Han Jin, Zhijiang Guo +1
Multimodal Large Language Models (MLLMs) have demonstrated remarkable reasoning capabilities yet continue to suffer from hallucination, where generated text contradicts visual cont…
Beyond End-to-End: Dynamic Chain Optimization for Private LLM Adaptation on the Edge
Yebo Wu, Jingguang Li, Chunlin Tian +3
Federated fine-tuning enables privacy-preserving LLM adaptation but faces a critical bottleneck: the disparity between LLMs' high memory demands and edge devices' limited capacity.…
TSEmbed: Unlocking Task Scaling in Universal Multimodal Embeddings
Yebo Wu, Feng Liu, Ziwei Xie +4
Despite the exceptional reasoning capabilities of Multimodal Large Language Models (MLLMs), their adaptation into universal embedding models is significantly impeded by task confli…
A Survey on Federated Fine-tuning of Large Language Models
Yebo Wu, Chunlin Tian, Jingguang Li +8
Large Language Models (LLMs) have demonstrated impressive success across various tasks. Integrating LLMs with Federated Learning (FL), a paradigm known as FedLLM, offers a promisin…
Floe: Federated Specialization for Real-Time LLM-SLM Inference
Chunlin Tian, Kahou Tam, Yebo Wu +4
Deploying large language models (LLMs) in real-time systems remains challenging due to their substantial computational demands and privacy concerns. We propose Floe, a hybrid feder…
Elastic Mixture of Rank-Wise Experts for Knowledge Reuse in Federated Fine-Tuning
Yebo Wu, Jingguang Li, Zhijiang Guo +1
Federated fine-tuning offers a promising solution for adapting Large Language Models (LLMs) to downstream tasks while safeguarding data privacy. However, its high computational and…