3 papers
cs.MA2025
Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems
Jiaxi Yang, Mengqi Zhang, Yiqiao Jin +8
Large Language Model-based Multi-Agent Systems (MASs) have emerged as a powerful paradigm for tackling complex tasks through collaborative intelligence. However, the topology of th…
cs.IR2025
Mixture-of-RAG: Integrating Text and Tables with Large Language Models
Chi Zhang, Qiyang Chen, Mengqi Zhang
Large language models (LLMs) achieve optimal utility when their responses are grounded in external knowledge sources. However, real-world documents, such as annual reports, scienti…
cs.CL2024
ASLoRA: Adaptive Sharing Low-Rank Adaptation Across Layers
Junyan Hu, Xue Xiao, Mengqi Zhang +4
As large language models (LLMs) grow in size, traditional full fine-tuning becomes increasingly impractical due to its high computational and storage costs. Although popular parame…