Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecture

Abstract

Artificial Intelligence (AI) holds great potential in legal services, yet Large Language Models (LLMs) face two major challenges: limited knowledge of the Chinese legal system and vulnerability to hallucinations. To address these issues, we present Chatlaw, a multi-agent legal assistant. Chatlaw's framework is designed to emulate the Standard Operating Procedures (SOP) of real law firms, where different roles (e.g., assistant, researcher, senior lawyer) collaborate on a case. To computationally mirror this collaborative structure, we developed a novel Role-Aligned Mixture-of-Experts (RA-MoE) architecture. In this system, the internal "experts" are specifically trained to align with the distinct tasks of each agent role (e.g., inquiry, analysis, drafting). These specialized agents (Legal Assistant, Researcher, etc.) then form the collaborative framework. When they interact with users, retrieve legal knowledge, analyze case details, or generate reliable consultations, the RA-MoE architecture intelligently routes their computations to the corresponding dedicated expert, ensuring each step is handled by the most qualified parameters. In evaluations, Chatlaw surpasses general-purpose AI models, including GPT-4, achieving a 7.73% improvement in accuracy on the LawBench benchmark and an 11-point higher score on the Unified Qualification Exam for Legal Professionals. Real-case studies and expert assessments further confirm its robustness. Chatlaw enhances the accessibility and reliability of legal services, advancing the provision of legal support to the public.

Accepted manuscript. Updated to match the journal version and added DOI

References in corpus (4)

• polyBERT: A chemical language model to enable fully machine-driven ultrafast polymer informatics
• Large Language Models Streamline Automated Machine Learning for Clinical Studies
• Augmenting Interpretable Models with LLMs during Training
• Input Domain Aware MoE: Decoupling Routing Decisions from Task Optimization in Mixture of Experts

Cited by in corpus (9)

• Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models
• Uncovering ChatGPT's Capabilities in Recommender Systems
• ChatEDA: A Large Language Model Powered Autonomous Agent for EDA
• C2Ideas: Supporting Creative Interior Color Design Ideation with Large Language Model
• A Survey on Symbolic Knowledge Distillation of Large Language Models
• GeoCode-GPT: A Large Language Model for Geospatial Code Generation Tasks
• Exploring the Reversal Curse and Other Deductive Logical Reasoning in BERT and GPT-Based Large Language Models
• SPROUT: an Interactive Authoring Tool for Generating Programming Tutorials with the Visualization of Large Language Models
• Hallucinations in LLMs: A Lifecycle-Based Survey of Causes, Detection, Mitigation, and Prevention