6 papers
MultiwayPAM: Multiway Partitioning Around Medoids for LLM-as-a-Judge Score Analysis
Chihiro Watanabe, Jingyu Sun
LLM-as-a-Judge is a flexible framework for text evaluation, which allows us to obtain scores for the quality of a given text from various perspectives by changing the prompt templa…
Empirical Cumulative Distribution Function Clustering for LLM-based Agent System Analysis
Chihiro Watanabe, Jingyu Sun
Large language models (LLMs) are increasingly used as agents to solve complex tasks such as question answering (QA), scientific debate, and software development. A standard evaluat…
KG2QA: Knowledge Graph-enhanced Retrieval-augmented Generation for Communication Standards Question Answering
Zhongze Luo, Weixuan Wan, Tianya Zhang +2
The rapid evolution of communication technologies has led to an explosion of standards, rendering traditional expert-dependent consultation methods inefficient and slow. To address…
ForPKG: A Framework for Constructing Forestry Policy Knowledge Graph and Application Analysis
Jingyun Sun, Zhongze Luo
A policy knowledge graph can provide decision support for tasks such as project compliance, policy analysis, and intelligent question answering, and can also serve as an external k…
LawLuo: A Multi-Agent Collaborative Framework for Multi-Round Chinese Legal Consultation
Jingyun Sun, Chengxiao Dai, Zhongze Luo +2
Legal Large Language Models (LLMs) have shown promise in providing legal consultations to non-experts. However, most existing Chinese legal consultation models are based on single-…
A Multi-Source Heterogeneous Knowledge Injected Prompt Learning Method for Legal Charge Prediction
Jingyun Sun, Chi Wei, Yang Li
Legal charge prediction, an essential task in legal AI, seeks to assign accurate charge labels to case descriptions, attracting significant recent interest. Existing methods primar…