4 papers
MultiwayPAM: Multiway Partitioning Around Medoids for LLM-as-a-Judge Score Analysis
Chihiro Watanabe, Jingyu Sun
LLM-as-a-Judge is a flexible framework for text evaluation, which allows us to obtain scores for the quality of a given text from various perspectives by changing the prompt templa…
Empirical Cumulative Distribution Function Clustering for LLM-based Agent System Analysis
Chihiro Watanabe, Jingyu Sun
Large language models (LLMs) are increasingly used as agents to solve complex tasks such as question answering (QA), scientific debate, and software development. A standard evaluat…
KG2QA: Knowledge Graph-enhanced Retrieval-augmented Generation for Communication Standards Question Answering
Zhongze Luo, Weixuan Wan, Tianya Zhang +2
The rapid evolution of communication technologies has led to an explosion of standards, rendering traditional expert-dependent consultation methods inefficient and slow. To address…
ForPKG: A Framework for Constructing Forestry Policy Knowledge Graph and Application Analysis
Jingyun Sun, Zhongze Luo
A policy knowledge graph can provide decision support for tasks such as project compliance, policy analysis, and intelligent question answering, and can also serve as an external k…