8 papers
On the Stability of Prompt Ranking in Large Language Model Evaluation
Shaoshuai Du, Penghao Liang, Yixian Shen +3
Prompt-based interaction has become a dominant paradigm for using large language models (LLMs), where multiple candidate prompts are evaluated and the top-ranked one is selected fo…
Performance Review on LLM for solving leetcode problems
Lun Wang, Chuanqi Shi, Shaoshui Du +5
This paper presents a comprehensive performance evaluation of Large Language Models (LLMs) in solving programming challenges from Leetcode, a widely used platform for algorithm pra…
Comparative Analysis of Large Language Models for Context-Aware Code Completion using SAFIM Framework
Hang Zhang, Yanxin Shen, Lun Wang +4
The advent of Large Language Models (LLMs) has revolutionized code completion, transforming it into a more intelligent and context-aware feature in modern integrated development en…
Deep Semantic Graph Learning via LLM based Node Enhancement
Chuanqi Shi, Yiyi Tao, Hang Zhang +4
Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node e…
Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPT
Shaoshuai Du, Yiyi Tao, Yixian Shen +4
This study investigates the performance of various large language models (LLMs) on zero-shot end-to-end relation extraction (RE) in Chinese, a task that integrates entity recogniti…
Comparative Analysis of Listwise Reranking with Large Language Models in Limited-Resource Language Contexts
Yanxin Shen, Lun Wang, Chuanqi Shi +4
Large Language Models (LLMs) have demonstrated significant effectiveness across various NLP tasks, including text ranking. This study assesses the performance of large language mod…