7 papers
On the Stability of Prompt Ranking in Large Language Model Evaluation
Shaoshuai Du, Penghao Liang, Yixian Shen +3
Prompt-based interaction has become a dominant paradigm for using large language models (LLMs), where multiple candidate prompts are evaluated and the top-ranked one is selected fo…
Comparative Analysis of Large Language Models for Context-Aware Code Completion using SAFIM Framework
Hang Zhang, Yanxin Shen, Lun Wang +4
The advent of Large Language Models (LLMs) has revolutionized code completion, transforming it into a more intelligent and context-aware feature in modern integrated development en…
Deep Semantic Graph Learning via LLM based Node Enhancement
Chuanqi Shi, Yiyi Tao, Hang Zhang +4
Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node e…
Zero-Shot End-to-End Relation Extraction in Chinese: A Comparative Study of Gemini, LLaMA and ChatGPT
Shaoshuai Du, Yiyi Tao, Yixian Shen +4
This study investigates the performance of various large language models (LLMs) on zero-shot end-to-end relation extraction (RE) in Chinese, a task that integrates entity recogniti…
Comparative Analysis of Listwise Reranking with Large Language Models in Limited-Resource Language Contexts
Yanxin Shen, Lun Wang, Chuanqi Shi +4
Large Language Models (LLMs) have demonstrated significant effectiveness across various NLP tasks, including text ranking. This study assesses the performance of large language mod…
AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibility
Yixian Shen, Hang Zhang, Yanxin Shen +4
Digital accessibility is a cornerstone of inclusive content delivery, yet many EPUB files fail to meet fundamental accessibility standards, particularly in providing descriptive al…
Robustness of Large Language Models Against Adversarial Attacks
Yiyi Tao, Yixian Shen, Hang Zhang +4
The increasing deployment of Large Language Models (LLMs) in various applications necessitates a rigorous evaluation of their robustness against adversarial attacks. In this paper,…