4 papers
PASemiQA: Plan-Assisted Agent for Question Answering on Semi-Structured Data with Text and Relational Information
Hansi Yang, Qi Zhang, Wei Jiang +1
Large language models (LLMs) have shown impressive abilities in answering questions across various domains, but they often encounter hallucination issues on questions that require…
An Empirical Study on Commit Message Generation using LLMs via In-Context Learning
Yifan Wu, Yunpeng Wang, Ying Li +5
Commit messages concisely describe code changes in natural language and are important for software maintenance. Several approaches have been proposed to automatically generate comm…
LogPTR: Variable-Aware Log Parsing with Pointer Network
Yifan Wu, Bingxu Chai, Siyu Yu +4
Due to the sheer size of software logs, developers rely on automated log analysis. Log parsing, which parses semi-structured logs into a structured format, is a prerequisite of aut…
CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending
Shiyi Zhu, Jing Ye, Wei Jiang +4
Self-attention and position embedding are two key modules in transformer-based Large Language Models (LLMs). However, the potential relationship between them is far from well studi…