From the 1 of 4 linked papers with an AI index.
4 papers
When Models Meet Users: An Empirical Study of Perceptions of General LLMs and Multimodal LLMs on Hugging Face
Yujian Liu, Xiao Yu, Jacky Keung +3
The paper empirically examines user discussions on Hugging Face to understand how people perceive general-purpose and multimodal large language models, identifying key concerns suc…
R2ComSync: Improving Code-Comment Synchronization with In-Context Learning and Reranking
Zhen Yang, Hongyi Lin, Xiao Yu +5
Code-Comment Synchronization (CCS) aims to synchronize the comments with code changes in an automated fashion, thereby significantly reducing the workload of developers during soft…
HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks
Fengji Zhang, Linquan Wu, Huiyu Bai +6
Understanding and reasoning over diagrams is a fundamental aspect of human intelligence. While Large Multimodal Models (LMMs) have demonstrated impressive capabilities across vario…
Practitioners' Expectations on Log Anomaly Detection
Xiaoxue Ma, Yishu Li, Jacky Keung +5
Log anomaly detection has become a common practice for software engineers to analyze software system behavior. Despite significant research efforts in log anomaly detection over th…