9 citations · 27 across the 24 of their papers we have counts for
5 papers · 1 filter
LoCoBench-Agent: An Interactive Benchmark for LLM Agents in Long-Context Software Engineering
Jielin Qiu, Zuxin Liu, Zhiwei Liu +18
As large language models (LLMs) evolve into sophisticated autonomous agents capable of complex software development tasks, evaluating their real-world capabilities becomes critical…
GeoGNN: Quantifying and Mitigating Semantic Drift in Text-Attributed Graphs
Liangwei Yang, Jing Ma, Jianguo Zhang +11
Graph neural networks (GNNs) on text--attributed graphs (TAGs) typically encode node texts using pretrained language models (PLMs) and propagate these embeddings through linear nei…
LoCoBench: A Benchmark for Long-Context Large Language Models in Complex Software Engineering
Jielin Qiu, Zuxin Liu, Zhiwei Liu +14
The emergence of long-context language models with context windows extending to millions of tokens has created new opportunities for sophisticated code understanding and software d…
Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models
Rithesh Murthy, Ming Zhu, Liangwei Yang +6
Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix…
PersonaBench: Evaluating AI Models on Understanding Personal Information through Accessing (Synthetic) Private User Data
Juntao Tan, Liangwei Yang, Zuxin Liu +11
Personalization is critical in AI assistants, particularly in the context of private AI models that work with individual users. A key scenario in this domain involves enabling AI m…