4 papers
EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
Yuyao Wang, Zhongjian Zhang, Mo Chi +7
Recent benchmarks for Large Language Model (LLM) agents mainly evaluate reasoning, planning, and execution. However, memory is also essential for agents, as it enables them to stor…
Finite-Time Regret Analysis of Retry-Aware Bandits
Bingkui Tong, Junpei Komiyama, Soichiro Nishimori +1
We study a stochastic bandit algorithm motivated by retry-aware objectives that value the best outcome among multiple attempts, such as pass@ and max@. Given a posterior over…
The Linked Data Benchmark Council (LDBC): Driving competition and collaboration in the graph data management space
Gábor Szárnyas, Brad Bebee, Altan Birler +30
Graph data management is instrumental for several use cases such as recommendation, root cause analysis, financial fraud detection, and enterprise knowledge representation. Efficie…
The LDBC Financial Benchmark
Shipeng Qi, Heng Lin, Zhihui Guo +11
The Linked Data Benchmark Council's Financial Benchmark (LDBC FinBench) is a new effort that defines a graph database benchmark targeting financial scenarios such as anti-fraud and…