Minerva: A Programmable Memory Test Benchmark for Language Models

Menglin Xia, Victor Ruehle, Saravan Rajmohan +1

How effectively can LLM-based AI assistants utilize their memory (context) to perform various tasks? Traditional data benchmarks, which are often manually crafted, suffer from seve…