HarvestBench: Measuring Whether LLM Agents Will Pay to Avoid Killing Animals

Jasmine Brazilek, Miles Tidmarsh, Matthias Endres +2

HarvestBench is the first benchmark to 1) put a price on avoiding a side effect and 2) name the side effect as a living creature. Nine LLMs each drive a crew of two tractors to gat…