4 papers
HEPTABench: A framework for portable and controlled agentic evaluations in high energy physics
Tony Menzo, Alexander Roman, George T. Fleming +3
Quantifying the capability and reliability of agentic systems in high-energy physics (HEP) requires repeated evaluations under controlled configurations. Establishing whether chang…
Reining in an Agentic Harness for High Energy Physics
Tony Menzo, George T. Fleming, Konstantin T. Matchev +2
Agentic systems now address tasks across theoretical, phenomenological, and experimental high energy physics (HEP), but their scientific capabilities remain difficult to reuse acro…
Orchestral AI: A Framework for Agent Orchestration
Alexander Roman, Jacob Roman
The rapid proliferation of LLM agent frameworks has forced developers to choose between vendor lock-in through provider-specific SDKs and complex multi-package ecosystems that obsc…
HEPTAPOD: Orchestrating High Energy Physics Workflows Towards Autonomous Agency
Tony Menzo, Alexander Roman, Sergei Gleyzer +5
Many theoretical and experimental workflows in high-energy-physics (HEP) stand to benefit from recent advances in transformer-based large language models (LLMs). While early applic…