Beyond Ideal Instruction: A Comprehensive Framework for Evaluating LLMs in Realistic Interactions

Xuan Yang, Hao Xu, Tingfeng Hui +4

Despite great advances in tool-use capabilities of large language models (LLMs), existing evaluation benchmarks struggle to fully align with real-world scenarios. Such benchmarks m…