Bench360: Benchmarking Local LLM Inference from 360 Degrees

Linus Stuhlmann, Mauricio Fadel Argerich, Jonathan Fürst

Running LLMs locally has become increasingly common, but users face a complex design space across models, quantization levels, inference engines, and serving scenarios. Existing in…