Delivering Transparency in LLM Benchmarking. We use multi-LLM evaluation for accurate and unbiased evaluation of LLM quality, cost and speed. AutoBench resists gaming by changing at each run. Our system uses 20+ LLM models to generate granular benchmarks that score 87% correlation with AAII and 77% with LMArena.