Benchmarks

Every benchmark we aggregate, what it measures, and where its numbers come from.

agentic

Benchmark	Models	Unit	Run by	Notes
AA Agentic Index	87	index	Artificial Analysis

coding

Benchmark	Models	Unit	Run by	Notes
AA Coding Index	92	index	Artificial Analysis

intelligence

Benchmark	Models	Unit	Run by	Notes
AA Intelligence Index	125	index	Artificial Analysis	Composite of independently run evals by Artificial Analysis.

preference

Benchmark	Models	Unit	Run by	Notes
LMArena Text	72	elo	LMArena	Overall text category; style effects not controlled in this config.
LMArena WebDev	57	elo	LMArena	Head-to-head web app building votes.
LMArena Vision	53	elo	LMArena	Image-understanding battles.

Design Arena — 25 categories (crowd-voted design/code battles)

Design Arena — website	74	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — codecategories	72	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — dataviz	72	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — uicomponent	71	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — gamedev	70	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — 3d	69	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — svg	54	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — asciiart	44	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — webapps	33	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — fullstack	32	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — mobileapps	30	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — godotgamedev	29	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — androidnative	29	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — python-pptxslides	18	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agenticgamedev	18	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — htmlslides	18	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agentichtmlslides	10	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agenticslides(html)	10	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agenticslides	10	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agenticslides(python-pptx)	10	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — pptxslides	9	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — graphicdesign	3	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — image	3	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — logo	3	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — imageediting	1	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.

speed

Benchmark	Models	Unit	Run by	Notes
Median output speed	48	tokens_per_s	Artificial Analysis
Median time to first token	48	seconds	Artificial Analysis