Benchmarks

Every benchmark we aggregate, what it measures, and where its numbers come from.

agentic

Benchmark	Models	Unit	Run by	Notes
AA Agentic Index	104	index	Artificial Analysis

coding

Benchmark	Models	Unit	Run by	Notes
AA Coding Index	109	index	Artificial Analysis

intelligence

Benchmark	Models	Unit	Run by	Notes
AA Intelligence Index	142	index	Artificial Analysis	Composite of independently run evals by Artificial Analysis.

preference

Benchmark	Models	Unit	Run by	Notes
LMArena Text	127	elo	LMArena	Overall text category; style effects not controlled in this config.
LMArena WebDev	71	elo	LMArena	Head-to-head web app building votes.
LMArena Vision	68	elo	LMArena	Image-understanding battles.

Design Arena — 25 categories (crowd-voted design/code battles)

Design Arena — website	84	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — codecategories	82	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — dataviz	82	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — uicomponent	82	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — gamedev	82	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — 3d	79	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — svg	65	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — asciiart	54	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — fullstack	43	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — mobileapps	43	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — webapps	42	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — androidnative	36	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — godotgamedev	31	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — python-pptxslides	27	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agenticgamedev	25	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — htmlslides	24	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agentichtmlslides	10	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agenticslides(html)	10	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agenticslides	10	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — agenticslides(python-pptx)	10	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — pptxslides	9	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — graphicdesign	3	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — image	3	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — logo	3	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.
Design Arena — imageediting	1	elo	Design Arena	Head-to-head human votes on generated designs/code, mirrored via OpenRouter.

speed

Benchmark	Models	Unit	Run by	Notes
Median output speed	54	tokens_per_s	Artificial Analysis
Median time to first token	54	seconds	Artificial Analysis