Skip to main content
GET
List Benchmarks

Authorizations

Authorization
string
header
required

A Nemonist key (sk-nm-...) as a bearer token in the Authorization header.

Headers

HTTP-Referer
string

The app identifier should be your app's URL and is used as the primary identifier for rankings. This is used to track API usage per application.

X-OpenRouter-Title
string

The app display name allows you to customize how your app appears in OpenRouter's dashboard.

X-OpenRouter-Categories
string

Comma-separated list of app categories (e.g. "cli-agent,cloud-agent"). Used for marketplace rankings.

Query Parameters

source
enum<string>

Benchmark source to query. Determines the shape of the returned items. When omitted, returns results from all sources.

Available options:
artificial-analysis,
design-arena,
openrouter
Example:

"artificial-analysis"

task_type
enum<string>

Filter results by task type. For Artificial Analysis, maps to the corresponding index. For Design Arena, maps to the matching category. search returns OpenRouter search benchmark results only.

Available options:
coding,
intelligence,
agentic,
search
Example:

"coding"

benchmark_type
enum<string>

Return results for one exact OpenRouter benchmark. A search_* value narrows the response to search results only; a classic value narrows the OpenRouter items and leaves other sources' items as they are.

Available options:
gpqa_diamond,
tau_bench_verified_airline,
search_browsecomp,
search_hle,
search_dsqa,
search_widesearch
Example:

"search_widesearch"

include_run_config
boolean
default:false

Search benchmarks only: include the published lane configuration whitelist in each search item. Defaults to false. The whitelist is limited to agent turn count, reasoning effort, and temperature so future harness configuration changes do not change the public contract.

Example:

true

search_engine
string

OpenRouter search benchmarks only: filter by the search engine used.

Example:

"exa"

search_surface
enum<string>

OpenRouter search benchmarks only: filter by the request surface the lane ran on.

Available options:
server-tool,
plugin
Example:

"server-tool"

arena
enum<string>

Design Arena only: arena to query. Defaults to models when source is design-arena.

Available options:
models,
builders,
agents
Example:

"models"

category
string

Design Arena only: category within the arena (e.g. codecategories, uicomponent, gamedev, 3d, dataviz, image, video, svg). When omitted, returns all categories.

Example:

"codecategories"

max_results
integer

Maximum number of items to return. When omitted, all matching results are returned.

Required range: x >= 1
Example:

50

Response

Benchmark results filtered by the specified source and optional task type.

data
object[]
required

The benchmark results.

Example:
meta
object
required

About this benchmark data: when it was last updated, the dataset version, its source and required citation, the filters applied, and how many models it covers.

Example: