Tools
Benchmark Runs
Manage benchmark runs.
Manage benchmark runs that execute all tasks in a benchmark and collect results.
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Manage benchmark runs.
| Action | Description |
|---|---|
list | List all benchmark runs in the organization |
create | Start a new benchmark run |
get | Get a benchmark run by ID |
complete | Mark a benchmark run as complete |
cancel | Cancel a benchmark run |
listcreate| Parameter | Type | Required | Description |
|---|---|---|---|
benchmarkId | string | yes | Benchmark ID to run |
get| Parameter | Type | Required | Description |
|---|---|---|---|
id | string | yes | Benchmark run ID |
complete| Parameter | Type | Required | Description |
|---|---|---|---|
id | string | yes | Benchmark run ID |
cancel| Parameter | Type | Required | Description |
|---|---|---|---|
id | string | yes | Benchmark run ID |
{
"action": "create",
"benchmarkId": "bm_abc123"
}
{
"action": "get",
"id": "br_xyz789"
}
{
"action": "cancel",
"id": "br_xyz789"
}