Documentation Index
Fetch the complete documentation index at: https://docs.verial.ai/llms.txt
Use this file to discover all available pages before exploring further.
Manage benchmarks that group related tasks into a runnable test suite for your agent.
Actions
| Action | Description |
|---|
list | List all benchmarks in the organization |
create | Create a new benchmark |
get | Get a benchmark by ID |
update | Update a benchmark |
delete | Delete a benchmark |
Parameters
list
No parameters.
create
| Parameter | Type | Required | Description |
|---|
name | string | yes | Name of the benchmark |
description | string | no | Description of the benchmark |
timeout | number | no | Default timeout in seconds for tasks in this benchmark |
concurrency | number | no | Max concurrent task runs |
get
| Parameter | Type | Required | Description |
|---|
id | string | yes | Benchmark ID |
update
| Parameter | Type | Required | Description |
|---|
id | string | yes | Benchmark ID |
name | string | no | Updated name |
description | string | null | no | Updated description, or null to clear |
timeout | number | null | no | Updated timeout, or null to clear |
concurrency | number | null | no | Updated concurrency, or null to clear |
delete
| Parameter | Type | Required | Description |
|---|
id | string | yes | Benchmark ID |
Examples
Create a prior auth workflow benchmark
{
"action": "create",
"name": "Prior Auth Workflow",
"description": "End-to-end prior authorization submission and tracking",
"timeout": 300,
"concurrency": 5
}
List all benchmarks
Update benchmark concurrency
{
"action": "update",
"id": "bm_abc123",
"concurrency": 10
}
