> ## Documentation Index
> Fetch the complete documentation index at: https://docs.verial.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Benchmarks

> Manage benchmarks (groups of tasks with criteria).

Manage benchmarks that group related tasks into a runnable test suite for your agent.

## Actions

| Action   | Description                             |
| -------- | --------------------------------------- |
| `list`   | List all benchmarks in the organization |
| `create` | Create a new benchmark                  |
| `get`    | Get a benchmark by ID                   |
| `update` | Update a benchmark                      |
| `delete` | Delete a benchmark                      |

## Parameters

### `list`

No parameters.

### `create`

| Parameter     | Type   | Required | Description                                            |
| ------------- | ------ | -------- | ------------------------------------------------------ |
| `name`        | string | yes      | Name of the benchmark                                  |
| `description` | string | no       | Description of the benchmark                           |
| `timeout`     | number | no       | Default timeout in seconds for tasks in this benchmark |
| `concurrency` | number | no       | Max concurrent task runs                               |

### `get`

| Parameter | Type   | Required | Description  |
| --------- | ------ | -------- | ------------ |
| `id`      | string | yes      | Benchmark ID |

### `update`

| Parameter     | Type           | Required | Description                           |
| ------------- | -------------- | -------- | ------------------------------------- |
| `id`          | string         | yes      | Benchmark ID                          |
| `name`        | string         | no       | Updated name                          |
| `description` | string \| null | no       | Updated description, or null to clear |
| `timeout`     | number \| null | no       | Updated timeout, or null to clear     |
| `concurrency` | number \| null | no       | Updated concurrency, or null to clear |

### `delete`

| Parameter | Type   | Required | Description  |
| --------- | ------ | -------- | ------------ |
| `id`      | string | yes      | Benchmark ID |

## Examples

### Create a prior auth workflow benchmark

```json theme={null}
{
  "action": "create",
  "name": "Prior Auth Workflow",
  "description": "End-to-end prior authorization submission and tracking",
  "timeout": 300,
  "concurrency": 5
}
```

### List all benchmarks

```json theme={null}
{
  "action": "list"
}
```

### Update benchmark concurrency

```json theme={null}
{
  "action": "update",
  "id": "bm_abc123",
  "concurrency": 10
}
```