Benchmarks - Verial

Manage benchmarks that group related tasks into a runnable test suite for your agent.

Actions

Action	Description
`list`	List all benchmarks in the organization
`create`	Create a new benchmark
`get`	Get a benchmark by ID
`update`	Update a benchmark
`delete`	Delete a benchmark

Parameters

`list`

No parameters.

`create`

Parameter	Type	Required	Description
`name`	string	yes	Name of the benchmark
`description`	string	no	Description of the benchmark
`timeout`	number	no	Default timeout in seconds for tasks in this benchmark
`concurrency`	number	no	Max concurrent task runs

`get`

Parameter	Type	Required	Description
`id`	string	yes	Benchmark ID

`update`

Parameter	Type	Required	Description
`id`	string	yes	Benchmark ID
`name`	string	no	Updated name
`description`	string \| null	no	Updated description, or null to clear
`timeout`	number \| null	no	Updated timeout, or null to clear
`concurrency`	number \| null	no	Updated concurrency, or null to clear

`delete`

Parameter	Type	Required	Description
`id`	string	yes	Benchmark ID

Examples

Create a prior auth workflow benchmark

{
  "action": "create",
  "name": "Prior Auth Workflow",
  "description": "End-to-end prior authorization submission and tracking",
  "timeout": 300,
  "concurrency": 5
}

List all benchmarks

{
  "action": "list"
}

Update benchmark concurrency

{
  "action": "update",
  "id": "bm_abc123",
  "concurrency": 10
}

​Actions

​Parameters

​list

​create

​get

​update

​delete

​Examples

​Create a prior auth workflow benchmark

​List all benchmarks

​Update benchmark concurrency

Actions

Parameters

`list`

`create`

`get`

`update`

`delete`

Examples

Create a prior auth workflow benchmark

List all benchmarks

Update benchmark concurrency