Benchmarks - Verial

Benchmarks group Tasks into a test suite. Each benchmark references an Environment and defines timeout and concurrency settings. Each task inside a benchmark has Criteria that the verification engine runs to score task runs.

Endpoints

Method	Endpoint	Description
`GET`	`/benchmarks`	List benchmarks
`POST`	`/benchmarks`	Create a benchmark
`GET`	`/benchmarks/{id}`	Get benchmark details
`PATCH`	`/benchmarks/{id}`	Update a benchmark
`DELETE`	`/benchmarks/{id}`	Delete a benchmark

Benchmark Object

Field	Type	Description
`id`	string	Unique identifier
`name`	string	Benchmark name
`description`	string \| null	Optional description
`timeout`	number	Max execution time in seconds
`concurrency`	number	Max concurrent task executions
`organization_id`	string	Parent organization
`created_at`	datetime	Creation timestamp
`updated_at`	datetime	Last modification timestamp

SDK Example

// Create a benchmark
const benchmark = await verial.benchmarks.create({
  name: 'Prior Auth E2E',
  environmentId: 'env_abc123',
  timeout: 300,
  concurrency: 5,
})

// List all benchmarks
const benchmarks = await verial.benchmarks.list()

// Get a specific benchmark
const details = await verial.benchmarks.get({ id: benchmark.id })

// Update
await verial.benchmarks.update({
  id: benchmark.id,
  timeout: 600,
})

// Delete
await verial.benchmarks.delete({ id: benchmark.id })

​Endpoints

​Benchmark Object

​SDK Example

Endpoints

Benchmark Object

SDK Example