voice-transcript criteria against the transcript.
How your agent connects
When the benchmark run is created, the voice sandbox’scredentials payload includes a leased phone number your agent can dial. The call connects to a simulated IVR flow configured on the simulator, optionally backed by a patient persona or human-facing agent. Your agent drives the conversation; Verial captures the audio and produces a turn-by-turn transcript with speaker labels.
Voice sandboxes route calls through a hosted IVR runtime. There is no /v1/benchmark-runs/{id}/voice/* HTTP surface during the rollout. The rollout happens over telephony. The resulting transcript is available through the benchmark run’s interaction evidence.
Connection model
| Artifact | Where to find it |
|---|---|
| Phone number | credentials.phone_number on the voice sandbox (in the benchmark-run response’s sandboxes list) |
| Expected IVR flow | Simulator config.ivr |
| Transcript | Interaction evidence; exposed through criterion.evidence after the rollout |
Driving the rollout
- Read the phone number out of the benchmark-run response.
- Place the call from your agent (Twilio, Retell, or any telephony runtime).
- Navigate the IVR, interact with the persona, and end the call.
- Complete the task run; the verification engine fetches the transcript and scores
voice-transcriptcriteria.
sandboxes array for the voice sandbox and its leased phone_number in credentials.
Configuration
At create time you configure the IVR flow, the persona the caller speaks to, and optional scripted beats the persona should hit.Verification
Thevoice-transcript check inspects the call transcript for required and forbidden phrases. Phrase matching is LLM-assisted so the check is robust to paraphrasing.
Next Steps
Criteria
Full reference for
voice-transcript assertions.Interactions
How transcripts and other evidence are recorded and retrieved.
Simulators overview
Lifecycle, provisioning, and configuration patterns.
Messages
Pair voice with SMS for multi-channel patient outreach.