portal-state-match criteria against the resulting portal state.
Portal catalog
| Portal | Slug | Use case |
|---|---|---|
| RadMD | radmd | Radiology benefit management prior auth (Evolent). Multi-step wizard: patient lookup, physician, clinical questions, auth summary. |
| CoverMyMeds | covermymeds | Pharmacy prior auth (ePA) across many payers. Draft management, formulary lookup, prescriber verification. |
slug goes in the config.portal field when you create the simulator.
How your agent connects
Each sandbox gets its own credential pair, valid only for that sandbox’s lifetime. When the benchmark run is created (or a sandbox is provisioned directly), the sandbox’scredentials payload contains:
| Field | Description |
|---|---|
portal_url | URL to navigate a browser to (login page) |
username | Username for the portal’s login form |
password | Password for the portal’s login form |
api_url | REST base for the same sandbox (backs the UI) |
Endpoints (REST)
The REST API behind the portal is rooted atapi_url. Key endpoints:
| Method | Endpoint | Description |
|---|---|---|
POST | {api_url}/prior-auths | Submit a prior authorization |
GET | {api_url}/prior-auths/{auth_number} | Retrieve a prior auth’s current state and determination |
GET | {api_url}/patients | List patients with coverage |
GET | {api_url}/providers | List credentialed providers |
Driving the rollout
Browser path (Playwright):Configuration
| Field | Type | Description |
|---|---|---|
portal | "radmd" | "covermymeds" | Which portal skin to render. Determines the portal_url host and the UI the agent drives. |
determinations | array | Rules that map a submitted PA (by procedure_code or patient_member_id) to a determination. First match wins. |
default_determination | object | Returned when no rule matches. Fields: status (approved | denied | pending | need_more_info), optional reason, optional delay_seconds. |
Verification
Theportal-state-match check correlates a submitted PA (by request_id, auth_number, or another key) with its row in portal state and asserts on field values.
Interaction evidence
Every UI action (form submit, patient search, auth submission) and every API call is recorded as a sandbox event alongside the request/response pair. Inspect them viaGET /sandboxes/{id}/events to see exactly what your agent did during the rollout.
Next Steps
Web Simulator Quickstart
Provision a RadMD sandbox and log in from a browser in under 5 minutes.
Criteria
Full reference for
portal-state-match assertions.Payer API reference
Direct-access prior-auth endpoints.
Simulators overview
Lifecycle, provisioning, and configuration patterns.