portal-state-match criteria against the resulting portal state.
Portal catalog
The
slug goes in the config.portal field when you create the simulator.
How your agent connects
Each sandbox gets its own credential pair, valid only for that sandbox’s lifetime. When the benchmark run is created (or a sandbox is provisioned directly), the sandbox’scredentials payload contains:
The same backing state is shared between the UI and the API, so you can drive the portal with Playwright / Stagehand / browser-use or call the REST endpoints directly, and criteria will score either path identically.
Endpoints (REST)
The REST API behind the portal is rooted atapi_url. Key endpoints:
These match the direct-access endpoints documented under Submit prior auth, Get prior auth, and List payer patients.
Driving the rollout
Browser path (Playwright):Configuration
Verification
Theportal-state-match check correlates a submitted PA (by request_id, auth_number, or another key) with its row in portal state and asserts on field values.
Interaction evidence
Every UI action (form submit, patient search, auth submission) and every API call is recorded as a sandbox event alongside the request/response pair. Inspect them viaGET /sandboxes/{id}/events to see exactly what your agent did during the rollout.
Next Steps
Web Simulator Quickstart
Provision a RadMD sandbox and log in from a browser in under 5 minutes.
Criteria
Full reference for
portal-state-match assertions.Payer API reference
Direct-access prior-auth endpoints.
Simulators overview
Lifecycle, provisioning, and configuration patterns.