Skip to main content
Manage evals that define assertions checked against task outcomes.

​
Actions

ActionDescription
listList all evals for a task
createCreate a new eval
getGet an eval by ID
updateUpdate an eval
deleteDelete an eval

​
Parameters

​
list

ParameterTypeRequiredDescription
taskIdstringyesTask ID to list evals for

​
create

ParameterTypeRequiredDescription
taskIdstringyesTask ID to add the eval to
labelstringyesHuman-readable label for the eval
assertstringyesAssertion to evaluate (natural language or expression)
weightnumbernoRelative weight for scoring (default 1)

​
get

ParameterTypeRequiredDescription
idstringyesEval ID

​
update

ParameterTypeRequiredDescription
idstringyesEval ID
labelstringnoUpdated label
assertstringnoUpdated assertion
weightnumbernoUpdated weight

​
delete

ParameterTypeRequiredDescription
idstringyesEval ID

​
Examples

​
Create an eval for prior auth submission

{
  "action": "create",
  "taskId": "task_xyz789",
  "label": "Prior auth created",
  "assert": "A prior authorization request was submitted to the payer for the correct CPT code",
  "weight": 2
}

​
List evals for a task

{
  "action": "list",
  "taskId": "task_xyz789"
}

​
Update eval weight

{
  "action": "update",
  "id": "eval_def456",
  "weight": 3
}