Skip to main content
POST
cURL
Grading is asynchronous: each accepted session gets a result with status: queued; poll it with GET /agents/{agent_id}/evaluations/{evaluation_id} until it is completed or failed. A new result replaces the previous result for that session.Sessions are skipped, not rejected, when they are unfinished, incognito, or not owned by this agent (ineligible), or already have a queued or running result (in_flight, with the existing result_id). The caller is charged one credit per queued session. Set dry_run: true to see the cost and skips without queuing anything.Requires edit access on the agent and a plan with evaluations enabled.

Authorizations

Authorization
string
header
required

A personal API key or an OAuth 2.0 access token. Personal API keys also require the x-auth-key header with your user ID.

Path Parameters

agent_id
string
required

ID of the agent that owns the sessions.

Body

application/json
session_ids
string[]
required

Sessions to grade. Duplicates are rejected.

Required array length: 1 - 200 elements
dry_run
boolean
default:false

Report cost and skipped sessions without queuing.

Response

Dry run — nothing was queued. results lists the sessions that would run with status: planned and no id.

dry_run
boolean
credit_cost
integer

Credits charged (or, on a dry run, that would be charged) — one per queued session.

results
object[]

Sessions accepted, in request order.

skipped
object[]