Fetch Evaluation Scenarios

GET 
/evaluations/:evaluation_id/evaluation_scenarios

Fetches evaluation scenarios for a given evaluation ID.

Arguments: evaluation_id (str): The ID of the evaluation for which to fetch scenarios.

Raises: HTTPException: If the evaluation is not found or access is denied.

Returns: List[EvaluationScenario]: A list of evaluation scenarios.

Request

Path Parameters

evaluation_id Evaluation Idrequired

Responses

200

Successful Response

application/json

Schema

Schema

• Array [

idobject
anyOf
MOD1
string
evaluation_id Evaluation Id (string)required
inputsobject[]required

Array [

name Name (string)required

type Type (string)required

value Valuerequired

]

outputsobject[]required

Array [

resultobjectrequired

type Type (string)required

valueobject

anyOf

errorobject

anyOf

Error

message Message (string)required

stacktraceobject

anyOf

MOD1

string

costobject

anyOf

MOD1

number

latencyobject

anyOf

MOD1

number

]

correct_answersobject

anyOf

MOD1

Array [

key Key (string)required

value Value (string)required

]

is_pinnedobject
anyOf
MOD1
boolean
noteobject
anyOf
MOD1
string
resultsobject[]required

Array [

evaluator_config Evaluator Config (string)required

resultobjectrequired

type Type (string)required

valueobject

anyOf

errorobject

anyOf

Error

message Message (string)required

stacktraceobject

anyOf

MOD1

string

]

• ]

Example (from schema)

[
  {
    "id": "string",
    "evaluation_id": "string",
    "inputs": [
      {
        "name": "string",
        "type": "string"
      }
    ],
    "outputs": [
      {
        "result": {
          "type": "string",
          "error": {}
        },
        "cost": 0,
        "latency": 0
      }
    ],
    "correct_answers": [
      null
    ],
    "is_pinned": true,
    "note": "string",
    "results": [
      {
        "evaluator_config": "string",
        "result": {
          "type": "string",
          "error": {}
        }
      }
    ]
  }
]

422

Validation Error

application/json

Schema

Schema

detailobject[]

Array [

locobject[]required

Array [

anyOf

MOD1

string

MOD2

integer

]

msg Message (string)required

type Error Type (string)required

]

Example (from schema)

{
  "detail": [
    {
      "loc": [
        "string",
        0
      ],
      "msg": "string",
      "type": "string"
    }
  ]
}

Loading...