Create Human Evaluation

POST 
/human-evaluations

Creates a new comparison table document Raises: HTTPException: description Returns: description

Request

application/json

Body

required

app_id App Id (string)required
variant_ids string[]required
evaluation_type EvaluationType (string)required

Possible values: [human_a_b_testing, single_model_test]

inputs string[]required
testset_id Testset Id (string)required
status Status (string)required

Responses

200

Successful Response

application/json

Schema

Schema

id Id (string)required
variant_ids string[]required
app_id App Id (string)required
status Status (string)required
evaluation_type EvaluationType (string)required

Possible values: [human_a_b_testing, single_model_test]

Example (from schema)

{
  "id": "string",
  "variant_ids": [
    "string"
  ],
  "app_id": "string",
  "status": "string",
  "evaluation_type": "human_a_b_testing"
}

422

Validation Error

application/json

Schema

Schema

detail

object[]

Array [

loc

object[]

required

Array [

anyOf

MOD1

string

MOD2

integer

]

msg Message (string)required

type Error Type (string)required

]

Example (from schema)

{
  "detail": [
    {
      "loc": [
        "string",
        0
      ],
      "msg": "string",
      "type": "string"
    }
  ]
}

Loading...