Skip to main content
Install the Python SDK, then run an evaluator from your project.

Install the SDK

Install the SDK from the package registry rather than cloning the evaluators repository ↗. The published package is versioned, so you can pick up fixes and new evaluators with a standard package update:

Run an evaluator

Supported evaluators

See which evaluators the Python SDK includes, and which API keys they need.

Configuration

Configure evaluators, including API keys and options.

Evaluation

Understand evaluator input and output fields.

Error handling

Handle configuration, validation, and API errors.