Skip to main content
Evaluator last updated June 24, 2026.

Overview

The Revision Actionability evaluator assesses whether a piece of feedback gives the student a clear, usable next step they can reasonably act on without additional clarification. The evaluator considers:
  • Presence of a directive verb (e.g., add, replace, clarify, explain, revise) or focused question that points somewhere specific
  • Whether feedback goes beyond evaluative comments (e.g., “good job,” “this is incomplete”)
  • Clarity of the target (is it clear what should be revised?)
  • Specificity of the next move (a concrete directive rather than a vague instruction)
  • Whether the student could reasonably act without further clarification or more information
  • Whether a next step is warranted at all (a response that didn’t require revision should not draw a forced directive)

At a glance

The evaluator was built and validated using the model and temperature below (other configurations will produce different results and may have lower accuracy):

Getting started

Follow the Quickstart to start using this evaluator:

Inputs

Example input

Output

Example output

Interpreting results

Evaluator release history

Feedback evaluators

Explore other evaluators that assess the quality of coaching feedback.

Quickstart

Run an evaluator in the Evaluators playground, a Python notebook, or with the SDK.