Overview
The Revision Actionability evaluator assesses whether a piece of feedback gives the student a clear, usable next step they can reasonably act on without additional clarification. The evaluator considers:- Presence of a directive verb (e.g., add, replace, clarify, explain, revise) or focused question that points somewhere specific
- Whether feedback goes beyond evaluative comments (e.g., “good job,” “this is incomplete”)
- Clarity of the target (is it clear what should be revised?)
- Specificity of the next move (a concrete directive rather than a vague instruction)
- Whether the student could reasonably act without further clarification or more information
- Whether a next step is warranted at all (a response that didn’t require revision should not draw a forced directive)
At a glance
The evaluator was built and validated using the model and temperature below (other configurations will produce different results and may have lower accuracy):
Getting started
Follow the Quickstart to start using this evaluator:Inputs
Example input
Output
Example output
Interpreting results
Evaluator release history
Related topics
Feedback evaluators
Explore other evaluators that assess the quality of coaching feedback.
Quickstart
Run an evaluator in the Evaluators playground, a Python notebook, or with
the SDK.