Skip to main content
Evaluator last updated October 14, 2026.

​
Overview

The Graphics Accuracy evaluator checks whether a math graphic, such as a plot, chart, diagram, equation, or worked solution, correctly shows what its accompanying text states. It also checks whether the image is sound on its own: complete, legible, and internally consistent. The evaluator treats the text as correct and the image as the thing under review. It works in 3 steps:
  1. Describe the image: Records what’s literally in the image, counts each feature the claim depends on (such as dots, bars, or sides) as an exact number rather than an estimate, and lists any defects, like a missing or illegible label, tick marks that don’t match their values, or parts that don’t add up to their stated total.
  2. Work out an answer: Finds the value or result the image yields, using only the image and any facts the question states in words, independent of what the claim says.
  3. Compare and decide: Checks its answer against the claim, then gives its verdict and the basis for it.
The evaluator returns a pass/fail verdict, not a score you set your own threshold on. Because the verdict is decided last, it follows from the answer the evaluator worked out. When the evaluator can’t confirm that a graphic is correct, it returns false rather than true.

​
At a glance

​
Getting started

Follow the Quickstart to start using this evaluator:

​
Inputs

When the graphic goes with a problem, use the question-and-answer form of the claim. The evaluator uses facts the question states in words, like given lengths or rules, and is less accurate without them. For example, instead of the statement “The trees have 9 apples,” submit the question “How many apples do all the trees have together?” with the answer “9.”
The evaluator checks only whether a graphic is mathematically correct. It doesn’t judge grade-level fit, standards alignment, or teaching quality. The evaluator isn’t designed for grading student work, or for graphics that are wrong on purpose (like a “find the mistake” problem) unless the claim says so.

​
Output

​
Interpreting results

​
Evaluator release history

Graphics evaluators

Explore other evaluators that assess the graphics in a text.

Math Standards Alignment

Check math questions against a standard’s learning components to see which math skills they measure.

Quickstart

Run an evaluator in the Evaluators playground, a Python notebook, or with the SDK.