Skip to main content
Look at the data. ↗

​
About the dataset

The Graphics Complexity dataset contains passages used to test the Graphics Complexity evaluator. It only includes passages where a majority of literacy experts agreed with the evaluator’s rating. Each passage is an informational text with one or more graphics, such as photographs, illustrations, diagrams, charts, or maps. The evaluator didn’t see any of these passages during development. The passages come from 3 sources: Literacy experts from Student Achievement Partners (SAP) reviewed the evaluator’s rating for each passage. They used a rubric based on the Use of Graphics dimension of SAP’s Qualitative Text Complexity Rubric for Informational Text.
This dataset doesn’t include the passages used to develop the evaluator. We plan to expand it with more graphic types and more Exceedingly Complex examples.

​
Our process

  • After the evaluator was finalized, we used 20 new passages from the same 3 sources.
  • Each graphic was prepared as an image file.
  • We ran the evaluator 3 times on each passage, and kept its most common rating.
  • 3 literacy experts from SAP independently reviewed each rating, noting whether they agree with it and scoring how sound its reasoning is on a scale of 1–5.
  • We published only the passages where a majority of the experts agreed with the evaluator’s rating. Of the 20 passages tested, 17 met that bar.

​
Fields

Last updated October 14, 2026This list will be updated as the dataset expands.

​
Limitations

  • The dataset is small (17 passages).
  • It doesn’t show cases where the experts disagreed with the evaluator’s rating and reasoning.
  • Each rating is the most common result of 3 runs. For 3 passages, the runs didn’t all agree (they were never more than one level apart), so a single run may not match the published rating.
  • The passages come from the same 3 sources used to develop the evaluator, so results may not generalize to other graphic types, like textbook diagrams, infographics, or comics.
  • Only grades 4, 5, 7, 8, 10, and 12 are represented, even though the evaluator supports grades 3–12.
  • There are no Exceedingly Complex examples.
  • Each interactive graphic is represented by a single screenshot, so the dataset doesn’t capture the demands of interacting with it.

Datasets

Understand what evaluator datasets are and how they are used.

Graphics evaluators

Explore evaluators that assess the graphics in instructional content.

Core concepts

Learn how evaluator datasets inform accuracy and validation.