Overview
The Organizational Structure evaluator assesses the structural complexity of an informational text — whether its ideas are arranged in a clear, predictable sequence with explicit connections, or woven into an intricate structure that asks the reader to infer how the pieces relate. Two texts can share the same vocabulary, sentence length, and grade-level reading score, yet place very different demands on a reader depending on how they’re organized. The Organizational Structure evaluator surfaces this dimension directly, so developers can optimize prompts, match texts to instructional goals, and maintain quality at scale. The evaluator works in 2 steps:-
Identify structure – Detects the organizational pattern(s) a text uses to arrange its ideas and how explicitly it signals the connections between them
- Evaluate structural demand – Weighs those structural demands against what students at the target grade are expected to navigate independently
At a glance
The evaluator was built and validated using the model and temperature below (other configurations will produce different results and may have lower accuracy):
Getting started
Follow the Quickstart to start using this evaluator:Inputs
Output
Evaluator release history
Related topics
Literacy evaluators
Explore other evaluators that assess qualitative text complexity.
Literacy dataset
Explore the expert-annotated benchmark behind literacy evaluators.
Quickstart
Run an evaluator in the Evaluators playground, a Python notebook, or with
the SDK.