Early Release
This evaluator reflects early-stage work. We’re continuously improving its accuracy and reliability.
- Annotator coverage per item is limited; reported precision and agreement reflect this coverage. Additional annotations (potentially added in future updates) will improve statistical reliability by increasing confidence, reducing variance, and stabilizing borderline cases.
- Flesch–Kincaid grade estimates (based on sentence and word length) are recorded as metadata and may be referenced in the evaluator prompt as one of multiple signals. They are heuristic and do not capture qualitative factors (e.g., conceptual difficulty, vocabulary sophistication, thematic maturity), and are not the sole determinant of evaluator labels.