Evaluation

Once you’ve configured your evaluator, you can start evaluating text inputs for grade level appropriateness:

example.py

from learning_commons_evaluators import (
  GradeLevelAppropriatenessEvaluator,
  GradeLevelAppropriatenessInput,
)

evaluator = GradeLevelAppropriatenessEvaluator(google_api_key="your-google-key")

result = evaluator.evaluate_sync(
  GradeLevelAppropriatenessInput(text="The cat's out of the bag now.")
)

Inputs

Each evaluator requires different input fields when invoking evaluate().

Text Complexity

Grade Level Appropriateness takes { text }:

Field	Type	Description
`text`	`string`	Informational text to evaluate. 10–10,000 characters

All other Text Complexity evaluators take { text, grade_level }:

Field	Type	Description
`text`	`string`	Informational text to evaluate. Length limits vary by evaluator (typically 1–10,000 characters)
`grade_level`	`int`	Target student grade, 3–12. Passed as an integer

from learning_commons_evaluators import (
  VocabularyComplexityEvaluator,
  VocabularyComplexityInput,
)

evaluator = VocabularyComplexityEvaluator(
  openai_api_key="your-openai-key",
  google_api_key="your-google-key",
)

result = evaluator.evaluate_sync(
  VocabularyComplexityInput(text="The cat's out of the bag now.", grade_level=5)
)

Feedback

Feedback evaluators take { student_text, feedback_text }:

Field	Type	Description
`student_text`	`string`	Student’s written response. 1–10,000 characters
`feedback_text`	`string`	Teacher or AI feedback to evaluate. 1–10,000 characters

Academic Standards

Math Standards Alignment has two entry points, depending on how you name the standard.

evaluate() — by CASE UUID

Field	Type	Description
`question`	`string`	Math assessment question to evaluate. 1–10,000 characters
`case_identifier_uuid`	`string`	CASE Network UUID of the math standard — the Knowledge Graph’s `caseIdentifierUUID`

from learning_commons_evaluators import MathStandardsAlignmentEvaluator

evaluator = MathStandardsAlignmentEvaluator(
  anthropic_api_key="your-anthropic-key",
  learning_commons_api_key="your-learning-commons-key",
)

result = evaluator.evaluate_sync(
  question="What is 3/4 + 1/8?",
  case_identifier_uuid="6ba25656-d7cc-11e8-824f-0242ac160002",
)

evaluate_by_code() — by standard code

Only question and statement_code are required.

Field	Type	Description
`question`	`string`	Math assessment question to evaluate. 1–10,000 characters
`statement_code`	`string`	Math standard code, spelled as its jurisdiction spells it (e.g., `"3.MD.C.7.d"`, `"K.CC.A.1"`). 1–50 characters
`jurisdiction`	`Jurisdiction` ↗	Optional. Whose framework the code belongs to (`JurisdictionENUM`). Defaults to `Jurisdiction.MULTI_STATE`, which is
`grade_level`	`string`	Optional, `"K"` through `"12"`. Only consulted when a code names more than one standard, which happens when a framework reuses codes across courses

import asyncio

from learning_commons_evaluators import MathStandardsAlignmentEvaluator

evaluator = MathStandardsAlignmentEvaluator(
  anthropic_api_key="your-anthropic-key",
  learning_commons_api_key="your-learning-commons-key",
)

result = asyncio.run(
  evaluator.evaluate_by_code(
    question="What is 3/4 + 1/8?",
    statement_code="5.NF.A.1",
  )
)

Output

All Text Complexity, Feedback, and Academic Standards evaluators have the following output fields:

Field	Type	Description
`evaluator`	`string`	Registry ID for the evaluator used
`result`	Unique to each evaluator See “Output” for each evaluator (e.g., for Grade Level Appropriateness)	Detailed internal analysis data specific to each evaluator
`metadata`	`EvaluationMetadata` ↗	Includes model used to generate the evaluation, total evaluation processing time in milliseconds, input tokens, and output tokens

Quickstart

Install the SDK and run your first evaluator.

Configuration

Configure evaluators, including API keys and options.

Error handling

Handle configuration, validation, and API errors.

Understanding evaluators

Getting started

SDK API reference

Text Complexity evaluators

Feedback evaluators

Academic standards evaluators

Durable skills evaluators

Datasets

Resources

Inputs

Text Complexity

Feedback

Academic Standards

evaluate() — by CASE UUID

evaluate_by_code() — by standard code

Output

Quickstart

Configuration

Error handling

​Inputs

​Text Complexity

​Feedback

​Academic Standards

​evaluate() — by CASE UUID

​evaluate_by_code() — by standard code

​Output

​Related topics

Quickstart

Configuration

Error handling

Inputs

Text Complexity

Feedback

Academic Standards

evaluate() — by CASE UUID

evaluate_by_code() — by standard code

Output

Related topics