Prepare scoring checklist calibration with contrasting exemplars

A calibration pack with evidence annotations and unresolved scoring disagreements.

Choose one of three approaches. The steps for that option appear below.

Choose an option above. On a phone, swipe the tabs left or right to see all options →

Gemini Notebook: drafts the matrix, then the pack

Gemini Notebook drafts a sample-by-criterion matrix, then the calibration pack. You correct the matrix in between.

  1. You

    Get ready

  2. Gemini Notebook

    Draft the matrix

  3. You

    Correct the matrix

  4. Gemini Notebook

    Draft the pack

  5. You

    Check and decide

  1. Have ready: checklist, samples, judgements

    Use: You

    The essay scoring checklist, the samples and the differing teacher judgements. Keep originals unchanged.

    Check

    Check you may use each file. This guide does not confirm upload is allowed; check your organisation's rules.

  2. Draft the sample-by-criterion matrix

    Use: Gemini Notebook

    Add the checked inputs and ask for a matrix with ambiguous boundaries, unsupported items marked unresolved.

    Details

    What to paste into the tool

    Using only the added inputs, produce a Sample-by-criterion matrix with ambiguous boundaries. Give one row per item with its source location. If the inputs do not support a row, write UNRESOLVED. Do not add outside facts.

  3. Correct the matrix row by row

    Use: You

    Correct the draft matrix row by row and keep unresolved items in place.

    Check

    Compare each draft matrix row with the original. Preserve the independent original judgements.

  4. Draft the calibration pack

    Use: Gemini Notebook

    Give it the corrected matrix. Ask for a calibration pack with evidence annotations and unresolved scoring disagreements.

    Details

    What to paste into the tool

    Using only the corrected table, draft the calibration pack with evidence annotations and unresolved scoring disagreements. Mark anything the table does not support as UNRESOLVED.

  5. Check the pack and decide what to keep

    Use: You

    Check the draft pack against the original inputs and decide what to keep.

    Check

    Teachers decide anchor levels; proposed judgements never update official scores. Check the pack against the original inputs.

Before you paste into any AI tool, remove any confidential information. Put it back at the end.

Tools in this workflow

Final check

Every stage output is checked by the named person before the next stage.

Unresolved items stay visible and are not filled in by the tool.

Only the supplied sources are used as authority.

Check the result against your original inputs. Approve it before sharing or acting.

What still needs checking
  • Final anchor levels are for the teachers to agree; this draft proposes none as official.

Share this page