Fleet Schemas ↑↓ move within a pane · ←→ move between panes · Enter opens · Esc backs out
GenTracesExperimentJudgments 14 fields

autoresearch-experiments/GenTracesExperimentJudgments

protocolHash string matching /^sha256:[a-f0-9]{64}$/
Recorded recipe identity; migrations preserve the exact hash.
required
errors non-empty list of object
Recorded failures outside the outcome rows.
1,939
stage one of: fire | judge
Execution boundary that failed.
required
runId non-empty string
Recorded generation run id, when available.
message non-empty string
Failure retained outside the verdict denominator.
required
_legacy map of any shape (not yet constrained by the schema)
Unmapped historical values preserved by lossless migration, including row members indexed by original position. Never a live write target.
2,757
runs list of object
Samples in original execution order.
required
runId non-empty string
Canonical generation run id resolving this row input and output.
required
judged exactly "RED" OR exactly "GREEN" OR exactly "BLACK"
Whether this judge run graded its reply correctly: GREEN when its verdict matches the reference color for the reply it judged (the human hand grade in a trial, otherwise the reply's settled color), RED when it does not. Correctness is only informative once a trial has supplied hand grades; rows recorded before any trial read GREEN because they produced the color they were recorded against. When the reply settled no color at all, because its samples split or too few survived, there is no reference to agree with, so the row carries that sample's own verdict instead.
required
attribution map of string OR list of string
Producer-owned entries attributing a verdict to a rule or criterion. The engine stores these entries without interpreting them; unrelated metadata is forbidden. The producer enforces its own strict shape before writing.
judgedInput non-empty string
Recorded reply id graded by this sample.
required
sample object
Facts written by one grading sample.
verdict exactly "RED" OR exactly "GREEN" OR exactly "BLACK"
The sample outcome, independent of agreement with a reference; absence never inherits judged.
criticalDefect non-empty string
The sample report that its input could not be graded, retained outside settled outcomes.

Checks

  • _checkRunIdentityUniqueness
  • _checkRecordRows

Defects

Checked 200 of 6,725 records (the per-store cap is 200), so this is a sample, not a whole-store verdict.

No defects in the 200 records checked.

Where it lives

Bound byautoresearch-experiments
Declared in~/mnt/mdr/skills/autoresearch-experiments/assets/schemas/gen-traces-experiment-results.ts
BindinggenTracesExperimentJudgeDataStore
Directory~/runs/autoresearch-experiments
Files*/*/*/artifacts/trace-judge.yml
Referenced asgen-traces-experiment-judgments