Fleet Schemas ↑↓ move within a pane · ←→ move between panes · Enter opens · Esc backs out
ConformanceEvidence 122 fields

models/ConformanceEvidence

schemaVersion exactly 1
Evidence grammar version.
required
createdAt string matching /^\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}(?:\.\d{3})?Z$/
UTC timestamp of the probe run that wrote this evidence.
required
mode one of: probe | soft
probe = deterministic checks; soft = two-artifact judgement bundle.
required
modality one of: text | image | video | music
Media kind exercised by the probe.
required
model string matching /^[a-z0-9-]+\/[A-Za-z0-9][A-Za-z0-9._:-]*$/
Canonical creator-vendor model id, e.g. openai/sora-2.
required
family non-empty string
Evidence directory segment; sanitized model id for current-writer records, hand-named slugs on legacy ones.
required
endpoint non-empty string
Model endpoint the probe dispatched through; default unless a named endpoint was probed.
required
param non-empty string
Probed parameter; equals the evidence file basename.
required
value string
Probed parameter value as passed on the command line; numbers are stringified.
118
prompt string
Prompt used for the probe. Always written by the current writer; absent only on legacy records.
112
runIds list of string matching /^\d{4}-\d{2}-\d{2}\/\d{2}_\d{2}_\d{2}_\d{3}$/
query-llm run-registry ids backing this evidence.
required
status one of: passed | failed | blocked
Aggregate verdict: blocked = probe could not determine an answer (quota, missing tool).
required
reason string
First failure or block reason.
43
commands list of object
Slim per-attempt execution rows; verbose stdout/stderr stays out of evidence.
required
runId string
query-llm run id for this attempt.
status number OR exactly null
Process exit code, or the provider HTTP status on legacy rows; null when the attempt died before exiting.
required
classification one of: passed | failed | blocked
Per-attempt verdict.
required
reason string
Classification detail, e.g. the provider rejection message.
artifacts list of object
Generated artifact references with hash proof; bytes live in the run registry, not here.
required
path non-empty string
Artifact path at write time; may no longer exist on disk.
required
exists boolean
Whether the path existed when the evidence was written.
required
sha256 string matching /^[a-f0-9]{64}$/
SHA-256 of the artifact bytes.
label string
Role label on legacy multi-reference rows.
firstFrame string
Extracted first-frame path on legacy video rows.
ffprobe any shape (not yet constrained by the schema)
Legacy per-artifact ffprobe capture; flat or raw ffprobe JSON.
bytes number
Artifact byte size on legacy rows.
dimensions any shape (not yet constrained by the schema)
Legacy per-artifact dimension capture.
quality string
Requested quality tier on legacy rows.
checks object
Deterministic check payloads keyed by check family; empty when the param has no deterministic check.
required
aspect list of object
Dimension inspections for aspect probes.
path non-empty string
Inspected artifact path.
width number
Pixel width.
height number
Pixel height.
durationSeconds number
Video duration in seconds, when the artifact is a video.
duration list of object
Duration inspections for duration probes.
path non-empty string
Inspected artifact path.
width number
Pixel width.
height number
Pixel height.
durationSeconds number
Video duration in seconds, when the artifact is a video.
video list of object
Legacy video inspections.
path non-empty string
Inspected artifact path.
width number
Pixel width.
height number
Pixel height.
durationSeconds number
Video duration in seconds, when the artifact is a video.
repeatHashes list of object
Artifact hashes across repeated generations.
path non-empty string
no description declared
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
allIdentical boolean
Whether every repeated generation hashed identically (temperature probes).
sameSeedIdentical boolean
Whether two same-seed generations hashed identically.
differentSeedDifferent boolean
Whether a different-seed generation hashed differently.
imageInput object
Source-vs-output comparison produced by the deterministic SSIM/frame checks.
status one of: passed | blocked | candidate
passed/blocked from the current comparator; candidate marks a legacy result awaiting human review.
required
reason string
Why the comparison could not complete.
detail string
Tool error detail behind a blocked comparison.
source string
Reference artifact path or URL.
output string
Generated artifact path compared against the source.
firstFrame string
Extracted first-frame image path (legacy frame comparisons).
lastFrame string
Extracted last-frame image path (legacy frame comparisons).
statsPath string
ffmpeg SSIM stats file path.
statsPreview list of string
First lines of the SSIM stats file.
dimensions object
Normalized comparison dimensions.
width number
no description declared
required
height number
no description declared
required
imageFirst object
Source-vs-output comparison produced by the deterministic SSIM/frame checks.
status one of: passed | blocked | candidate
passed/blocked from the current comparator; candidate marks a legacy result awaiting human review.
required
reason string
Why the comparison could not complete.
detail string
Tool error detail behind a blocked comparison.
source string
Reference artifact path or URL.
output string
Generated artifact path compared against the source.
firstFrame string
Extracted first-frame image path (legacy frame comparisons).
lastFrame string
Extracted last-frame image path (legacy frame comparisons).
statsPath string
ffmpeg SSIM stats file path.
statsPreview list of string
First lines of the SSIM stats file.
dimensions object
Normalized comparison dimensions.
width number
no description declared
required
height number
no description declared
required
imageLast object
Source-vs-output comparison produced by the deterministic SSIM/frame checks.
status one of: passed | blocked | candidate
passed/blocked from the current comparator; candidate marks a legacy result awaiting human review.
required
reason string
Why the comparison could not complete.
detail string
Tool error detail behind a blocked comparison.
source string
Reference artifact path or URL.
output string
Generated artifact path compared against the source.
firstFrame string
Extracted first-frame image path (legacy frame comparisons).
lastFrame string
Extracted last-frame image path (legacy frame comparisons).
statsPath string
ffmpeg SSIM stats file path.
statsPreview list of string
First lines of the SSIM stats file.
dimensions object
Normalized comparison dimensions.
width number
no description declared
required
height number
no description declared
required
legacy object
Imported pre-harness seed evidence with its original source path.
sourcePath non-empty string
no description declared
required
models list of object
no description declared
required
model non-empty string
no description declared
required
route non-empty string
no description declared
required
rawDir non-empty string
no description declared
required
sameSeedOutputs list of string
no description declared
required
controlOutput string
no description declared
required
sameSeedIdentical boolean
no description declared
required
controlDiffers boolean
no description declared
required
softJudgement object
Legacy soft-mode judgement summary.
expectedEffect non-empty string
no description declared
required
artifactCount integer
no description declared
required
frames list of string
Extracted frame paths behind a legacy soft judgement.
agentJudgement non-empty string
Legacy agent verdict on a soft bundle.
judgementReason non-empty string
Legacy agent reasoning behind agentJudgement.
contactSheet non-empty string
Legacy contact-sheet image path.
providerError object
Provider rejection captured by a legacy probe.
status non-empty string
no description declared
required
message non-empty string
no description declared
required
status exactly "blocked"
Written only when deterministic inspection itself failed.
reason string
Why deterministic inspection failed.
detail string
Tool error behind a blocked inspection.
softBundle object
Two-artifact judgement bundle written by soft-mode probes.
1
artifactA non-empty string
no description declared
required
artifactB non-empty string
no description declared
required
expectedEffect non-empty string
no description declared
required
judgement object
no description declared
required
question non-empty string
no description declared
required
acceptWhen list of string
no description declared
required
rejectWhen list of string
no description declared
required
result non-empty string
Recorded human/agent judgement outcome.
reason non-empty string
Reasoning behind the recorded judgement.

Checks

This binding declares no checks beyond its field shape.

Defects

No defects in the 126 records checked.

Where it lives

Bound bymodels-catalog
Declared bylib-models
Declared in~/mnt/mdr/skills/lib-models/assets/schemas/conformance-evidence.ts
Bound in~/mnt/mdr/skills/models-catalog/assets/schemas/conformance-evidence.ts
BindingconformanceEvidenceDataStore
Directory~/data/models-catalog/conformance
Files*/*/*.json
Referenced asconformance-evidence