Fleet Schemas ↑↓ move within a pane · ←→ move between panes · Enter opens · Esc backs out
BenchmarkDocument 46 fields

bench-homegrown/BenchmarkDocument

schemaVersion exactly 1
no description declared
required
id string matching /^[a-z0-9]+(?:-[a-z0-9]+)*$/
no description declared
required
title non-empty string
no description declared
required
summary non-empty string
no description declared
required
category one of: commit-writing | diarization | handwriting-ocr | image-generation | motion-critique | region-detection | structured-authoring | summarization | transcription | video-generation | vision | weekly-recap
no description declared
required
status one of: complete | partial | blocked | historical
no description declared
required
recommendation non-empty string
no description declared
recommendedModelIds non-empty list of string matching /^[A-Za-z0-9.-]+\/[A-Za-z0-9._:+-]+$/
no description declared
candidateRequirements object (additional keys allowed) 1 sub
no description declared
minContextTokens integer >= 0
no description declared
testedReasoningEfforts object (additional keys allowed)
no description declared
modelIds non-empty list of string matching /^[A-Za-z0-9.-]+\/[A-Za-z0-9._:+-]+$/
no description declared
required
currentDefault object (additional keys allowed) 2 sub
no description declared
modelId string matching /^[A-Za-z0-9.-]+\/[A-Za-z0-9._:+-]+$/
no description declared
required
reasoning non-empty string
no description declared
provenance object (additional keys allowed) 5 sub envelope
no description declared
required
legacyPath non-empty string
no description declared
required
legacyPublishedUrl string
no description declared
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
lineCount integer >= 0
no description declared
required
migratedAt string matching /^\d{4}-\d{2}-\d{2}$/
no description declared
required
lineageProof object (additional keys allowed) 4 sub
no description declared
evidenceRoot non-empty string
no description declared
required
round object (additional keys allowed) 2 sub
no description declared
required
path non-empty string
no description declared
required
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
preflight object (additional keys allowed) 2 sub
no description declared
required
path non-empty string
no description declared
required
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
parentRound object (additional keys allowed) 2 sub
no description declared
path non-empty string
no description declared
required
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
sections non-empty list of object (additional keys allowed) 5 sub
no description declared
required
id non-empty string
no description declared
required
title non-empty string
no description declared
required
level exactly 2 OR exactly 3 OR exactly 4
no description declared
required
collapsed boolean
no description declared
blocks non-empty list of object (additional keys allowed) OR object (additional keys allowed) 2 sub
no description declared
required
form 1 object (additional keys allowed) 2 sub
no description declared
required
type exactly "html"
no description declared
required
html string
no description declared
required
form 2 object (additional keys allowed) 4 sub
no description declared
required
type exactly "table"
no description declared
required
id non-empty string
no description declared
required
columns non-empty list of string
no description declared
required
rows list of list of string
no description declared
required

Rules

  • nonEmptyCandidateRequirements
  • validLegacyPublishedUrl
  • tableRowsMatchColumns
  • uniqueModelIds
  • recommendedModelsWereEvaluated
  • testedReasoningEffortsAreComplete
  • uniqueSectionAndTableIds
  • canonicalDuelTableAndLineageProof

Defects

No defects in the 15 records checked.

Where it lives

Bound bybench-homegrown
Declared in~/mnt/mdr/skills/bench-homegrown/assets/schemas/benchmark-document.ts
BindingbenchmarkDocumentDataStore
Directory~/mnt/mdr/skills/bench-homegrown/assets/benchmarks
Files*.json
Referenced asbenchmark-document