Fleet Schemas ↑↓ move within a pane · ←→ move between panes · Enter opens · Esc backs out
BenchmarkDocument 46 fields

bench-homegrown/BenchmarkDocument

schemaVersion exactly 1
no description declared
required
id string matching /^[a-z0-9]+(?:-[a-z0-9]+)*$/
no description declared
required
title non-empty string
no description declared
required
summary non-empty string
no description declared
required
category one of: commit-writing | diarization | handwriting-ocr | image-generation | motion-critique | region-detection | structured-authoring | summarization | transcription | video-generation | vision | weekly-recap
no description declared
required
status one of: complete | partial | blocked | historical
no description declared
required
recommendation non-empty string
no description declared
recommendedModelIds non-empty list of string matching /^[A-Za-z0-9.-]+\/[A-Za-z0-9._:+-]+$/
no description declared
0
candidateRequirements object
no description declared
4
minContextTokens integer > 0
no description declared
testedReasoningEfforts map of non-empty list of non-empty string
no description declared
6
modelIds non-empty list of string matching /^[A-Za-z0-9.-]+\/[A-Za-z0-9._:+-]+$/
no description declared
required
currentDefault object
no description declared
8
modelId string matching /^[A-Za-z0-9.-]+\/[A-Za-z0-9._:+-]+$/
no description declared
required
reasoning non-empty string
no description declared
provenance object
no description declared
required
legacyPath non-empty string
no description declared
required
legacyPublishedUrl string
no description declared
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
lineCount integer > 0
no description declared
required
migratedAt string matching /^\d{4}-\d{2}-\d{2}$/
no description declared
required
lineageProof object
no description declared
4
evidenceRoot non-empty string
no description declared
required
round object
no description declared
required
path non-empty string
no description declared
required
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
preflight object
no description declared
required
path non-empty string
no description declared
required
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
parentRound object
no description declared
path non-empty string
no description declared
required
sha256 string matching /^[a-f0-9]{64}$/
no description declared
required
sections non-empty list of object
no description declared
required
id non-empty string
no description declared
required
title non-empty string
no description declared
required
level exactly 2 OR exactly 3 OR exactly 4
no description declared
required
collapsed boolean
no description declared
blocks non-empty list of html OR table
no description declared
required
html object
no description declared
required
type exactly "html"
no description declared
required
html string
no description declared
required
table object
no description declared
required
type exactly "table"
no description declared
required
id non-empty string
no description declared
required
columns non-empty list of string
no description declared
required
rows list of list of string
no description declared
required

Checks

  • nonEmptyCandidateRequirements - candidate requirements cannot be empty
  • validLegacyPublishedUrl - legacy publication URL is valid
  • tableRowsMatchColumns - every table row matches its columns
  • uniqueModelIds - evaluated model IDs are unique
  • recommendedModelsWereEvaluated - recommendations reference evaluated models
  • testedReasoningEffortsAreComplete - reasoning evidence covers evaluated models
  • uniqueSectionAndTableIds - section and table IDs are unique
  • canonicalDuelTableAndLineageProof - duel leaderboards carry one canonical lineage proof

Defects

No defects in the 15 records checked.

Where it lives

Bound bybench-homegrown
Declared in~/mnt/mdr/skills/bench-homegrown/assets/schemas/benchmark-document.ts
BindingbenchmarkDocumentDataStore
Directory~/mnt/mdr/skills/bench-homegrown/assets/benchmarks
Files*.json
Referenced asbenchmark-document