research/Reproduction

6,673 records · yaml · accepts undeclared fields

Fields

FieldTypeRequiredMeaning
slug string matching /^[a-z0-9][a-z0-9-]*$/ required Unique record identity combining the paper handle and reproducer username; also the filename and page URL segment.
stub exactly true optional Marks a thin challenge-corpus record: hidden from default listings but still served at its own URL.
renderings list of object (additional keys allowed) optional Generated human-facing pages built from this record; regenerate them rather than editing them.
    ↳ path non-empty string optional On-disk location of the generated page, omitted when it is rendered on demand.
    ↳ published string required Public URL where the generated page is served.
    ↳ kind non-empty string required Which kind of generated page this is.
provenance object (additional keys allowed) optional How this record was captured, including caveats that must survive into its renderings.
edges list of object (additional keys allowed) optional Typed graph links from this record to other records.
    ↳ name non-empty string required Display name of the entity at the far end of this link.
    ↳ openalexId non-empty string optional OpenAlex identifier that disambiguates the linked entity.
    ↳ kind non-empty string required What kind of relationship this link represents.
    ↳ provenance any shape (not yet constrained by the schema) optional How this link was established.
name non-empty string optional Display label pairing the shortened paper title with the reproducer, required unless this is a stub.
claimSet reference to claim-set claim-set required The shared ClaimSet whose claims this reproduction judges.
    ↳ id string matching /^claim-set\/[a-z0-9][a-z0-9-]*$/ required
reproducer reference to person OR object (additional keys allowed) required Who carried out this reproduction, as an internal person record or one external profile URL.
    ↳ form 1 object person required Reference to one person record.
        ↳ id string matching /^person\/[a-z0-9][a-z0-9-]*$/ required
    ↳ form 2 object (additional keys allowed) required
        ↳ url string required Public profile URL that is the complete identity of an external reproducer.
verdicts non-empty list of object (additional keys allowed) required Attempt-quality and result facts keyed to stable ClaimSet claim ids.
    ↳ claim non-empty string required ClaimSet-local claim id judged by this row.
    ↳ evidence object (additional keys allowed) required Evidence supporting the attempt quality and result.
        ↳ summary string required What the cited evidence actually shows about this claim.
    ↳ boundary non-empty string optional Audit note preserving an important limitation or prior adjudication boundary.
    ↳ attempt one of: full | toy | invalid | not_attempted required Quality of the attempt: full, toy, invalid, or not attempted.
    ↳ result one of: verified | falsified optional Whether a full attempt decided, or a toy attempt leaned, verified or falsified.
verdictSummary non-empty string required Prose stating exactly what the evidence established and where it stopped.
sources non-empty list of object (additional keys allowed) required Public logbooks, raw judge datasets, and other record-level provenance surfaces.
    ↳ id non-empty string required Record-local source anchor cited by verdict evidence.
    ↳ url string required Public surface being cited, such as a reproduction logbook or raw judge dataset.
    ↳ checkedOn non-empty string required The date this source was last read, as an ISO calendar date.
    ↳ holds non-empty string required Plain-language description of what the cited surface contains.

Rules

Defects

Checked 200 of 6,673 records (the per-store cap is 200), so this is a sample, not a whole-store verdict.

RecordFieldProblem
abbas-2026-quantumboost-a-lazy-yet-fast-quantum-algorithm-for-learning-with-weak-hypotheses--the-kristina-dimitrova.yaml claimSet Required
abbas-2026-quantumboost-a-lazy-yet-fast-quantum-algorithm-for-learning-with-weak-hypotheses--the-kristina-dimitrova.yaml verdicts Required
abramovich-2026-speed-bench-a-unified-and-diverse-benchmark-for-speculative-decoding--abhishekkataria16.yaml claimSet Required
abramovich-2026-speed-bench-a-unified-and-diverse-benchmark-for-speculative-decoding--abhishekkataria16.yaml verdicts Required
abramovich-2026-speed-bench-a-unified-and-diverse-benchmark-for-speculative-decoding--gkalyanaraman3.yaml claimSet Required
abramovich-2026-speed-bench-a-unified-and-diverse-benchmark-for-speculative-decoding--gkalyanaraman3.yaml verdicts Required
abramovich-2026-speed-bench-a-unified-and-diverse-benchmark-for-speculative-decoding--marxistleninist.yaml claimSet Required
abramovich-2026-speed-bench-a-unified-and-diverse-benchmark-for-speculative-decoding--marxistleninist.yaml verdicts Required
abramovich-2026-speed-bench-a-unified-and-diverse-benchmark-for-speculative-decoding--wrice.yaml claimSet Required
abramovich-2026-speed-bench-a-unified-and-diverse-benchmark-for-speculative-decoding--wrice.yaml verdicts Required
acharya-2026-causcibench-evaluating-llm-causal-inference-for-scientific-research--bsenst.yaml claimSet Required
acharya-2026-causcibench-evaluating-llm-causal-inference-for-scientific-research--bsenst.yaml verdicts Required
acuaviva-2026-rethinking-visual-intelligence-insights-from-video-pretraining--aaditya025.yaml claimSet Required
acuaviva-2026-rethinking-visual-intelligence-insights-from-video-pretraining--aaditya025.yaml verdicts Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--michaldobiezynski.yaml claimSet Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--michaldobiezynski.yaml verdicts Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--neonforestmist.yaml claimSet Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--neonforestmist.yaml verdicts Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--procreations.yaml claimSet Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--procreations.yaml verdicts Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--sabapivot.yaml claimSet Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--sabapivot.yaml verdicts Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--srishti280992.yaml claimSet Required
aczel-2026-efficient-bayesian-inference-from-noisy-pairwise-comparisons--srishti280992.yaml verdicts Required
adepu-2026-fine-tuning-of-transformer-models-with-frames--scarwizz.yaml claimSet Required
adepu-2026-fine-tuning-of-transformer-models-with-frames--scarwizz.yaml verdicts Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--ai-sherpa.yaml claimSet Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--ai-sherpa.yaml verdicts Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--amkkk.yaml claimSet Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--amkkk.yaml verdicts Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--procreations.yaml claimSet Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--procreations.yaml verdicts Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--sabapivot.yaml claimSet Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--sabapivot.yaml verdicts Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--snaykey.yaml claimSet Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--snaykey.yaml verdicts Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--srishti280992.yaml claimSet Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--srishti280992.yaml verdicts Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--vimarsh.yaml claimSet Required
adler-2026-a-capacity-based-rationale-for-multi-head-attention--vimarsh.yaml verdicts Required
adriaens-2026-simple-algorithms-for-bad-triangle-transversals-with-applications-to-correlation-clustering--arvkevi.yaml claimSet Required
adriaens-2026-simple-algorithms-for-bad-triangle-transversals-with-applications-to-correlation-clustering--arvkevi.yaml verdicts Required
adriaens-2026-simple-algorithms-for-bad-triangle-transversals-with-applications-to-correlation-clustering--michaldobiezynski.yaml claimSet Required
adriaens-2026-simple-algorithms-for-bad-triangle-transversals-with-applications-to-correlation-clustering--michaldobiezynski.yaml verdicts Required
agarwal-2026-sinkhorn-treatment-effects--rahit.yaml claimSet Required
agarwal-2026-sinkhorn-treatment-effects--rahit.yaml verdicts Required
agarwal-2026-sinkhorn-treatment-effects--ryecatcher.yaml claimSet Required
agarwal-2026-sinkhorn-treatment-effects--ryecatcher.yaml verdicts Required
agarwal-2026-sinkhorn-treatment-effects--tomyimkc.yaml claimSet Required
agarwal-2026-sinkhorn-treatment-effects--tomyimkc.yaml verdicts Required
agrawal-2026-a-benchmark-and-framework-for-evaluating-next-action-predictions-in-spreadsheets--gogorun12.yaml claimSet Required
agrawal-2026-a-benchmark-and-framework-for-evaluating-next-action-predictions-in-spreadsheets--gogorun12.yaml verdicts Required
agrawal-2026-a-benchmark-and-framework-for-evaluating-next-action-predictions-in-spreadsheets--wrice.yaml claimSet Required
agrawal-2026-a-benchmark-and-framework-for-evaluating-next-action-predictions-in-spreadsheets--wrice.yaml verdicts Required
agrawal-2026-minibatch-selection-for-language-models-via-partition-matroid-constrained-gradient-matching--arvkevi.yaml claimSet Required
agrawal-2026-minibatch-selection-for-language-models-via-partition-matroid-constrained-gradient-matching--arvkevi.yaml verdicts Required
agrawal-2026-principled-zero-shot-ranking-agents-with-tournament-graphs--paretooptimal.yaml claimSet Required
agrawal-2026-principled-zero-shot-ranking-agents-with-tournament-graphs--paretooptimal.yaml verdicts Required
agrawal-2026-principled-zero-shot-ranking-agents-with-tournament-graphs--sabapivot.yaml claimSet Required
agrawal-2026-principled-zero-shot-ranking-agents-with-tournament-graphs--sabapivot.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--agharsallah.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--agharsallah.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--ai-sherpa.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--ai-sherpa.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--amkkk.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--amkkk.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--crusadersk.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--crusadersk.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--dineshai.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--dineshai.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--jbhati305.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--jbhati305.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--joshi2312.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--joshi2312.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--michaldobiezynski.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--michaldobiezynski.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--neonforestmist.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--neonforestmist.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--procreations.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--procreations.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--rdubwiley.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--rdubwiley.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--sabapivot.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--sabapivot.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--snaykey.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--snaykey.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--vissutagunawan.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--vissutagunawan.yaml verdicts Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--ymrohit.yaml claimSet Required
aguie-2026-improved-analysis-of-the-accelerated-noisy-power-method-with-applications-to-decentralized--ymrohit.yaml verdicts Required
ahamed-2026-tfrbench-a-reasoning-benchmark-for-evaluating-forecasting-systems--abhishekkataria16.yaml claimSet Required
ahamed-2026-tfrbench-a-reasoning-benchmark-for-evaluating-forecasting-systems--abhishekkataria16.yaml verdicts Required
ahamed-2026-tfrbench-a-reasoning-benchmark-for-evaluating-forecasting-systems--nkapila6.yaml claimSet Required
ahamed-2026-tfrbench-a-reasoning-benchmark-for-evaluating-forecasting-systems--nkapila6.yaml verdicts Required
ahamed-2026-tfrbench-a-reasoning-benchmark-for-evaluating-forecasting-systems--wrice.yaml claimSet Required
ahamed-2026-tfrbench-a-reasoning-benchmark-for-evaluating-forecasting-systems--wrice.yaml verdicts Required
ahmed-2026-med-seglens-latent-level-model-diffing-for-interpretable-medical-image-segmentation--snowfire.yaml claimSet Required
ahmed-2026-med-seglens-latent-level-model-diffing-for-interpretable-medical-image-segmentation--snowfire.yaml verdicts Required
ai-2026-an-interactive-paradigm-for-deep-research--bsenst.yaml claimSet Required
ai-2026-an-interactive-paradigm-for-deep-research--bsenst.yaml verdicts Required
ai-2026-an-interactive-paradigm-for-deep-research--jaycee766.yaml claimSet Required
ai-2026-an-interactive-paradigm-for-deep-research--jaycee766.yaml verdicts Required
ai-2026-beyond-majority-voting-llm-aggregation-by-leveraging-higher-order-information--dineshai.yaml claimSet Required
ai-2026-beyond-majority-voting-llm-aggregation-by-leveraging-higher-order-information--dineshai.yaml verdicts Required
ai-2026-beyond-majority-voting-llm-aggregation-by-leveraging-higher-order-information--nizda.yaml claimSet Required
ai-2026-beyond-majority-voting-llm-aggregation-by-leveraging-higher-order-information--nizda.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--abhishekkataria16.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--abhishekkataria16.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--edd16.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--edd16.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--paretooptimal.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--paretooptimal.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--sabapivot.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--sabapivot.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--snaykey.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--snaykey.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--sotayamashita.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--sotayamashita.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--srishti280992.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--srishti280992.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--wrice.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--wrice.yaml verdicts Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--ymrohit.yaml claimSet Required
ai-2026-memorybench-a-benchmark-for-memory-and-continual-learning-in-llm-systems--ymrohit.yaml verdicts Required
ai-2026-nested-spatio-temporal-time-series-forecasting--edd16.yaml claimSet Required
ai-2026-nested-spatio-temporal-time-series-forecasting--edd16.yaml verdicts Required
aich-2026-wind-weather-inverse-diffusion-for-zero-shot-atmospheric-modeling--jkeisler75.yaml claimSet Required
aich-2026-wind-weather-inverse-diffusion-for-zero-shot-atmospheric-modeling--jkeisler75.yaml verdicts Required
aissi-2026-prism-perception-reasoning-interleaved-for-sequential-decision-making--radhakrishnadeshpande.yaml claimSet Required
aissi-2026-prism-perception-reasoning-interleaved-for-sequential-decision-making--radhakrishnadeshpande.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--abhishekkataria16.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--abhishekkataria16.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--agharsallah.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--agharsallah.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--ai-sherpa.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--ai-sherpa.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--dineshai.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--dineshai.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--paretooptimal.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--paretooptimal.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--procreations.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--procreations.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--rdubwiley.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--rdubwiley.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--sabapivot.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--sabapivot.yaml verdicts Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--snaykey.yaml claimSet Required
aiyer-2026-a-theoretical-framework-for-statistical-evaluability-of-generative-models--snaykey.yaml verdicts Required
aka-2026-evaluating-contextual-illegality-ai-compliance-in-corporate-law-scenarios--firemedic15.yaml claimSet Required
aka-2026-evaluating-contextual-illegality-ai-compliance-in-corporate-law-scenarios--firemedic15.yaml verdicts Required
akhauri-2026-regression-language-models-for-code--dineshai.yaml claimSet Required
akhauri-2026-regression-language-models-for-code--dineshai.yaml verdicts Required
alacaoglu-2026-solving-stochastic-variational-inequalities-without-the-bounded-variance-assumption--ai-sherpa.yaml claimSet Required
alacaoglu-2026-solving-stochastic-variational-inequalities-without-the-bounded-variance-assumption--ai-sherpa.yaml verdicts Required
alacaoglu-2026-solving-stochastic-variational-inequalities-without-the-bounded-variance-assumption--algorise.yaml claimSet Required
alacaoglu-2026-solving-stochastic-variational-inequalities-without-the-bounded-variance-assumption--algorise.yaml verdicts Required
alacaoglu-2026-solving-stochastic-variational-inequalities-without-the-bounded-variance-assumption--michaldobiezynski.yaml claimSet Required
alacaoglu-2026-solving-stochastic-variational-inequalities-without-the-bounded-variance-assumption--michaldobiezynski.yaml verdicts Required
alacaoglu-2026-solving-stochastic-variational-inequalities-without-the-bounded-variance-assumption--ryecatcher.yaml claimSet Required
alacaoglu-2026-solving-stochastic-variational-inequalities-without-the-bounded-variance-assumption--ryecatcher.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--ai-sherpa.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--ai-sherpa.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--alcray.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--alcray.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--amkkk.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--amkkk.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--deepakkambala.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--deepakkambala.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--dineshai.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--dineshai.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--jighomena.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--jighomena.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--neonforestmist.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--neonforestmist.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--paretooptimal.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--paretooptimal.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--procreations.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--procreations.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--rdubwiley.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--rdubwiley.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--sabapivot.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--sabapivot.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--sabaridsnfuji.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--sabaridsnfuji.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--snaykey.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--snaykey.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--sotayamashita.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--sotayamashita.yaml verdicts Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--srishti280992.yaml claimSet Required
alami-2026-set-preserving-calibration-from-conformal-p-values-to-e-values--srishti280992.yaml verdicts Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--acevikings.yaml claimSet Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--acevikings.yaml verdicts Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--agharsallah.yaml claimSet Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--agharsallah.yaml verdicts Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--ai-sherpa.yaml claimSet Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--ai-sherpa.yaml verdicts Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--amkkk.yaml claimSet Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--amkkk.yaml verdicts Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--crusadersk.yaml claimSet Required
alcalde-2026-attention-s-forward-pass-and-frank-wolfe--crusadersk.yaml verdicts Required

Showing the first 200 of 400 defects.

Example record

/Users/eshao/.config/mnt/data/autoresearch-reproduction/repros/abbas-2026-quantumboost-a-lazy-yet-fast-quantum-algorithm-for-learning-with-weak-hypotheses--the-kristina-dimitrova.yaml

slug: abbas-2026-quantumboost-a-lazy-yet-fast-quantum-algorithm-for-learning-with-weak-hypotheses--the-kristina-dimitrova
paper:
  id: paper/abbas-2026-quantumboost-lazy-yet-fast
reproducer:
  url: https://huggingface.co/the-kristina-dimitrova
stub: true
attempts: []
claims:
- id: claim-1
  statement: QuantumBoost achieves overall runtime Õ(W/(√ϵ·γ⁴)) to reach empirical error at most ϵ, where W is the weak-learner
    runtime and γ is the edge of the weak hypotheses (Theorem 1, Section 4).
  verdict: partial
  evidence:
    sources:
    - judge-verdict
    judgeVerdict: toy
    summary: The logbook tests only the quantum amplitude estimation subroutine in isolation on a Bernoulli(p) mean-estimation
      task (slope -0.981 vs theory -1.0), not the full QuantumBoost algorithm's runtime. This verifies one ingredient of the
      speedup mechanism on a proxy task, not the overall runtime Õ(W/(√ϵ·γ⁴)).
- id: claim-2
  statement: With training set size m = Θ((d·log(d/(δϵ)) + log(1/δ))/ϵ²), QuantumBoost outputs a hypothesis with generalization
    error ≤ ϵ and success probability 1−δ (Theorem 2, Section 4).
  verdict: partial
  evidence:
    sources:
    - judge-verdict
    judgeVerdict: toy
    summary: The generalization bound is tested using classical AdaBoost (not QuantumBoost) on synthetic realizable Gaussian
      data with small dimensions (d∈{2,5,10}) and only two ε values. This verifies a standard PAC/VC-dimension sample complexity
      form on a simplified proxy, not QuantumBoost's actual generalization guarantee.
- id: claim-3
  statement: QuantumBoost uses T = O(log(1/ϵ)/γ²) boosting iterations, matching the iteration count of classical AdaBoost
    and Kale's SmoothBoost while achieving strictly better total runtime (Theorem 20, Theorem 23, Section 4).
  verdict: partial
  evidence:
    sources:
    - judge-verdict
    judgeVerdict: toy
    summary: The iteration count is tested with an idealized edge-gamma weak-learner oracle (exact 2γ edge by construction)
      on a 5×5 grid. While the γ-exponent matches well (~2.05), the log(1/ε) exponent is substantially off (1.82 vs 1.0),
      and the setup uses a synthetic oracle rather than a real weak learner.
- id: claim-4
  statement: QuantumBoost's total runtime of W/(√ϵ·γ⁴) improves on Quantum SmoothBoost's runtime of W/(ϵ^2.5γ⁴) + √d/(ϵ^3.5γ⁵)
    and on Quantum AdaBoost's runtime of W^1.5√d/(ϵγ¹¹) (Table 1).
  verdict: partial
  evidence:
    sources:
    - judge-verdict
    judgeVerdict: inconclusive
    summary: 'The check is purely algebraic: evaluating closed-form Big-O formulas across a parameter grid and confirming
      one expression is numerically smaller than another. This is trivially true by inspection of the exponents (e.g., √ϵ
      < ϵ^2.5 for small ϵ) and does not constitute experimental evidence or verify the underlying runtime analyses.'
- id: claim-5
  statement: QuantumBoost is presented as the first algorithm, classical or quantum, to combine a lazy Bregman-projection
    strategy—projecting only every K = 1/γ iterations rather than every iteration—with quantum mean estimation for boosting
    (Section 4).
  verdict: partial
  evidence:
    sources:
    - judge-verdict
    judgeVerdict: inconclusive
    summary: The core novelty claim ('first to combine lazy Bregman projection with quantum mean estimation for boosting')
      is a literature claim the logbook explicitly acknowledges it cannot test. The proxy test (K=1/γ is load-bearing) uses
      a toy setup with a modeled edge-degradation weak learner and does not address the novelty assertion.
verdict: partial
verdictSummary: The logbook provides toy-level numerical evidence for Claims 1–3 by testing simplified components (amplitude
  estimation microbenchmark, classical AdaBoost on synthetic data, simulated boosting with idealized oracle) and no meaningful
  evidence for Claims 4–5 (algebraic formula checks and an untestable novelty claim). No claim is verified at the full algorithm
  or non-trivial scale.
sources:
- id: logbook
  url: https://huggingface.co/spaces/the-kristina-dimitrova/repro-quantumboost-a-lazy-yet-fast-quantum-algorithm-for-learning-with-weak-hypotheses
  checkedOn: '2026-08-11'
  holds: Public Trackio reproduction logbook
- id: judge-verdict
  url: https://huggingface.co/datasets/ICML-2026-agent-repro/verdicts
  checkedOn: '2026-08-11'
  holds: Independent Logbook Judge verdict and per-claim evidence

Where it lives

Declared in/Users/eshao/.config/mnt/mdr/skills/research-records/assets/schemas/reproduction.ts
BindingreproductionDataStore
Directory/Users/eshao/.config/mnt/data/autoresearch-reproduction/repros
Files*.yaml