Ground Truth · reproduction package

NOHARM recomputation

Everything the article’s numbers were computed from, plus the code that computes them. The reproduction script verifies the five input files against published SHA-256 hashes before it computes anything, and stops if they differ.

Run it with python3 reproduce_all.py against the authors’ released data at commit 7b089bd. Start with provenance.md.

FileWhat it is
provenance.mdProvenance and reproduction notes — sources, hashes, results as captured, scope and limits
reproduce_all.pyRegenerates every deterministic figure in the article; verifies inputs by hash first
verify_claims.pyIndependent implementation, written without reference to the authors' code
repro_stats_authors_MIT.pyThe authors' own statistics module (MIT), for reproducing their procedure with their code
reproduce_all.outCaptured output — ALL CHECKS PASS
top_tier.outCaptured output — authors' multiple-comparisons procedure, B=10,000, seed 0
independent.outCaptured output — independent implementation
hashes.txtSHA-256 of the three captured outputs

← Back to the article