orchestrata_ultimate.factory.evidence

Reference › orchestrata_ultimate › factory › evidence

Evidence-against-false-confidence tooling (SPEC-033 §9, B6).

The evidence package provides tooling against false confidence in tests (SPEC-033 section 9, row B6). red_first keeps a ledger of test outcomes on top of the enforcement ledger, so a test counts as evidence only if it was seen failing at an ancestor of the commit where it was seen passing. mutation runs mutation testing over only the functions a change touched, using three operators, and reports which mutants the tests failed to kill. The two modules are independent of each other. The CLI entry point is scripts.factory_evidence. Start with red_first.

3 modules, 758 lines of code.

Modules

Module Summary LOC
__init__ Evidence-against-false-confidence tooling (SPEC-033 §9, B6). 19
mutation Affected-set mutation testing (SPEC-033 §9, B6). 382
red_first Red-first evidence ledger (SPEC-033 §9, B6). 357

Dependency diagram

Package dependency diagram orchestrata_ultimate.factory.evidence