orchestrata_ultimate.factory.evidence
Reference › orchestrata_ultimate › factory › evidence
Evidence-against-false-confidence tooling (SPEC-033 §9, B6).
The evidence package provides tooling against false confidence in tests (SPEC-033 section 9, row B6). red_first keeps a ledger of test outcomes on top of the enforcement ledger, so a test counts as evidence only if it was seen failing at an ancestor of the commit where it was seen passing. mutation runs mutation testing over only the functions a change touched, using three operators, and reports which mutants the tests failed to kill. The two modules are independent of each other. The CLI entry point is scripts.factory_evidence. Start with red_first.
3 modules, 758 lines of code.
Modules
| Module | Summary | LOC |
|---|---|---|
__init__ |
Evidence-against-false-confidence tooling (SPEC-033 §9, B6). | 19 |
mutation |
Affected-set mutation testing (SPEC-033 §9, B6). | 382 |
red_first |
Red-first evidence ledger (SPEC-033 §9, B6). | 357 |