Orchestrata Ultimate › Tests › Reference › scripts › test_generate_rtm_evidence

Tests reference — tests/scripts/test_generate_rtm_evidence.py

Module of tests/scripts, split out because the directory page would be too large.

Prose pending.

tests/scripts/test_generate_rtm_evidence.py

source · 43 tests · 593 lines

Tests for scripts/generate_rtm_evidence.py — the evidence-graded RTM.

Kind Name Line Description
function test_render_markdown_reports_totals_and_ghosts 263
function test_render_markdown_lists_evidence_rows_with_tests 281
class TestLoadRequirements 54
method TestLoadRequirements.test_both_definition_shapes_parsed 55
method TestLoadRequirements.test_dual_defined_records_every_spec 61
class TestHarvestTestCitations 66
method TestHarvestTestCitations.test_docstring_citation_counts 73
method TestHarvestTestCitations.test_comment_citation_counts 80
method TestHarvestTestCitations.test_string_literal_is_data_not_claim 87
method TestHarvestTestCitations.test_placeholder_excluded 96
method TestHarvestTestCitations.test_decorator_citation_counts_with_provenance 103
method TestHarvestTestCitations.test_decorator_and_docstring_citations_coexist_with_provenance 115
method TestHarvestTestCitations.test_decorator_placeholder_id_excluded 130
method TestHarvestTestCitations.test_fixture_ids_pragma_skips_whole_file 139
class TestBuildMatrix 154
method TestBuildMatrix.test_unlinked_when_no_evidence 164
method TestBuildMatrix.test_declared_when_only_traces 167
method TestBuildMatrix.test_cited_beats_declared 173
method TestBuildMatrix.test_tested_and_failing_from_verify_results 181
method TestBuildMatrix.test_ghost_for_undefined_plausible_ids 196
method TestBuildMatrix.test_fixture_space_ids_never_ghost 200
method TestBuildMatrix.test_malformed_tokens_never_ghost 206
class TestBuildRtmFacts 220
method TestBuildRtmFacts.test_declared_only_requirement_gets_no_trace 221
method TestBuildRtmFacts.test_cited_requirement_defaults_to_cited_class_without_verify 229
method TestBuildRtmFacts.test_verify_results_grade_tested_and_failing 236
class TestFormatViolation 249
method TestFormatViolation.test_untraced_is_kind_and_req_only 250
method TestFormatViolation.test_dangling_includes_unit 254
method TestFormatViolation.test_unproven_includes_needed_class 258
class TestLoadRequirementsUnreadable 297
method TestLoadRequirementsUnreadable.test_undecodable_file_is_skipped 298
class TestClaimPositions 305
method TestClaimPositions.test_syntax_error_returns_empty 306
method TestClaimPositions.test_docstring_span_and_comment_column_found 311
class TestHarvestTestCitationsUnreadable 318
method TestHarvestTestCitationsUnreadable.test_undecodable_file_is_skipped 319
class TestHarvestSrcDeclarations 326
method TestHarvestSrcDeclarations.test_syntax_error_file_is_skipped 332
method TestHarvestSrcDeclarations.test_undecodable_file_is_skipped 337
method TestHarvestSrcDeclarations.test_node_without_traces_decorator_is_ignored 342
method TestHarvestSrcDeclarations.test_decorator_via_module_attribute_form 347
method TestHarvestSrcDeclarations.test_non_reqs_keyword_is_ignored 359
method TestHarvestSrcDeclarations.test_reqs_kwarg_not_a_list_is_ignored 364
method TestHarvestSrcDeclarations.test_placeholder_id_excluded 371
method TestHarvestSrcDeclarations.test_valid_declaration_recorded 378
class TestRunCitingTests 389
method TestRunCitingTests.test_passing_and_failing_modules_graded 390
class TestMain 399
method TestMain.test_main_static_writes_json_and_md 438
method TestMain.test_main_verify_runs_citing_tests_and_grades_tested 471
method TestMain.test_main_check_constraints_reports_untraced_and_exits_1 505
method TestMain.test_main_check_constraints_clean_exits_0 539
method TestMain.test_main_without_flag_does_not_run_constraints_check 568