Knowledge Wiki Orchestrata Ultimate

Orchestrata Ultimate › Tests › Reference › verification

Tests reference — tests/verification

tests/verification — 117 test modules, 1662 test functions (cumulative over subdirectories). Source tree: tests/verification at commit 8a2cb42ad. Generated from the tests AST snapshot by scripts/gen-data-pages.py.

Prose pending.

Subdirectories

Directory Modules Tests
agents/ 4 33
autofix/ 7 95
checkpoints/ 4 25
config/ 2 5
constraints/ 3 38
edge_cases/ 3 37
impossibility/ 2 9
integrations/ 3 22
models/ 1 17
orchestration/ 2 25
proofs/ 1 9
protocols/ 1 11
requirements/ 3 17
review/ 9 161
session/ 2 14
traceability/ 1 20
verification/ 3 20

Modules

Module Tests Covers
test_agents_proofs.py 22 5
test_autofix.py 28 6
test_autofix_engine.py 1 2
test_autofix_format_fixes.py 8 1
test_autofix_helpers.py 5 1
test_autofix_imports.py 17 1
test_autofix_redis.py 17 1
test_autofix_types.py 2 1
test_checkpoint_concurrent.py 5 2
test_checkpoint_definitions.py 10 2
test_checkpoint_verifier.py 9 3
test_checkpoints.py 15 4
test_checkpoints_definitions.py 12 2
test_checks_correctness.py 14 1
test_checks_quality.py 22 1
test_checks_safety.py 22 1
test_concurrent_checkpoint.py 7 2
test_config.py 4 1
test_constraint_definitions.py 8 2
test_constraints.py 9 2
test_constraints_definitions.py 6 2
test_constraints_evaluator.py 21 2
test_coordinator.py 9 2
test_edge_case_database.py 7 2
test_edge_cases.py 26 3
test_edge_cases_database.py 7 2
test_engine.py 5 2
test_engine_pure.py 27 1
test_escalation_handler.py 11 2
test_execution_agent.py 10 2
test_feedback.py 7 2
test_feedback_generator.py 9 2
test_implementation_scanner.py 53 2
test_impossibility_handler.py 15 2
test_integrations_session_config.py 48 11
test_intent_broker.py 8 2
test_issue_triage.py 9 1
test_model_registry.py 5 1
test_models.py 27 4
test_models_base_model.py 11 1
test_non_python_scan_coverage.py 17 1
test_prolog_generator.py 12 2
test_proofs_verifier.py 9 2
test_protocols_cxp.py 9 2
test_redis_manager.py 5 1
test_requirements.py 29 4
test_review.py 21 2
test_review_checks.py 51 4
test_review_checks_expanded.py 73 4
test_review_helpers.py 21 1
test_rtm_constraints.py 10 1
test_session_manager.py 11 2
test_small_modules.py 80 24
test_spec_completeness.py 10 1
test_spec_completeness_extended.py 22 1
test_spec_completeness_js_evidence.py 3 1
test_supervisor_agent.py 8 2
test_traceability.py 46 1
test_types.py 30 1
test_verification_agents.py 26 6
test_verification_config.py 3 1
test_verification_coordinator.py 11 2
test_verification_cxp_adapter.py 11 2
test_verification_engine.py 9 3
test_verification_models.py 19 4

Module details

tests/verification/test_agents_proofs.py

source · 22 tests · 264 lines

Tests for verification.agents.* and verification.proofs.*.

Covers: verification.agents.execution_agent, verification.agents.supervisor_agent, verification.agents.verification_agent, verification.proofs.verifier, verification.types

Kind Name Line Description
function test_execution_agent_receive_and_execute 28
function test_execution_agent_submit_for_verification 38
function test_execution_agent_receive_feedback 46
function test_supervisor_review_work 57
function test_supervisor_generate_proof 65
function test_supervisor_submit_proof 75
function test_verification_agent_check_via_prolog 87
function test_verification_agent_decide_pass 98
function test_verification_agent_decide_fail 108
function test_verification_agent_validate_proof 118
function test_verification_agent_analyze_no_llm 131
function test_verification_agent_analyze_with_llm 139
function test_verification_agent_analyze_llm_raises 151
function test_verifier_exhaustive_valid 166
function test_verifier_exhaustive_missing_space 177
function test_verifier_logical_valid 189
function test_verifier_logical_missing_reasoning 201
function test_verifier_mathematical_valid 211
function test_verifier_mathematical_missing_basis 223
function test_verifier_practical_valid 234
function test_verifier_practical_missing 246
function test_verifier_unknown_proof_type_is_safe 253

tests/verification/test_autofix.py

source · 28 tests · 305 lines

Covers: verification.autofix.engine, verification.autofix.format_fixes, verification.autofix.helpers, verification.autofix.import_fixes, verification.autofix.redis_fixes, verification.autofix.types

Kind Name Line Description
function test_autofix_result_defaults 56
function test_walk_python_files_skips_venv 67
function test_autofix_aioredis_rewrites_import 84
function test_autofix_aioredis_rewrites_aioredis_name 92
function test_autofix_aioredis_no_redis_usage 100
function test_autofix_sync_redis 105
function test_autofix_sync_redis_skips_if_async_already 114
function test_autofix_redis_decode 122
function test_autofix_redis_decode_skips_if_present 130
function test_autofix_redis_host_rewrites_tests 137
function test_autofix_redis_host_ignores_non_tests 147
function test_autofix_xadd_dict 152
function test_autofix_hset_dict 159
function test_autofix_relative_imports 171
function test_autofix_relative_imports_no_package 185
function test_autofix_relative_imports_flat_layout 190
function test_autofix_missing_stdlib_imports_json 201
function test_autofix_missing_stdlib_imports_dataclasses 209
function test_autofix_missing_barename_imports_timedelta 217
function test_autofix_missing_barename_imports_extends_existing 226
function test_autofix_missing_barename_imports_skips_if_present 234
function test_autofix_line_length_runs_without_error 246
function test_autofix_parse_args_adds_param 252
function test_autofix_f821_datetime_adds_from_import 266
function test_autofix_f821_datetime_skips_when_imported 275
function test_autofix_f821_datetime_no_usage 282
function test_run_all_autofixes_on_empty_workspace 292
function test_run_all_autofixes_applies_redis_fix 301

tests/verification/test_autofix_engine.py

source · 1 tests · 32 lines

Tests for verification.autofix.engine.

Covers: verification.autofix.engine, verification.autofix.types

Kind Name Line Description
class TestRunAllAutofixes 27
method TestRunAllAutofixes.test_returns_autofix_result 28

tests/verification/test_autofix_format_fixes.py

source · 8 tests · 50 lines

Tests for verification.autofix.format_fixes — real implementations.

Covers: verification.autofix.format_fixes

Kind Name Line Description
class TestHasDatetimeImport 10
method TestHasDatetimeImport.test_from_import 11
method TestHasDatetimeImport.test_import_module 14
method TestHasDatetimeImport.test_no_import 17
class TestAddDatetimeImport 21
method TestAddDatetimeImport.test_extend_existing 22
method TestAddDatetimeImport.test_add_after_import_os 27
method TestAddDatetimeImport.test_prepend 32
class TestAutofixParseArgs 38
method TestAutofixParseArgs.test_fixes_parse_args 39
method TestAutofixParseArgs.test_no_change 46

tests/verification/test_autofix_helpers.py

source · 5 tests · 59 lines

Tests for verification.autofix.helpers.

Covers: verification.autofix.helpers

Kind Name Line Description
class TestWalkPythonFiles 9
method TestWalkPythonFiles.test_finds_py_files 10
method TestWalkPythonFiles.test_skips_non_py 19
method TestWalkPythonFiles.test_skips_venv 28
method TestWalkPythonFiles.test_skips_pycache 39
method TestWalkPythonFiles.test_skips_dot_dirs 50

tests/verification/test_autofix_imports.py

source · 17 tests · 147 lines

Tests for autofix/import_fixes.py — real implementation.

Covers: verification.autofix.import_fixes

Kind Name Line Description
class TestDetectPackageName 34
method TestDetectPackageName.test_src_layout 35
method TestDetectPackageName.test_flat_layout 41
method TestDetectPackageName.test_no_package 47
class TestAutofixRelativeImports 51
method TestAutofixRelativeImports.test_fixes_relative 52
method TestAutofixRelativeImports.test_skips_venv 66
class TestAddStdlibImports 75
method TestAddStdlibImports.test_adds_json 76
method TestAddStdlibImports.test_skips_if_already_imported 81
method TestAddStdlibImports.test_no_usage_no_add 86
class TestAddBarenameImports 92
method TestAddBarenameImports.test_adds_timedelta 93
method TestAddBarenameImports.test_adds_optional 98
method TestAddBarenameImports.test_skips_if_already_imported 103
method TestAddBarenameImports.test_skips_if_module_imported 108
class TestExtendOrAddImport 114
method TestExtendOrAddImport.test_extends_existing 115
method TestExtendOrAddImport.test_adds_new 120
method TestExtendOrAddImport.test_adds_after_import 125
class TestAutofixMissingStdlibImports 132
method TestAutofixMissingStdlibImports.test_fixes_file 133
class TestAutofixMissingBarenameImports 141
method TestAutofixMissingBarenameImports.test_fixes_file 142

tests/verification/test_autofix_redis.py

source · 17 tests · 152 lines

Tests for autofix/redis_fixes.py — real implementation.

Covers: verification.autofix.redis_fixes

Kind Name Line Description
class TestReplaceAioredisImports 35
method TestReplaceAioredisImports.test_import_redis 36
method TestReplaceAioredisImports.test_from_redis 41
class TestReplaceAioredisUsage 47
method TestReplaceAioredisUsage.test_replaces_aioredis 48
class TestApplySyncRedisFix 55
method TestApplySyncRedisFix.test_converts_import 56
method TestApplySyncRedisFix.test_adds_exception_import 63
class TestReplaceHardcodedHost 69
method TestReplaceHardcodedHost.test_host_localhost 70
method TestReplaceHardcodedHost.test_redis_localhost 75
method TestReplaceHardcodedHost.test_port_6379 80
class TestAutofixAioredis 86
method TestAutofixAioredis.test_fixes_file 87
class TestAutofixSyncRedis 95
method TestAutofixSyncRedis.test_fixes_file 96
method TestAutofixSyncRedis.test_skips_already_async 103
class TestAutofixRedisDecode 110
method TestAutofixRedisDecode.test_adds_decode_responses 111
method TestAutofixRedisDecode.test_skips_if_already_present 118
class TestAutofixRedisHost 125
method TestAutofixRedisHost.test_fixes_test_file 126
method TestAutofixRedisHost.test_skips_non_test 133
class TestAutofixXaddDict 140
method TestAutofixXaddDict.test_fixes_to_dict 141
method TestAutofixXaddDict.test_fixes_kwargs 148

tests/verification/test_autofix_types.py

source · 2 tests · 15 lines

Tests for verification.autofix.types.

Covers: verification.autofix.types

Kind Name Line Description
function test_autofix_result_defaults 6
function test_autofix_result_custom_values 12

tests/verification/test_checkpoint_concurrent.py

source · 5 tests · 61 lines

Tests for verification/checkpoints/concurrent.py — ConcurrentCheckpointEvaluator.

Covers: verification.checkpoints.concurrent, verification.types

Kind Name Line Description
class TestConcurrentCheckpointEvaluator 20
method TestConcurrentCheckpointEvaluator.test_init_defaults 21
method TestConcurrentCheckpointEvaluator.test_init_custom 25
method TestConcurrentCheckpointEvaluator.test_evaluate_all 30
method TestConcurrentCheckpointEvaluator.test_evaluate_sequential_all_pass 43
method TestConcurrentCheckpointEvaluator.test_evaluate_sequential_stops_on_failure 51

tests/verification/test_checkpoint_definitions.py

source · 10 tests · 54 lines

Tests for verification/checkpoints/definitions.py.

Covers: verification.checkpoints.definitions, verification.types

Kind Name Line Description
class TestGetNextCheckpoint 12
method TestGetNextCheckpoint.test_core_to_unit_tests 13
method TestGetNextCheckpoint.test_unit_tests_to_integration 17
method TestGetNextCheckpoint.test_integration_to_documentation 21
method TestGetNextCheckpoint.test_documentation_to_final 25
method TestGetNextCheckpoint.test_final_returns_none 29
method TestGetNextCheckpoint.test_invalid_checkpoint_returns_none 33
class TestGetCheckpointPredicates 38
method TestGetCheckpointPredicates.test_core_implementation 39
method TestGetCheckpointPredicates.test_unit_tests 44
method TestGetCheckpointPredicates.test_final_verification 48
method TestGetCheckpointPredicates.test_unknown_checkpoint 52

tests/verification/test_checkpoint_verifier.py

source · 9 tests · 102 lines

Tests for verification/checkpoints/verifier.py — CheckpointVerifier.

Covers: verification.checkpoints.verifier, verification.constraints.evaluator, verification.types

Kind Name Line Description
class TestCheckpointVerifier 19
method TestCheckpointVerifier.test_init_defaults 20
method TestCheckpointVerifier.test_init_with_evaluator 24
method TestCheckpointVerifier.test_verify_checkpoint_no_constraints 29
method TestCheckpointVerifier.test_verify_checkpoint_all_satisfied 37
method TestCheckpointVerifier.test_verify_checkpoint_not_satisfied 50
method TestCheckpointVerifier.test_get_checkpoint_criteria 62
method TestCheckpointVerifier.test_transition_state_passed 67
method TestCheckpointVerifier.test_transition_state_failed 79
method TestCheckpointVerifier.test_transition_state_final_checkpoint 92

tests/verification/test_checkpoints.py

source · 15 tests · 205 lines

Tests for verification.checkpoints.* .

Covers: verification.checkpoints.concurrent, verification.checkpoints.definitions, verification.checkpoints.verifier, verification.types

Kind Name Line Description
function test_get_next_checkpoint_moves_forward 39
function test_get_next_checkpoint_at_end 46
function test_get_checkpoint_predicates_known 50
function test_get_checkpoint_predicates_unknown 55
function test_checkpoint_order_contains_all 61
function test_verify_checkpoint_no_constraints 71
function test_verify_checkpoint_all_satisfied 78
function test_verify_checkpoint_some_failed 94
function test_get_checkpoint_criteria 106
function test_transition_state_advances_on_pass 113
function test_transition_state_completes_on_final 123
function test_transition_state_increments_on_fail 133
function test_evaluate_all_concurrent 150
function test_evaluate_sequential_stops_on_fail 162
function test_evaluate_sequential_all_pass 172

tests/verification/test_checkpoints_definitions.py

source · 12 tests · 86 lines

Tests for verification.checkpoints.definitions — real implementations.

Covers: verification.checkpoints.definitions, verification.types

Kind Name Line Description
class TestGetNextCheckpoint 31
method TestGetNextCheckpoint.test_core_to_unit_tests 32
method TestGetNextCheckpoint.test_unit_tests_to_integration 36
method TestGetNextCheckpoint.test_integration_to_docs 40
method TestGetNextCheckpoint.test_docs_to_final 44
method TestGetNextCheckpoint.test_final_returns_none 48
method TestGetNextCheckpoint.test_unknown_returns_none 52
class TestGetCheckpointPredicates 60
method TestGetCheckpointPredicates.test_core_implementation 61
method TestGetCheckpointPredicates.test_unit_tests 66
method TestGetCheckpointPredicates.test_integration_tests 70
method TestGetCheckpointPredicates.test_documentation 74
method TestGetCheckpointPredicates.test_final_verification 78
method TestGetCheckpointPredicates.test_unknown_checkpoint 83

tests/verification/test_checks_correctness.py

source · 14 tests · 124 lines

Tests for verification.review.checks_correctness — real implementations.

Covers: verification.review.checks_correctness

Kind Name Line Description
class TestCheckImports 34
method TestCheckImports.test_relative_import 35
method TestCheckImports.test_out_of_order 42
method TestCheckImports.test_valid_order 49
class TestCheckFileCompleteness 56
method TestCheckFileCompleteness.test_missing_module 57
method TestCheckFileCompleteness.test_module_exists 64
class TestBuildModuleCandidates 71
method TestBuildModuleCandidates.test_simple 72
method TestBuildModuleCandidates.test_nested 77
class TestCheckEntryPoint 82
method TestCheckEntryPoint.test_main_file_with_guard 83
method TestCheckEntryPoint.test_main_file_missing_guard 88
method TestCheckEntryPoint.test_not_main_file 94
class TestCheckDependencyDeclaration 100
method TestCheckDependencyDeclaration.test_undeclared_dep 101
method TestCheckDependencyDeclaration.test_declared_dep 108
method TestCheckDependencyDeclaration.test_stdlib_skipped 114
method TestCheckDependencyDeclaration.test_alias 120

tests/verification/test_checks_quality.py

source · 22 tests · 174 lines

Tests for checks_quality.py — real AST-based quality checks.

Covers: verification.review.checks_quality

Kind Name Line Description
class TestCheckTypeHints 32
method TestCheckTypeHints.test_no_issues_for_private 33
method TestCheckTypeHints.test_missing_return_annotation 39
method TestCheckTypeHints.test_missing_param_annotation 46
method TestCheckTypeHints.test_fully_annotated 53
method TestCheckTypeHints.test_init_params 59
method TestCheckTypeHints.test_init_self_skipped 68
class TestCheckMutableDefaults 75
method TestCheckMutableDefaults.test_no_mutable_defaults 76
method TestCheckMutableDefaults.test_list_default 82
method TestCheckMutableDefaults.test_dict_default 89
method TestCheckMutableDefaults.test_set_literal_default 95
method TestCheckMutableDefaults.test_kw_default 101
method TestCheckMutableDefaults.test_multiple_mutable 107
class TestCheckDocstrings 114
method TestCheckDocstrings.test_missing_function_docstring 115
method TestCheckDocstrings.test_has_function_docstring 122
method TestCheckDocstrings.test_missing_class_docstring 128
method TestCheckDocstrings.test_has_class_docstring 135
method TestCheckDocstrings.test_private_skipped 141
class TestCheckLineLength 148
method TestCheckLineLength.test_within_limit 149
method TestCheckLineLength.test_over_limit 154
method TestCheckLineLength.test_url_exempt 160
method TestCheckLineLength.test_multiple_violations_capped 165
method TestCheckLineLength.test_custom_max_len 171

tests/verification/test_checks_safety.py

source · 22 tests · 171 lines

Tests for checks_safety.py — real implementation.

Covers: verification.review.checks_safety

Kind Name Line Description
class TestCheckSecurity 33
method TestCheckSecurity.test_eval_call 34
method TestCheckSecurity.test_exec_call 41
method TestCheckSecurity.test_no_eval 48
method TestCheckSecurity.test_hardcoded_secret 54
method TestCheckSecurity.test_secret_in_comment_ignored 61
method TestCheckSecurity.test_secret_with_os_environ_ignored 67
method TestCheckSecurity.test_api_key_pattern 73
class TestCheckTodoComments 81
method TestCheckTodoComments.test_todo_found 82
method TestCheckTodoComments.test_fixme_found 88
method TestCheckTodoComments.test_hack_found 93
method TestCheckTodoComments.test_xxx_found 98
method TestCheckTodoComments.test_no_todo 103
method TestCheckTodoComments.test_todo_in_code_ignored 108
class TestCheckNoMocks 114
method TestCheckNoMocks.test_mock_import 115
method TestCheckNoMocks.test_magic_mock 121
method TestCheckNoMocks.test_patch_decorator 127
method TestCheckNoMocks.test_comment_ignored 133
method TestCheckNoMocks.test_monkeypatch_setenv_delenv_forbidden 138
method TestCheckNoMocks.test_monkeypatch_other_methods_forbidden 146
method TestCheckNoMocks.test_validate_code_no_mocks 152
class TestCheckLint 159
method TestCheckLint.test_valid_file 160
method TestCheckLint.test_undefined_name 167

tests/verification/test_concurrent_checkpoint.py

source · 7 tests · 95 lines

Tests for ConcurrentCheckpointEvaluator — real implementation.

Covers: verification.checkpoints.concurrent, verification.types

Kind Name Line Description
class TestConcurrentCheckpointEvaluator 33
method TestConcurrentCheckpointEvaluator.test_init_defaults 34
method TestConcurrentCheckpointEvaluator.test_init_custom 39
method TestConcurrentCheckpointEvaluator.test_evaluate_all_empty 44
method TestConcurrentCheckpointEvaluator.test_evaluate_all_single 50
method TestConcurrentCheckpointEvaluator.test_evaluate_all_multiple 61
method TestConcurrentCheckpointEvaluator.test_evaluate_sequential_all_pass 76
method TestConcurrentCheckpointEvaluator.test_evaluate_sequential_stops_on_failure 86

tests/verification/test_config.py

source · 4 tests · 66 lines

Tests for verification.config.verification_config — real implementations.

Covers: verification.config.verification_config

Kind Name Line Description
class TestModelConfig 30
method TestModelConfig.test_default 31
method TestModelConfig.test_custom 39
class TestVerificationConfig 46
method TestVerificationConfig.test_default 47
method TestVerificationConfig.test_default_classmethod 64

tests/verification/test_constraint_definitions.py

source · 8 tests · 75 lines

Tests for verification/requirements/constraint_definitions.py.

Covers: verification.requirements.constraint_definitions, verification.types

Kind Name Line Description
class TestConstraintDefinitions 35
method TestConstraintDefinitions.test_functional_constraints 36
method TestConstraintDefinitions.test_quality_constraints 40
method TestConstraintDefinitions.test_performance_constraints 44
method TestConstraintDefinitions.test_security_constraints 50
method TestConstraintDefinitions.test_all_predefined 54
method TestConstraintDefinitions.test_get_constraints_by_type 63
method TestConstraintDefinitions.test_get_constraint_by_id_found 68
method TestConstraintDefinitions.test_get_constraint_by_id_not_found 73

tests/verification/test_constraints.py

source · 9 tests · 61 lines

Tests for verification.constraints.definitions.

Covers: verification.constraints.definitions, verification.types

Kind Name Line Description
class TestIsBlocking 12
method TestIsBlocking.test_high_priority_blocks 13
method TestIsBlocking.test_security_blocks 17
method TestIsBlocking.test_low_priority_non_security_not_blocking 21
class TestGroupByType 26
method TestGroupByType.test_groups_correctly 27
method TestGroupByType.test_empty_list 35
class TestSortByPriority 39
method TestSortByPriority.test_sorts_descending 40
method TestSortByPriority.test_empty_list 47
class TestFilterByType 51
method TestFilterByType.test_filters 52
method TestFilterByType.test_no_match 59

tests/verification/test_constraints_definitions.py

source · 6 tests · 74 lines

Tests for verification/constraints/definitions.py — constraint helpers.

Covers: verification.constraints.definitions, verification.types

Kind Name Line Description
class TestIsBlocking 32
method TestIsBlocking.test_security_is_blocking 33
method TestIsBlocking.test_high_priority_is_blocking 37
method TestIsBlocking.test_low_priority_not_blocking 41
class TestGroupByType 46
method TestGroupByType.test_groups_correctly 47
class TestSortByPriority 56
method TestSortByPriority.test_sorts_descending 57
class TestFilterByType 67
method TestFilterByType.test_filters 68

tests/verification/test_constraints_evaluator.py

source · 21 tests · 188 lines

Tests for verification.constraints.evaluator — real implementations.

Covers: verification.constraints.evaluator, verification.types

Kind Name Line Description
class TestConstraintEvaluatorInit 32
method TestConstraintEvaluatorInit.test_init 33
class TestConstraintEvaluatorEvaluate 38
method TestConstraintEvaluatorEvaluate.test_evaluate_missing_value 39
method TestConstraintEvaluatorEvaluate.test_evaluate_equality 46
method TestConstraintEvaluatorEvaluate.test_evaluate_inequality 53
method TestConstraintEvaluatorEvaluate.test_evaluate_performance_pass 59
method TestConstraintEvaluatorEvaluate.test_evaluate_performance_fail 67
method TestConstraintEvaluatorEvaluate.test_evaluate_performance_non_numeric 75
method TestConstraintEvaluatorEvaluate.test_evaluate_quality_numeric_pass 83
method TestConstraintEvaluatorEvaluate.test_evaluate_quality_numeric_fail 89
method TestConstraintEvaluatorEvaluate.test_evaluate_quality_non_numeric_true 95
method TestConstraintEvaluatorEvaluate.test_evaluate_quality_non_numeric_false 101
method TestConstraintEvaluatorEvaluate.test_evaluate_security_pass 107
method TestConstraintEvaluatorEvaluate.test_evaluate_security_fail 115
method TestConstraintEvaluatorEvaluate.test_evaluate_none_expected 123
method TestConstraintEvaluatorEvaluate.test_evaluate_none_expected_false 129
class TestConstraintEvaluatorEvaluateAll 136
method TestConstraintEvaluatorEvaluateAll.test_multiple 137
method TestConstraintEvaluatorEvaluateAll.test_empty 145
class TestConstraintEvaluatorEvaluateWithDependencies 151
method TestConstraintEvaluatorEvaluateWithDependencies.test_simple 152
method TestConstraintEvaluatorEvaluateWithDependencies.test_dependency_not_met 162
method TestConstraintEvaluatorEvaluateWithDependencies.test_missing_constraint 174
method TestConstraintEvaluatorEvaluateWithDependencies.test_circular_dependencies 182

tests/verification/test_coordinator.py

source · 9 tests · 91 lines

Tests for verification/orchestration/coordinator.py — VerificationCoordinator.

Covers: verification.orchestration.coordinator, verification.types

Kind Name Line Description
class TestVerificationCoordinator 29
method TestVerificationCoordinator.test_init 30
method TestVerificationCoordinator.test_init_custom_attempts 35
method TestVerificationCoordinator.test_start_workflow 39
method TestVerificationCoordinator.test_advance_step 48
method TestVerificationCoordinator.test_advance_to_completion 58
method TestVerificationCoordinator.test_advance_unknown_session 75
method TestVerificationCoordinator.test_get_workflow_unknown 79
method TestVerificationCoordinator.test_is_complete_unknown 83
method TestVerificationCoordinator.test_workflow_count 87

tests/verification/test_edge_case_database.py

source · 7 tests · 55 lines

Tests for verification.edge_cases.database.

Covers: verification.edge_cases.database, verification.types

Kind Name Line Description
class TestEdgeCaseDatabase 7
method TestEdgeCaseDatabase.test_add_and_get 8
method TestEdgeCaseDatabase.test_get_missing 14
method TestEdgeCaseDatabase.test_get_by_constraint 18
method TestEdgeCaseDatabase.test_list_all 31
method TestEdgeCaseDatabase.test_remove 37
method TestEdgeCaseDatabase.test_count 45
method TestEdgeCaseDatabase.test_clear 51

tests/verification/test_edge_cases.py

source · 26 tests · 272 lines

Tests for verification.edge_cases.* .

Covers: verification.edge_cases.database, verification.edge_cases.detector, verification.types

Kind Name Line Description
function test_database_add_and_get 29
function test_database_get_missing 36
function test_database_get_by_constraint 41
function test_database_list_all 52
function test_database_remove_existing 58
function test_database_count_and_clear 65
function test_detector_detect_partial_produces_medium 78
function test_detector_detect_error_produces_high 92
function test_detector_detect_satisfied_no_edge_case 104
function test_detector_boundary_near_miss 115
function test_detector_boundary_far_miss_no_case 127
function test_detector_boundary_missing_values 133
function test_detector_pattern_detects_empty_input 144
function test_detector_pattern_zero_division 151
function test_detector_suggest_skips_already_tested 158
function test_detector_calculate_coverage 167
function test_detector_generate_test_suggestions_per_category 175
function test_detector_is_edge_case_tested_by_name_keyword 183
function test_detector_database_add_and_retrieve 200
function test_detector_database_get_edge_cases_for_task 215
function test_detector_database_record_occurrence 221
function test_detector_database_get_coverage_default 229
function test_reporter_generate_report 240
function test_reporter_export_json 248
function test_reporter_export_markdown 255
function test_reporter_critical_recommendations 262

tests/verification/test_edge_cases_database.py

source · 7 tests · 75 lines

Tests for verification/edge_cases/database.py — EdgeCaseDatabase.

Covers: verification.edge_cases.database, verification.types

Kind Name Line Description
class TestEdgeCaseDatabase 27
method TestEdgeCaseDatabase.test_init 28
method TestEdgeCaseDatabase.test_add_and_get 32
method TestEdgeCaseDatabase.test_get_missing 39
method TestEdgeCaseDatabase.test_get_by_constraint 43
method TestEdgeCaseDatabase.test_list_all 56
method TestEdgeCaseDatabase.test_remove 62
method TestEdgeCaseDatabase.test_clear 70

tests/verification/test_engine.py

source · 5 tests · 70 lines

Tests for verification.verification.engine.

Covers: verification.types, verification.verification.engine

Kind Name Line Description
class TestVerificationEngine 33
method TestVerificationEngine.test_verify_complete_session 34
method TestVerificationEngine.test_verify_with_constraints 41
method TestVerificationEngine.test_verify_checkpoint 47
method TestVerificationEngine.test_generate_feedback 54
method TestVerificationEngine.test_generate_feedback_empty 67

tests/verification/test_engine_pure.py

source · 27 tests · 269 lines

Unit tests for verification/review/engine pure helpers.

Covers: verification.review.engine

Kind Name Line Description
function test_collect_workspace_files_empty 38
function test_collect_workspace_files_finds_files 43
function test_detect_project_modules_src_layout 53
function test_detect_project_modules_flat_layout 63
function test_detect_project_modules_no_modules 71
function test_detect_project_modules_both_layouts 76
function test_split_files_empty 90
function test_split_files_mixed 96
function test_discover_extra_tests_finds_tests 110
function test_discover_extra_tests_skips_existing 121
function test_discover_extra_tests_skips_skip_dirs 128
function test_is_test_file_test_prefix 137
function test_is_test_file_tests_dir 142
function test_is_test_file_not_test 147
function test_review_single_file_missing 152
function test_review_single_file_syntax_error 157
function test_review_single_file_valid_source 164
function test_review_single_file_valid_test 171
function test_source_only_runs_checks 180
function test_source_only_main_file 194
class TestFormatReviewReport 208
method TestFormatReviewReport.test_empty_issues_pass 209
method TestFormatReviewReport.test_single_issue 213
method TestFormatReviewReport.test_multiple_issues_same_check 220
method TestFormatReviewReport.test_multiple_checks 231
method TestFormatReviewReport.test_truncates_more_than_five 244
method TestFormatReviewReport.test_exactly_five_no_truncation 253
method TestFormatReviewReport.test_issue_ordering_by_check 260

tests/verification/test_escalation_handler.py

source · 11 tests · 174 lines

Tests for verification.escalation_handler.

Covers: verification.escalation_handler, verification.types

Kind Name Line Description
class TestEscalationHandler 35
method TestEscalationHandler.test_should_escalate_when_attempts_at_max 36
method TestEscalationHandler.test_should_escalate_when_attempts_exceed_max 41
method TestEscalationHandler.test_should_not_escalate_when_under_max 46
method TestEscalationHandler.test_should_not_escalate_when_zero_attempts 51
method TestEscalationHandler.test_escalate_to_human_sets_status 56
method TestEscalationHandler.test_escalate_to_human_collects_failed_constraints 73
method TestEscalationHandler.test_escalate_to_human_no_failed_constraints 97
method TestEscalationHandler.test_build_escalation_report 110
method TestEscalationHandler.test_build_escalation_report_empty_results 145
method TestEscalationHandler.test_escalate_report_in_message 156
method TestEscalationHandler.test_default_max_attempts 172

tests/verification/test_execution_agent.py

source · 10 tests · 91 lines

Tests for verification execution agent.

Covers: verification.agents.execution_agent, verification.types

Kind Name Line Description
class TestExecutionAgent 27 Tests for ExecutionAgent.
method TestExecutionAgent.test_default_agent_id 30
method TestExecutionAgent.test_custom_agent_id 34
method TestExecutionAgent.test_receive_constraints 38
method TestExecutionAgent.test_receive_constraints_copies_list 45
method TestExecutionAgent.test_execute_step 52
method TestExecutionAgent.test_execute_step_multiple_checkpoints 62
method TestExecutionAgent.test_submit_for_verification 68
method TestExecutionAgent.test_submit_for_verification_no_artifact 76
method TestExecutionAgent.test_receive_feedback 81
method TestExecutionAgent.test_properties_initial 87

tests/verification/test_feedback.py

source · 7 tests · 110 lines

Tests for verification/verification/feedback.py — FeedbackGenerator.

Covers: verification.types, verification.verification.feedback

Kind Name Line Description
class TestFeedbackGenerator 30
method TestFeedbackGenerator.test_generate_feedback_all_passed 31
method TestFeedbackGenerator.test_generate_feedback_with_failures 41
method TestFeedbackGenerator.test_generate_feedback_empty 59
method TestFeedbackGenerator.test_suggest_fixes_error_severity 65
method TestFeedbackGenerator.test_suggest_fixes_warning_severity 77
method TestFeedbackGenerator.test_build_suggestion_with_expected_actual 89
method TestFeedbackGenerator.test_build_suggestion_without_expected_actual 102

tests/verification/test_feedback_generator.py

source · 9 tests · 143 lines

Tests for verification feedback generator.

Covers: verification.types, verification.verification.feedback

Kind Name Line Description
class TestFeedbackGenerator 31 Tests for FeedbackGenerator.
method TestFeedbackGenerator.test_generate_feedback_all_satisfied 34
method TestFeedbackGenerator.test_generate_feedback_some_failed 48
method TestFeedbackGenerator.test_generate_feedback_empty 69
method TestFeedbackGenerator.test_generate_feedback_with_error_status 75
method TestFeedbackGenerator.test_suggest_fixes 88
method TestFeedbackGenerator.test_suggest_fixes_no_expected_actual 105
method TestFeedbackGenerator.test_suggest_fixes_empty_details 117
method TestFeedbackGenerator.test_build_suggestion_message_with_expected_actual 128
method TestFeedbackGenerator.test_build_suggestion_message_without_expected_actual 139

tests/verification/test_implementation_scanner.py

source · 53 tests · 696 lines

Tests for orchestrata_ultimate.verification.implementation_scanner — the

Covers: verification._non_python_scan, verification.implementation_scanner

Kind Name Line Description
class TestNoFilesystemWalk 72
method TestNoFilesystemWalk.test_module_contains_no_directory_walk_or_open 73
class TestRegistryInjection 99
method TestRegistryInjection.test_extra_detector_changes_output_with_zero_scanner_edits 100
class TestDecisiveCommentDocstringStringLiteral 143 The defect this rewrite fixes: text that merely LOOKS like a class
method TestDecisiveCommentDocstringStringLiteral.test_class_named_only_in_comment_is_not_evidence 147
method TestDecisiveCommentDocstringStringLiteral.test_class_named_only_in_docstring_is_not_evidence 153
method TestDecisiveCommentDocstringStringLiteral.test_class_named_only_in_string_literal_is_not_evidence 164
method TestDecisiveCommentDocstringStringLiteral.test_registration_key_named_only_in_comment_is_not_evidence 170
class TestClassDetector 179
method TestClassDetector.test_real_class_definition_is_evidence 180
class TestFunctionDetector 190
method TestFunctionDetector.test_async_handler_detected_with_is_async_true 191
method TestFunctionDetector.test_sync_function_detected_with_is_async_false 203
method TestFunctionDetector.test_method_on_class_is_detected_as_function_evidence 215
class TestExportDetector 229
method TestExportDetector.test_all_exports_multiline_list 230
method TestExportDetector.test_all_exports_as_tuple 237
class TestModuleDetector 245
method TestModuleDetector.test_module_basename_is_evidence 246
method TestModuleDetector.test_nested_module_is_discovered 254
class TestRegistrationDetector 263
method TestRegistrationDetector.test_registration_key_is_evidence 264
method TestRegistrationDetector.test_non_string_subscript_key_is_not_evidence 278
method TestRegistrationDetector.test_module_missing_from_trees_is_skipped_not_errored 286
class TestBuildProjectSource 303
method TestBuildProjectSource.test_missing_project_dir_raises 304
method TestBuildProjectSource.test_trees_populated_for_every_discovered_module 309
class TestScanImplementation 317
method TestScanImplementation.test_missing_project_dir_raises 318
method TestScanImplementation.test_returns_sorted_deduplicated_facts 323
method TestScanImplementation.test_fact_escapes_single_quotes 331
class TestMatchRequirementsToEvidence 342
method TestMatchRequirementsToEvidence.test_missing_project_dir_raises 343
method TestMatchRequirementsToEvidence.test_dotted_token_resolves_to_registration_evidence 348
method TestMatchRequirementsToEvidence.test_backtick_token_resolves_to_class_evidence 367
method TestMatchRequirementsToEvidence.test_named_identifier_with_no_evidence_is_a_real_gap 377
method TestMatchRequirementsToEvidence.test_description_naming_nothing_structural_is_unresolved 391
method TestMatchRequirementsToEvidence.test_all_three_buckets_together 405
class TestCandidateIdentifiers 427
method TestCandidateIdentifiers.test_backtick_span_extracted 428
method TestCandidateIdentifiers.test_dotted_token_extracted_without_backticks 433
method TestCandidateIdentifiers.test_plain_lowercase_words_are_not_candidates 438
method TestCandidateIdentifiers.test_bare_camelcase_word_is_a_candidate 442
method TestCandidateIdentifiers.test_bare_snake_case_word_is_a_candidate 447
method TestCandidateIdentifiers.test_sentence_capitalized_word_is_not_a_candidate 452
method TestCandidateIdentifiers.test_all_caps_acronym_is_not_a_candidate 457
method TestCandidateIdentifiers.test_empty_description_yields_no_candidates 460
class TestCollectNonPythonFiles 471 _non_python_scan._collect_non_python_files — the one directory
method TestCollectNonPythonFiles.test_collects_known_extensions_only 476
method TestCollectNonPythonFiles.test_walks_nested_directories 490
method TestCollectNonPythonFiles.test_node_modules_and_git_are_skipped 497
class TestJsTsAstDetector 512 AST-precise JS/TS class/function evidence — the case that
method TestJsTsAstDetector.test_js_export_extracted 516
method TestJsTsAstDetector.test_tsx_component_yields_evidence 538
method TestJsTsAstDetector.test_js_class_method_is_function_evidence 550
method TestJsTsAstDetector.test_async_js_function_detected_with_is_async_true 562
class TestNonPythonBasenameEvidence 577 Every collected file's extension-less basename is evidence —
method TestNonPythonBasenameEvidence.test_basename_always_included_as_evidence 583
method TestNonPythonBasenameEvidence.test_html_file_yields_only_basename_evidence 588
method TestNonPythonBasenameEvidence.test_js_ts_file_basename_is_evidence_alongside_its_symbols 601
class TestNonPythonAdditive 608 The Python detector path is untouched — additive only.
method TestNonPythonAdditive.test_python_only_project_evidence_is_byte_identical 611
method TestNonPythonAdditive.test_mixed_project_python_evidence_unaffected_by_js 621
class TestJsTsToolchainDiagnostics 636 The difference between 'no JS/TS files present' (never invoked)
method TestJsTsToolchainDiagnostics.test_no_js_ts_files_present_yields_no_diagnostic 641
method TestJsTsToolchainDiagnostics.test_python_only_project_yields_no_non_python_diagnostic 647
method TestJsTsToolchainDiagnostics.test_broken_node_toolchain_reports_diagnostic_not_silent_zero 653
method TestJsTsToolchainDiagnostics.test_missing_serializer_script_reports_diagnostic 672
method TestJsTsToolchainDiagnostics.test_malformed_json_output_reports_no_symbols 691

tests/verification/test_impossibility_handler.py

source · 15 tests · 150 lines

Tests for ImpossibilityHandler — real implementation.

Covers: verification.impossibility.handler, verification.types

Kind Name Line Description
class TestImpossibilityHandler 26
method TestImpossibilityHandler.test_detect_contradictions_empty 27
method TestImpossibilityHandler.test_detect_contradictions_single 31
method TestImpossibilityHandler.test_detect_contradictions_same_value 36
method TestImpossibilityHandler.test_detect_contradictions_different_value 48
method TestImpossibilityHandler.test_detect_contradictions_quality 64
method TestImpossibilityHandler.test_detect_contradictions_mixed_types 77
method TestImpossibilityHandler.test_detect_contradictions_none_expected 89
method TestImpossibilityHandler.test_detect_impossible_empty 101
method TestImpossibilityHandler.test_detect_impossible_performance_zero 105
method TestImpossibilityHandler.test_detect_impossible_performance_negative 113
method TestImpossibilityHandler.test_detect_impossible_performance_positive 119
method TestImpossibilityHandler.test_detect_impossible_quality_over_100 124
method TestImpossibilityHandler.test_detect_impossible_quality_exact_100 131
method TestImpossibilityHandler.test_detect_impossible_functional 136
method TestImpossibilityHandler.test_detect_impossible_multiple 141

tests/verification/test_integrations_session_config.py

source · 48 tests · 491 lines

Tests for verification.integrations., session., config., orchestration.,

Covers: verification.config.verification_config, verification.escalation_handler, verification.impossibility.handler, verification.integrations.intent_broker, verification.integrations.redis_manager, verification.orchestration.coordinator, verification.protocols.verification_cxp, verification.session.verification_session, verification.types, verification.verification.engine, verification.verification.feedback

Kind Name Line Description
function test_intent_broker_performance 44
function test_intent_broker_quality 58
function test_intent_broker_security 66
function test_intent_broker_default_functional 74
function test_redis_manager_no_redis 87
function test_redis_manager_save_load 96
function test_redis_manager_load_invalid_json 106
function test_session_manager_create_and_get 119
function test_session_manager_get_missing 126
function test_session_manager_increment 131
function test_session_manager_is_max_exceeded 138
function test_session_manager_update_results 146
function test_session_manager_update_status 154
function test_session_manager_list_sessions 161
function test_session_manager_with_redis 168
function test_verification_config_default 181
function test_model_config_defaults 187
function test_coordinator_start_and_advance 197
function test_coordinator_advance_through_all_steps 206
function test_coordinator_advance_unknown 217
function test_coordinator_get_workflow_missing 222
function test_engine_verify_complete_session_returns_existing 232
function test_engine_verify_all_satisfied_completes_session 240
function test_engine_verify_escalates_at_max_attempts 248
function test_engine_verify_checkpoint 259
function test_engine_generate_feedback 268
function test_feedback_generator_empty 288
function test_feedback_generator_all_satisfied 294
function test_feedback_generator_suggest_fixes_severity 302
function test_feedback_generator_suggest_with_expected 317
function test_impossibility_detect_contradictions 331
function test_impossibility_no_contradictions_different_predicates 339
function test_impossibility_none_expected_not_contradictory 346
function test_impossibility_quality_contradictions 353
function test_impossibility_detect_impossible_negative_perf 361
function test_impossibility_detect_impossible_quality_over_100 368
function test_impossibility_detect_none_valid 375
function test_escalation_should_escalate 386
function test_escalation_should_not_escalate 392
function test_escalation_to_human 398
function test_escalation_build_report 413
function test_cxp_constraint_message 432
function test_cxp_verification_request 441
function test_cxp_verification_result 447
function test_cxp_escalation_message 456
function test_cxp_feedback_message 466
function test_cxp_proof_request_and_submission 472
function test_cxp_parse_message 480

tests/verification/test_intent_broker.py

source · 8 tests · 96 lines

Tests for verification intent broker adapter.

Covers: verification.integrations.intent_broker, verification.types

Kind Name Line Description
class TestIntentBrokerAdapter 29 Tests for IntentBrokerAdapter.
method TestIntentBrokerAdapter.test_init 32
method TestIntentBrokerAdapter.test_intent_to_constraints_empty 36
method TestIntentBrokerAdapter.test_intent_to_constraints_with_requirements 43
method TestIntentBrokerAdapter.test_infer_type_performance 61
method TestIntentBrokerAdapter.test_infer_type_quality 72
method TestIntentBrokerAdapter.test_infer_type_security 78
method TestIntentBrokerAdapter.test_infer_type_default 84
method TestIntentBrokerAdapter.test_intent_to_constraints_uses_action_as_predicate_default 89

tests/verification/test_issue_triage.py

source · 9 tests · 101 lines

Tests for verification issue triage.

Covers: verification.review.issue_triage

Kind Name Line Description
class TestPrioritizeIssues 26 Tests for prioritize_issues.
method TestPrioritizeIssues.test_empty_list 29
method TestPrioritizeIssues.test_single_issue 32
method TestPrioritizeIssues.test_critical_before_cosmetic 36
method TestPrioritizeIssues.test_critical_order 49
method TestPrioritizeIssues.test_cosmetic_order 62
method TestPrioritizeIssues.test_untagged_middle_priority 73
method TestPrioritizeIssues.test_max_issues_cap 84
method TestPrioritizeIssues.test_max_issues_default 89
method TestPrioritizeIssues.test_unrecognized_tag 94

tests/verification/test_model_registry.py

source · 5 tests · 60 lines

Tests for verification/models/base_model.py ModelRegistry.

Covers: verification.models.base_model

Kind Name Line Description
class TestModelRegistry 27
method TestModelRegistry.test_register_and_get 28
method TestModelRegistry.test_get_missing 34
method TestModelRegistry.test_list_models 38
method TestModelRegistry.test_count 44
class TestModelFallbackChain 53
method TestModelFallbackChain.test_model_count 54

tests/verification/test_models.py

source · 27 tests · 211 lines

Tests for verification model wrappers.

Covers: verification.models.deepseek_r1, verification.models.grok4_minimax, verification.models.opus, verification.models.qwen_max

Kind Name Line Description
class TestGrokMiniMaxModel 31 Tests for GrokMiniMaxModel.
method TestGrokMiniMaxModel.test_name 34
method TestGrokMiniMaxModel.test_default_base_url 38
method TestGrokMiniMaxModel.test_custom_init 42
method TestGrokMiniMaxModel.test_capabilities 47
method TestGrokMiniMaxModel.test_verify 56
method TestGrokMiniMaxModel.test_verify_no_id 64
method TestGrokMiniMaxModel.test_analyze 70
method TestGrokMiniMaxModel.test_analyze_empty 83
method TestGrokMiniMaxModel.test_generate_proof 89
class TestDeepseekR1Model 97 Tests for DeepseekR1Model.
method TestDeepseekR1Model.test_name 100
method TestDeepseekR1Model.test_default_base_url 104
method TestDeepseekR1Model.test_capabilities 108
method TestDeepseekR1Model.test_verify 117
method TestDeepseekR1Model.test_analyze 124
method TestDeepseekR1Model.test_generate_proof 130
class TestClaudeOpusModel 136 Tests for ClaudeOpusModel.
method TestClaudeOpusModel.test_name 139
method TestClaudeOpusModel.test_default_base_url 143
method TestClaudeOpusModel.test_capabilities 147
method TestClaudeOpusModel.test_verify 156
method TestClaudeOpusModel.test_analyze 163
method TestClaudeOpusModel.test_generate_proof 169
class TestQwenMaxModel 175 Tests for QwenMaxModel.
method TestQwenMaxModel.test_name 178
method TestQwenMaxModel.test_default_base_url 182
method TestQwenMaxModel.test_capabilities 186
method TestQwenMaxModel.test_verify 195
method TestQwenMaxModel.test_analyze 202
method TestQwenMaxModel.test_generate_proof 208

tests/verification/test_models_base_model.py

source · 11 tests · 138 lines

Tests for verification.models.base_model — real implementations.

Covers: verification.models.base_model

Kind Name Line Description
class TestModelRegistry 67
method TestModelRegistry.test_register_and_get 68
method TestModelRegistry.test_get_missing 74
method TestModelRegistry.test_list_models 78
method TestModelRegistry.test_count 84
class TestModelFallbackChain 91
method TestModelFallbackChain.test_verify_first_succeeds 93
method TestModelFallbackChain.test_verify_fallback 100
method TestModelFallbackChain.test_verify_all_fail 108
method TestModelFallbackChain.test_analyze_first_succeeds 116
method TestModelFallbackChain.test_analyze_fallback 123
method TestModelFallbackChain.test_analyze_all_fail 131
method TestModelFallbackChain.test_model_count 136

tests/verification/test_non_python_scan_coverage.py

source · 17 tests · 275 lines

Branch-completion tests for verification._non_python_scan.

Covers: verification._non_python_scan

Kind Name Line Description
class TestNamedGuard 28 _named — absent key, non-string value, and the TypeScript
method TestNamedGuard.test_non_string_name_is_unnamed 33
method TestNamedGuard.test_absent_name_is_unnamed 38
method TestNamedGuard.test_compiler_placeholder_names_are_unnamed 41
method TestNamedGuard.test_real_identifier_is_named 47
class TestSymbolsFromAstJsonDegradedShapes 51 _symbols_from_ast_json degrades to fewer symbols found on a
method TestSymbolsFromAstJsonDegradedShapes.test_non_dict_module_entries_are_skipped 55
method TestSymbolsFromAstJsonDegradedShapes.test_non_dict_and_unnamed_function_entries_are_skipped 72
method TestSymbolsFromAstJsonDegradedShapes.test_function_defaults_when_fields_missing 98
method TestSymbolsFromAstJsonDegradedShapes.test_non_dict_and_unnamed_class_entries_are_skipped 106
method TestSymbolsFromAstJsonDegradedShapes.test_non_dict_and_unnamed_method_entries_are_skipped 125
method TestSymbolsFromAstJsonDegradedShapes.test_null_function_and_class_lists_are_tolerated 153
class TestRunJsTsSerializerFailureBranches 160 Every (symbols, diagnostic) failure pair _run_js_ts_serializer can
method TestRunJsTsSerializerFailureBranches.test_timeout_reports_diagnostic 165
method TestRunJsTsSerializerFailureBranches.test_unlaunchable_process_reports_diagnostic 175
method TestRunJsTsSerializerFailureBranches.test_unreadable_output_reports_diagnostic 190
method TestRunJsTsSerializerFailureBranches.test_invalid_json_output_reports_diagnostic 206
method TestRunJsTsSerializerFailureBranches.test_non_object_json_output_reports_diagnostic 220
method TestRunJsTsSerializerFailureBranches.test_successful_script_yields_symbols_and_no_diagnostic 234
class TestCollectNonPythonSourceDiagnosticFlow 252 The diagnostic pairs the public entry point composes — a JS/TS file
method TestCollectNonPythonSourceDiagnosticFlow.test_failed_serializer_still_reports_file_count_and_basenames 257

tests/verification/test_prolog_generator.py

source · 12 tests · 111 lines

Tests for PrologGenerator — real implementation.

Covers: verification.requirements.prolog_generator, verification.types

Kind Name Line Description
class TestPrologGenerator 28
method TestPrologGenerator.test_generate_empty 29
method TestPrologGenerator.test_generate_with_constraints 35
method TestPrologGenerator.test_generate_predicate_performance 49
method TestPrologGenerator.test_generate_predicate_quality_numeric 57
method TestPrologGenerator.test_generate_predicate_quality_non_numeric 65
method TestPrologGenerator.test_generate_predicate_security 73
method TestPrologGenerator.test_generate_predicate_functional 81
method TestPrologGenerator.test_validate_syntax_valid 89
method TestPrologGenerator.test_validate_syntax_module 94
method TestPrologGenerator.test_validate_syntax_invalid 99
method TestPrologGenerator.test_validate_syntax_comment_ignored 104
method TestPrologGenerator.test_validate_syntax_empty 109

tests/verification/test_proofs_verifier.py

source · 9 tests · 105 lines

Tests for verification.proofs.verifier — real implementations.

Covers: verification.proofs.verifier, verification.types

Kind Name Line Description
class TestProofVerifier 26
method TestProofVerifier.test_verify_exhaustive_search_valid 27
method TestProofVerifier.test_verify_exhaustive_search_invalid 38
method TestProofVerifier.test_verify_logical_deduction_valid 46
method TestProofVerifier.test_verify_logical_deduction_invalid 57
method TestProofVerifier.test_verify_mathematical_valid 64
method TestProofVerifier.test_verify_mathematical_invalid 75
method TestProofVerifier.test_verify_practical_explanation_valid 82
method TestProofVerifier.test_verify_practical_explanation_invalid 93
method TestProofVerifier.test_verify_unknown_type 100

tests/verification/test_protocols_cxp.py

source · 9 tests · 84 lines

Tests for verification.protocols.verification_cxp — real implementations.

Covers: verification.protocols.verification_cxp, verification.types

Kind Name Line Description
class TestVerificationCXPAdapter 15
method TestVerificationCXPAdapter.test_create_constraint_message 16
method TestVerificationCXPAdapter.test_create_verification_request 24
method TestVerificationCXPAdapter.test_create_verification_result_all_satisfied 32
method TestVerificationCXPAdapter.test_create_verification_result_not_all_satisfied 39
method TestVerificationCXPAdapter.test_create_escalation_message 45
method TestVerificationCXPAdapter.test_create_feedback_message 56
method TestVerificationCXPAdapter.test_create_proof_request 62
method TestVerificationCXPAdapter.test_create_proof_submission 68
method TestVerificationCXPAdapter.test_parse_message 74

tests/verification/test_redis_manager.py

source · 5 tests · 27 lines

Tests for verification/integrations/redis_manager.py no-Redis paths.

Covers: verification.integrations.redis_manager

Kind Name Line Description
class TestVerificationRedisManagerNoRedis 8
method TestVerificationRedisManagerNoRedis.test_available_false 9
method TestVerificationRedisManagerNoRedis.test_save_state_no_redis 13
method TestVerificationRedisManagerNoRedis.test_load_state_no_redis 17
method TestVerificationRedisManagerNoRedis.test_delete_state_no_redis 21
method TestVerificationRedisManagerNoRedis.test_list_keys_no_redis 25

tests/verification/test_requirements.py

source · 29 tests · 240 lines

Tests for verification/requirements/*.

Covers: verification.requirements.constraint_definitions, verification.requirements.prolog_generator, verification.requirements.requirements_parser, verification.types

Kind Name Line Description
function test_get_constraints_by_type_functional 18
function test_get_constraints_by_type_quality 23
function test_get_constraint_by_id_known 30
function test_get_constraint_by_id_unknown 36
function test_all_predefined_covers_four_types 40
function test_parser_extract_performance_response_time 53
function test_parser_extract_performance_latency 60
function test_parser_extract_performance_throughput 66
function test_parser_extract_performance_memory 72
function test_parser_extract_quality_coverage 78
function test_parser_extract_quality_linting 84
function test_parser_extract_quality_docs 90
function test_parser_extract_security_sqli 96
function test_parser_extract_security_secrets 102
function test_parser_extract_security_xss 108
function test_parser_extract_functional_file 114
function test_parser_extract_functional_compile 120
function test_parser_extract_functional_deps 126
function test_parser_parse_aggregates_all_types 132
function test_generator_generate_emits_module 152
function test_generator_predicate_performance 174
function test_generator_predicate_quality_numeric 184
function test_generator_predicate_quality_non_numeric 193
function test_generator_predicate_security 202
function test_generator_predicate_functional_default 211
function test_generator_validate_syntax_valid 220
function test_generator_validate_syntax_invalid_line 226
function test_generator_validate_syntax_directive_with_period 232
function test_generator_validate_syntax_empty 238

tests/verification/test_review.py

source · 21 tests · 222 lines

Covers: verification.review.helpers, verification.review/ (package)

Kind Name Line Description
function test_parse_file_valid 50
function test_parse_file_invalid_syntax 58
function test_parse_file_missing 65
function test_read_lines 69
function test_read_lines_missing 76
function test_is_public 80
function test_function_line_count_with_docstring 85
function test_function_line_count_empty 99
function test_get_pyproject_deps 106
function test_get_pyproject_deps_missing_file 121
function test_collect_imported_modules 125
function test_read_workspace_files 135
function test_prioritize_issues_order 148
function test_prioritize_issues_caps_to_max 161
function test_prioritize_issues_untagged_middle 167
function test_run_deterministic_review_empty_workspace 182
function test_run_deterministic_review_skips_missing 187
function test_run_deterministic_review_detects_syntax_error 192
function test_format_review_report_pass 202
function test_format_review_report_fail_format 206
function test_format_review_report_truncates 218

tests/verification/test_review_checks.py

source · 51 tests · 425 lines

Tests for verification.review.checks_* modules.

Covers: verification.review.checks_correctness, verification.review.checks_quality, verification.review.checks_safety, verification.review.checks_structure

Kind Name Line Description
function test_check_imports_relative_flagged 46
function test_check_imports_order_violation 52
function test_check_file_completeness_missing_module 59
function test_check_file_completeness_found_module 70
function test_check_entry_point_main_guard_missing 81
function test_check_entry_point_non_main_no_issue 86
function test_check_entry_point_has_guard 90
function test_check_dependency_undeclared 95
function test_check_dependency_aliased 103
function test_check_dependency_no_declared_deps_skipped 114
function test_check_type_hints_missing_return 129
function test_check_type_hints_missing_param 135
function test_check_type_hints_class_method_missing_return 141
function test_check_type_hints_private_skipped 147
function test_check_mutable_defaults_list 152
function test_check_mutable_defaults_dict 158
function test_check_mutable_defaults_clean 164
function test_check_docstrings_missing 169
function test_check_docstrings_class_missing 175
function test_check_docstrings_present 181
function test_check_line_length_violations 186
function test_check_line_length_url_exempt 192
function test_check_line_length_many_violations_truncated 198
function test_check_security_eval 210
function test_check_security_hardcoded_password 216
function test_check_security_os_environ_exempt 226
function test_check_todo_comments 232
function test_check_no_mocks_detects_import 238
function test_check_no_mocks_clean 244
function test_validate_code_no_mocks 249
function test_check_lint_runs 255
function test_check_function_length_violation 268
function test_check_function_args_violation 275
function test_check_function_args_self_not_counted 281
function test_check_no_placeholder_pass_only 286
function test_check_no_placeholder_not_implemented 292
function test_check_no_placeholder_valid 298
function test_check_error_handling_bare_except 303
function test_check_error_handling_specific_except_ok 309
function test_check_nesting_depth_deep 320
function test_check_nesting_depth_shallow 335
function test_check_god_objects_file_too_long 343
function test_check_god_objects_too_many_methods 351
function test_check_stub_methods_detects_pass_only 358
function test_check_stub_methods_skips_test_files 366
function test_check_stub_methods_real_logic_ignored 376
function test_check_env_access_flags_bare_subscript 394
function test_check_env_access_flags_single_quoted_subscript 401
function test_check_env_access_allows_get_with_default 407
function test_check_env_access_ignores_string_literals 413
function test_check_env_access_ignores_assignment_to_environ 421

tests/verification/test_review_checks_expanded.py

source · 73 tests · 542 lines

Covers: verification.review.checks_correctness, verification.review.checks_quality, verification.review.checks_safety, verification.review.checks_structure

Kind Name Line Description
class TestCheckFunctionLength 68
method TestCheckFunctionLength.test_short_function_passes 69
method TestCheckFunctionLength.test_long_function_fails 74
class TestCheckFunctionArgs 82
method TestCheckFunctionArgs.test_few_args_passes 83
method TestCheckFunctionArgs.test_many_args_fails 88
method TestCheckFunctionArgs.test_self_excluded 94
method TestCheckFunctionArgs.test_kwonly_args_counted 99
class TestCheckNoPlaceholder 105
method TestCheckNoPlaceholder.test_empty_pass_body 106
method TestCheckNoPlaceholder.test_docstring_and_pass 112
method TestCheckNoPlaceholder.test_real_body_passes 117
method TestCheckNoPlaceholder.test_not_implemented_error 122
method TestCheckNoPlaceholder.test_other_raise_passes 128
class TestCheckErrorHandling 134
method TestCheckErrorHandling.test_bare_except 135
method TestCheckErrorHandling.test_specific_except_passes 141
class TestCheckNestingDepth 147
method TestCheckNestingDepth.test_shallow_nesting_passes 148
method TestCheckNestingDepth.test_deep_nesting_fails 153
class TestCheckGodObjects 168
method TestCheckGodObjects.test_short_file_passes 169
method TestCheckGodObjects.test_long_file_fails 174
method TestCheckGodObjects.test_many_public_methods_fails 180
method TestCheckGodObjects.test_private_methods_excluded 187
class TestCheckStubMethods 195
method TestCheckStubMethods.test_pass_only_is_stub 196
method TestCheckStubMethods.test_test_file_excluded 209
method TestCheckStubMethods.test_await_excludes_stub 217
method TestCheckStubMethods.test_external_call_excludes_stub 223
method TestCheckStubMethods.test_method_call_excludes_stub 229
class TestCheckSecurity 241
method TestCheckSecurity.test_eval_call 242
method TestCheckSecurity.test_exec_call 248
method TestCheckSecurity.test_hardcoded_secret 253
method TestCheckSecurity.test_secret_in_comment_ignored 259
method TestCheckSecurity.test_os_getenv_ignored 265
method TestCheckSecurity.test_api_key_pattern 271
class TestCheckTodoComments 278
method TestCheckTodoComments.test_todo_found 279
method TestCheckTodoComments.test_fixme_found 285
method TestCheckTodoComments.test_hack_found 290
method TestCheckTodoComments.test_xxx_found 295
method TestCheckTodoComments.test_code_line_ignored 300
class TestCheckNoMocks 306
method TestCheckNoMocks.test_mock_import 307
method TestCheckNoMocks.test_magic_mock 313
method TestCheckNoMocks.test_patch_decorator 318
method TestCheckNoMocks.test_monkeypatch 323
method TestCheckNoMocks.test_comment_ignored 328
class TestValidateCodeNoMocks 334
method TestValidateCodeNoMocks.test_detects_mock 335
class TestCheckLint 342
method TestCheckLint.test_lint_runs 343
class TestCheckTypeHints 356
method TestCheckTypeHints.test_missing_param_hint 357
method TestCheckTypeHints.test_missing_return_hint 362
method TestCheckTypeHints.test_private_func_ignored 367
method TestCheckTypeHints.test_public_method_params_checked 372
method TestCheckTypeHints.test_fully_annotated_passes 377
class TestCheckMutableDefaults 383
method TestCheckMutableDefaults.test_list_default 384
method TestCheckMutableDefaults.test_dict_default 390
method TestCheckMutableDefaults.test_set_literal_default 395
method TestCheckMutableDefaults.test_none_default_passes 400
class TestCheckDocstrings 406
method TestCheckDocstrings.test_missing_function_docstring 407
method TestCheckDocstrings.test_missing_class_docstring 413
method TestCheckDocstrings.test_private_ignored 419
method TestCheckDocstrings.test_present_docstring_passes 424
class TestCheckLineLength 430
method TestCheckLineLength.test_long_line 431
method TestCheckLineLength.test_url_ignored 437
method TestCheckLineLength.test_many_long_lines_truncated 442
class TestCheckImports 454
method TestCheckImports.test_relative_import 455
method TestCheckImports.test_out_of_order_import 461
method TestCheckImports.test_wrong_order 466
class TestCheckFileCompleteness 473
method TestCheckFileCompleteness.test_missing_module 474
method TestCheckFileCompleteness.test_existing_module 480
class TestBuildModuleCandidates 488
method TestBuildModuleCandidates.test_simple 489
method TestBuildModuleCandidates.test_dotted 494
class TestCheckEntryPoint 499
method TestCheckEntryPoint.test_main_file_missing_guard 500
method TestCheckEntryPoint.test_main_file_has_guard 506
method TestCheckEntryPoint.test_not_main_file 511
class TestCheckDependencyDeclaration 517
method TestCheckDependencyDeclaration.test_undeclared_dep 518
method TestCheckDependencyDeclaration.test_declared_dep_passes 524
method TestCheckDependencyDeclaration.test_stdlib_ignored 529
method TestCheckDependencyDeclaration.test_alias_resolved 534
method TestCheckDependencyDeclaration.test_no_declared_deps 539

tests/verification/test_review_helpers.py

source · 21 tests · 168 lines

Tests for review/helpers.py — real implementation.

Covers: verification.review.helpers

Kind Name Line Description
class TestIsPublic 36
method TestIsPublic.test_public 37
method TestIsPublic.test_private 41
class TestParseFile 46
method TestParseFile.test_valid_file 47
method TestParseFile.test_missing_file 53
method TestParseFile.test_syntax_error 57
class TestReadLines 64
method TestReadLines.test_valid_file 65
method TestReadLines.test_missing_file 71
class TestFunctionLineCount 76
method TestFunctionLineCount.test_simple 77
method TestFunctionLineCount.test_with_docstring 83
method TestFunctionLineCount.test_empty_body 89
method TestFunctionLineCount.test_only_docstring 95
class TestGetPyprojectDeps 102
method TestGetPyprojectDeps.test_extracts_deps 103
method TestGetPyprojectDeps.test_no_file 112
method TestGetPyprojectDeps.test_no_deps_section 116
class TestCollectImportedModules 123
method TestCollectImportedModules.test_import 124
method TestCollectImportedModules.test_from_import 132
method TestCollectImportedModules.test_relative_import_skipped 139
method TestCollectImportedModules.test_function_level_import_skipped 145
class TestReadWorkspaceFiles 152
method TestReadWorkspaceFiles.test_reads_file 153
method TestReadWorkspaceFiles.test_missing_file 160
method TestReadWorkspaceFiles.test_binary_file 164

tests/verification/test_rtm_constraints.py

source · 10 tests · 174 lines

Tests for orchestrata_ultimate.verification.rtm_constraints — SPEC-033

Covers: verification.rtm_constraints

Kind Name Line Description
function test_clean_rtm_has_no_violations 24
function test_untraced_requirement_enumerates_exact_id 34
function test_unproven_requirement_names_needed_class 43
function test_unproven_not_reported_when_any_trace_meets_the_minimum 56
function test_missing_proof_class_never_satisfies_a_minimum 69
function test_dangling_trace_names_the_unresolved_unit 84
function test_multiple_violations_all_returned_no_truncation 106 ADR-0026 regression: all_violations/1 must enumerate every
function test_check_rtm_rejects_unknown_proof_class 134
function test_check_rtm_rejects_unknown_min_class 145
function test_checks_do_not_leak_state_between_calls 156 Each check_rtm() call must retract the previous facts before

tests/verification/test_session_manager.py

source · 11 tests · 75 lines

Tests for verification/session/verification_session.py.

Covers: verification.session.verification_session, verification.types

Kind Name Line Description
class TestVerificationSessionManager 15
method TestVerificationSessionManager.test_create_session 16
method TestVerificationSessionManager.test_get_session 22
method TestVerificationSessionManager.test_get_session_missing 27
method TestVerificationSessionManager.test_increment_attempt 31
method TestVerificationSessionManager.test_increment_attempt_missing 37
method TestVerificationSessionManager.test_is_max_exceeded 41
method TestVerificationSessionManager.test_is_max_exceeded_missing 50
method TestVerificationSessionManager.test_update_results 54
method TestVerificationSessionManager.test_update_status 61
method TestVerificationSessionManager.test_list_sessions_empty 67
method TestVerificationSessionManager.test_session_count 71

tests/verification/test_small_modules.py

source · 80 tests · 624 lines

Covers: verification.agents.execution_agent, verification.agents.supervisor_agent, verification.agents.verification_agent, verification.autofix.engine, verification.autofix.helpers, verification.autofix.types, verification.checkpoints.concurrent, verification.checkpoints.definitions, verification.checkpoints.verifier, verification.config.verification_config, verification.constraints.definitions, verification.constraints.evaluator, verification.escalation_handler, verification.impossibility.handler, verification.orchestration.coordinator, verification.proofs.verifier, verification.protocols.verification_cxp, verification.requirements.constraint_definitions, verification.requirements.prolog_generator, verification.requirements.requirements_parser, verification.session.verification_session, verification.types, verification.verification.engine, verification.verification.feedback

Kind Name Line Description
class TestExecutionAgent 99
method TestExecutionAgent.test_init 100
method TestExecutionAgent.test_receive_constraints 104
method TestExecutionAgent.test_execute_step 110
method TestExecutionAgent.test_submit_for_verification 115
method TestExecutionAgent.test_receive_feedback 120
method TestExecutionAgent.test_get_artifacts_empty 125
class TestSupervisorAgent 130
method TestSupervisorAgent.test_init 131
method TestSupervisorAgent.test_review_work 135
method TestSupervisorAgent.test_generate_proof 140
method TestSupervisorAgent.test_submit_proof 147
class TestVerificationAgent 153
method TestVerificationAgent.test_init 154
method TestVerificationAgent.test_decide 158
method TestVerificationAgent.test_validate_proof 163
class TestAutofixResult 174
method TestAutofixResult.test_defaults 175
class TestWalkPythonFiles 181
method TestWalkPythonFiles.test_walks_python_files 182
method TestWalkPythonFiles.test_skips_venv 189
class TestRunAllAutofixes 196
method TestRunAllAutofixes.test_runs_on_empty_workspace 197
class TestCheckpointDefinitions 207
method TestCheckpointDefinitions.test_criteria_not_empty 208
method TestCheckpointDefinitions.test_get_checkpoint_predicates 211
method TestCheckpointDefinitions.test_get_next_checkpoint 215
method TestCheckpointDefinitions.test_get_next_checkpoint_last 219
class TestCheckpointVerifier 224
method TestCheckpointVerifier.test_init 225
method TestCheckpointVerifier.test_verify_checkpoint 229
method TestCheckpointVerifier.test_get_checkpoint_criteria 234
method TestCheckpointVerifier.test_transition_state 239
class TestConcurrentCheckpointEvaluator 250
method TestConcurrentCheckpointEvaluator.test_init 251
method TestConcurrentCheckpointEvaluator.test_evaluate_all 256
class TestModelConfig 269
method TestModelConfig.test_defaults 270
class TestVerificationConfig 276
method TestVerificationConfig.test_defaults 277
class TestConstraintDefinitions 287
method TestConstraintDefinitions.test_is_blocking_security 288
method TestConstraintDefinitions.test_is_blocking_high_priority 292
method TestConstraintDefinitions.test_is_not_blocking 298
method TestConstraintDefinitions.test_group_by_type 304
method TestConstraintDefinitions.test_sort_by_priority 310
method TestConstraintDefinitions.test_filter_by_type 316
class TestConstraintEvaluator 323
method TestConstraintEvaluator.test_init 324
method TestConstraintEvaluator.test_evaluate_single 328
method TestConstraintEvaluator.test_evaluate_all_empty 334
method TestConstraintEvaluator.test_evaluate_all 339
class TestEscalationHandler 352
method TestEscalationHandler.test_init 353
method TestEscalationHandler.test_should_escalate_false 357
method TestEscalationHandler.test_should_escalate_true 362
method TestEscalationHandler.test_escalate_to_human 367
method TestEscalationHandler.test_build_escalation_report 373
class TestImpossibilityHandler 385
method TestImpossibilityHandler.test_init 386
method TestImpossibilityHandler.test_detect_contradictions_none 390
method TestImpossibilityHandler.test_detect_contradictions_found 395
method TestImpossibilityHandler.test_detect_impossible_performance 414
method TestImpossibilityHandler.test_detect_impossible_quality 422
method TestImpossibilityHandler.test_detect_impossible_none 430
class TestVerificationCoordinator 444
method TestVerificationCoordinator.test_init 445
method TestVerificationCoordinator.test_start_workflow 449
method TestVerificationCoordinator.test_get_workflow_missing 455
method TestVerificationCoordinator.test_is_complete_missing 459
method TestVerificationCoordinator.test_workflow_count 463
class TestProofVerifier 473
method TestProofVerifier.test_init 474
method TestProofVerifier.test_verify_empty 478
class TestVerificationCXPAdapter 489
method TestVerificationCXPAdapter.test_init 490
class TestRequirementConstraints 500
method TestRequirementConstraints.test_not_empty 501
method TestRequirementConstraints.test_functional_not_empty 504
method TestRequirementConstraints.test_quality_not_empty 507
method TestRequirementConstraints.test_performance_not_empty 510
method TestRequirementConstraints.test_security_not_empty 513
method TestRequirementConstraints.test_get_constraints_by_type 516
method TestRequirementConstraints.test_get_constraint_by_id_found 520
method TestRequirementConstraints.test_get_constraint_by_id_missing 524
class TestPrologGenerator 529
method TestPrologGenerator.test_init 530
method TestPrologGenerator.test_generate 534
class TestRequirementsParser 541
method TestRequirementsParser.test_init 542
method TestRequirementsParser.test_parse_text 546
class TestVerificationSessionManager 564
method TestVerificationSessionManager.test_init 565
method TestVerificationSessionManager.test_create_session 569
method TestVerificationSessionManager.test_get_session 575
method TestVerificationSessionManager.test_increment_attempt 581
method TestVerificationSessionManager.test_is_max_exceeded 587
method TestVerificationSessionManager.test_list_sessions 592
class TestVerificationEngine 604
method TestVerificationEngine.test_init 605
method TestVerificationEngine.test_verify_session 609
class TestFeedbackGenerator 616
method TestFeedbackGenerator.test_init 617
method TestFeedbackGenerator.test_generate_feedback_empty 621

tests/verification/test_spec_completeness.py

source · 10 tests · 194 lines

Covers: verification.spec_completeness

Kind Name Line Description
function test_find_spec_checklist_no_spec_reference 42
function test_find_spec_checklist_with_spec_but_dir_missing 49
function test_parse_req_tuples_well_formed 62
function test_parse_req_tuples_empty_file 77
function test_evaluate_spec_completeness_no_spec_returns_empty 88
function test_evaluate_spec_completeness_with_real_spec 94 Create a real spec directory structure and evaluate against an empty
function test_run_prolog_evaluation_returns_dict 128
function test_an_implemented_requirement_is_actually_counted_as_implemented 139 The join key, pinned.
function test_an_unimplemented_requirement_is_still_reported_as_a_gap 161 Negative control for the test above: the join must not match
function test_repeated_evaluation_of_one_spec_does_not_inflate_its_totals 176 spec_requirement/3 and implemented/2 are dynamic and the

tests/verification/test_spec_completeness_extended.py

source · 22 tests · 496 lines

Covers: verification.spec_completeness

Kind Name Line Description
function test_find_spec_checklist_specs_dir_exists_no_digits 56 _SPECS_DIR exists but summary contains no 3-digit number.
function test_find_spec_checklist_specs_dir_exists_no_matching_dir 68 _SPECS_DIR exists and digits are found, but no dirname starts with
function test_find_spec_checklist_match_dir_but_no_checklist_file 82 Directory matches the spec number, but requirements.md is absent.
function test_find_spec_checklist_success 95 Happy path: matching directory and existing checklist file.
function test_find_spec_checklist_uses_first_three_digit_number 110 When multiple 3-digit numbers appear, the first is used.
function test_parse_req_tuples_no_matching_lines 130 Content exists but contains no REQ lines.
function test_parse_req_tuples_checked_and_unchecked 137 Both checked ([x]) and unchecked ([ ]) items are parsed.
function test_parse_req_tuples_whitespace_variations 149 Leading/trailing spaces and extra internal whitespace are handled.
function test_parse_req_tuples_description_with_special_chars 164 Descriptions containing quotes, commas and punctuation are preserved.
function test_parse_req_tuples_mixed_content 178 Only REQ lines are extracted from a larger markdown document.
function test_run_prolog_evaluation_dict_structure 204 Returns a dict with the expected keys even when no rules file is
function test_run_prolog_evaluation_with_requirement_facts 219 Prolog counts requirements and reports them as missing when no
function test_run_prolog_evaluation_with_impl_facts 233 Implementation facts are asserted and influence coverage counts.
function test_evaluate_spec_completeness_empty_requirements 255 Checklist file exists but contains no REQ lines → empty dict.
function test_evaluate_spec_completeness_project_dir_not_found 269 A valid spec is found but the project directory does not exist.
function test_evaluate_spec_completeness_prolog_all_implemented 288 Prolog reports 100%% coverage and no gaps.
function test_evaluate_spec_completeness_prolog_partial 322 Prolog reports partial coverage with gaps.
function test_evaluate_spec_completeness_prolog_zero_total 354 Prolog reports zero total requirements → coverage shows 0.0%%.
function test_evaluate_spec_completeness_prolog_enriches_gaps 383 Prolog returns an empty gap list but Python-side matching finds gaps;
function test_evaluate_spec_completeness_fallback_all_implemented 421 When Prolog is unavailable, Python fallback reports complete=True
function test_evaluate_spec_completeness_fallback_partial 446 Python fallback with partial implementation reports correct
function test_evaluate_spec_completeness_fallback_zero_implemented 474 Python fallback with empty project → 0%% coverage.

tests/verification/test_spec_completeness_js_evidence.py

source · 3 tests · 203 lines

Integration test: does the spec_completeness CONSUMER of the AST evidence

Covers: verification.implementation_scanner

Kind Name Line Description
function test_requirement_implemented_only_in_tsx_is_reported_implemented 97 A requirement whose ONLY implementation is a TSX class -- no Python
function test_same_requirement_is_still_a_gap_without_the_matching_tsx_symbol 133 Discriminating negative control for the test above.
function test_the_positive_verdict_actually_depends_on_the_js_ts_toolchain 163 The guard that makes the two tests above worth having.

tests/verification/test_supervisor_agent.py

source · 8 tests · 83 lines

Tests for verification supervisor agent.

Covers: verification.agents.supervisor_agent, verification.types

Kind Name Line Description
class TestSupervisorAgent 27 Tests for SupervisorAgent.
method TestSupervisorAgent.test_default_agent_id 30
method TestSupervisorAgent.test_custom_agent_id 34
method TestSupervisorAgent.test_review_work 38
method TestSupervisorAgent.test_review_work_no_artifacts 48
method TestSupervisorAgent.test_review_work_multiple 54
method TestSupervisorAgent.test_generate_proof_default_type 60
method TestSupervisorAgent.test_generate_proof_custom_type 69
method TestSupervisorAgent.test_submit_proof 77

tests/verification/test_traceability.py

source · 46 tests · 438 lines

Tests for traceability module — real implementation.

Covers: verification.traceability

Kind Name Line Description
class TestValidateReqId 50
method TestValidateReqId.test_valid_req 51
method TestValidateReqId.test_valid_us 55
method TestValidateReqId.test_invalid 59
class TestTracesDecorator 64
method TestTracesDecorator.test_decorates_class 65
method TestTracesDecorator.test_decorates_function 74
method TestTracesDecorator.test_invalid_req_raises 81
method TestTracesDecorator.test_empty_reqs_raises 85
method TestTracesDecorator.test_stacking 89
class TestExtractHelpers 100
method TestExtractHelpers.test_extract_string_value 101
method TestExtractHelpers.test_extract_string_value_not_string 105
method TestExtractHelpers.test_extract_list_values 109
method TestExtractHelpers.test_extract_list_values_mixed 113
method TestExtractHelpers.test_extract_list_values_not_list 117
method TestExtractHelpers.test_extract_traces_from_decorator 121
method TestExtractHelpers.test_extract_traces_not_traces 132
class TestFilePathToModule 142
method TestFilePathToModule.test_simple 143
method TestFilePathToModule.test_outside_root 147
class TestIsMethod 153
method TestIsMethod.test_method 154
method TestIsMethod.test_function 162
class TestScanTraces 169
method TestScanTraces.test_scan_empty_dir 170
method TestScanTraces.test_scan_with_traces 174
method TestScanTraces.test_scan_skips_pycache 189
method TestScanTraces.test_scan_skips_pycache_with_py_file 197
class TestValidateTraces 211
method TestValidateTraces.test_all_verified 212
method TestValidateTraces.test_missing 222
method TestValidateTraces.test_orphan 230
method TestValidateTraces.test_duplicates 237
method TestValidateTraces.test_empty 246
class TestGenerateRTM 251
method TestGenerateRTM.test_basic 252
class TestSaveRTM 273
method TestSaveRTM.test_saves_files 274
class TestDataClasses 288
method TestDataClasses.test_trace_info_to_dict 289
method TestDataClasses.test_user_story_to_dict 295
method TestDataClasses.test_validation_report_metrics 300
method TestDataClasses.test_validation_report_empty 307
method TestDataClasses.test_rtm_report_to_dict 311
class TestExtractTracesFromDecoratorEdgeCases 317
method TestExtractTracesFromDecoratorEdgeCases.test_non_traces_decorator_returns_none 318
method TestExtractTracesFromDecoratorEdgeCases.test_module_qualified_traces_decorator 327
class TestScanTracesEdgeCases 340
method TestScanTracesEdgeCases.test_scan_nonexistent_dir_returns_empty 341
method TestScanTracesEdgeCases.test_scan_skips_files_with_syntax_error 345
method TestScanTracesEdgeCases.test_scan_skips_files_with_unicode_decode_error 351
method TestScanTracesEdgeCases.test_scan_finds_module_level_function 357
class TestValidateTracesLocationFallback 371
method TestValidateTracesLocationFallback.test_location_fallback_to_module 372
class TestRenderRTMMarkdownEdgeCases 382
method TestRenderRTMMarkdownEdgeCases.test_render_with_missing_requirements 383
method TestRenderRTMMarkdownEdgeCases.test_render_with_orphan_traces 396
method TestRenderRTMMarkdownEdgeCases.test_render_with_empty_validation 409
method TestRenderRTMMarkdownEdgeCases.test_render_truncates_src_path 420

tests/verification/test_types.py

source · 30 tests · 257 lines

Tests for verification.types — real implementations, no mocks.

Covers: verification.types

Kind Name Line Description
class TestConstraintType 23
method TestConstraintType.test_values 24
class TestVerificationStatus 31
method TestVerificationStatus.test_values 32
class TestCheckpointName 40
method TestCheckpointName.test_values 41
class TestProofType 46
method TestProofType.test_values 47
class TestSessionStatus 52
method TestSessionStatus.test_values 53
class TestConstraint 60
method TestConstraint.test_default_creation 61
method TestConstraint.test_to_dict 68
method TestConstraint.test_from_dict 85
class TestVerificationResult 101
method TestVerificationResult.test_is_satisfied_true 102
method TestVerificationResult.test_is_satisfied_false 106
method TestVerificationResult.test_to_dict 110
class TestProof 123
method TestProof.test_default_creation 124
method TestProof.test_to_dict 129
class TestProofResult 144
method TestProofResult.test_default 145
class TestCheckpointResult 151
method TestCheckpointResult.test_pass_rate_zero 152
method TestCheckpointResult.test_pass_rate_half 156
method TestCheckpointResult.test_pass_rate_full 160
class TestSuggestion 165
method TestSuggestion.test_creation 166
class TestFeedback 172
method TestFeedback.test_default 173
class TestVerificationSession 179
method TestVerificationSession.test_default 180
method TestVerificationSession.test_is_complete_completed 187
method TestVerificationSession.test_is_complete_failed 191
method TestVerificationSession.test_max_exceeded 195
method TestVerificationSession.test_max_not_exceeded 199
method TestVerificationSession.test_to_dict 203
class TestEscalationMessage 218
method TestEscalationMessage.test_creation 219
class TestEdgeCase 227
method TestEdgeCase.test_default 228
method TestEdgeCase.test_creation 233
class TestModelCapability 246
method TestModelCapability.test_default 247
method TestModelCapability.test_custom 253

tests/verification/test_verification_agents.py

source · 26 tests · 267 lines

Tests for verification agents — real implementations, no mocks.

Covers: verification.agents.execution_agent, verification.agents.supervisor_agent, verification.agents.verification_agent, verification.constraints.evaluator, verification.proofs.verifier, verification.types

Kind Name Line Description
class TestExecutionAgent 65
method TestExecutionAgent.test_init_defaults 66
method TestExecutionAgent.test_init_custom_id 73
method TestExecutionAgent.test_receive_constraints 77
method TestExecutionAgent.test_execute_step 83
method TestExecutionAgent.test_execute_step_multiple_checkpoints 93
method TestExecutionAgent.test_submit_for_verification 99
method TestExecutionAgent.test_submit_for_verification_missing 107
method TestExecutionAgent.test_receive_feedback 112
class TestSupervisorAgent 119
method TestSupervisorAgent.test_init_defaults 120
method TestSupervisorAgent.test_review_work 125
method TestSupervisorAgent.test_review_work_no_artifacts 135
method TestSupervisorAgent.test_generate_proof_default_type 140
method TestSupervisorAgent.test_generate_proof_with_context 148
method TestSupervisorAgent.test_submit_proof 154
class TestVerificationAgent 163
method TestVerificationAgent.test_init_defaults 164
method TestVerificationAgent.test_init_custom 169
method TestVerificationAgent.test_check_via_prolog 175
method TestVerificationAgent.test_analyze_via_llm_no_llm 183
method TestVerificationAgent.test_analyze_via_llm_with_llm 191
method TestVerificationAgent.test_analyze_via_llm_failure 199
method TestVerificationAgent.test_decide_all_satisfied 207
method TestVerificationAgent.test_decide_partial 221
method TestVerificationAgent.test_decide_empty 232
method TestVerificationAgent.test_decide_with_llm_analysis 239
method TestVerificationAgent.test_validate_proof 248
method TestVerificationAgent.test_validate_proof_exhaustive 259

tests/verification/test_verification_config.py

source · 3 tests · 69 lines

Tests for config/verification_config.py — real implementation.

Covers: verification.config.verification_config

Kind Name Line Description
class TestModelConfig 29
method TestModelConfig.test_defaults 30
class TestVerificationConfig 39 The Redis endpoint comes from the environment, never from this test.
method TestVerificationConfig.test_defaults 52
method TestVerificationConfig.test_default_classmethod 65

tests/verification/test_verification_coordinator.py

source · 11 tests · 108 lines

Tests for VerificationCoordinator — real implementation.

Covers: verification.orchestration.coordinator, verification.types

Kind Name Line Description
class TestVerificationCoordinator 30
method TestVerificationCoordinator.test_init_defaults 31
method TestVerificationCoordinator.test_init_custom 36
method TestVerificationCoordinator.test_start_workflow 40
method TestVerificationCoordinator.test_get_workflow 50
method TestVerificationCoordinator.test_get_workflow_missing 58
method TestVerificationCoordinator.test_advance_step 62
method TestVerificationCoordinator.test_advance_step_all_steps 72
method TestVerificationCoordinator.test_advance_step_missing 88
method TestVerificationCoordinator.test_is_complete_false 92
method TestVerificationCoordinator.test_is_complete_missing 98
method TestVerificationCoordinator.test_multiple_workflows 102

tests/verification/test_verification_cxp_adapter.py

source · 11 tests · 126 lines

Tests for VerificationCXPAdapter — real implementation.

Covers: verification.protocols.verification_cxp, verification.types

Kind Name Line Description
class TestVerificationCXPAdapter 34
method TestVerificationCXPAdapter.test_create_constraint_message 35
method TestVerificationCXPAdapter.test_create_constraint_message_custom_agents 45
method TestVerificationCXPAdapter.test_create_verification_request 51
method TestVerificationCXPAdapter.test_create_verification_result 60
method TestVerificationCXPAdapter.test_create_verification_result_not_satisfied 70
method TestVerificationCXPAdapter.test_create_escalation_message 78
method TestVerificationCXPAdapter.test_create_feedback_message 90
method TestVerificationCXPAdapter.test_create_proof_request 96
method TestVerificationCXPAdapter.test_create_proof_submission 102
method TestVerificationCXPAdapter.test_parse_message 109
method TestVerificationCXPAdapter.test_parse_message_defaults 122

tests/verification/test_verification_engine.py

source · 9 tests · 110 lines

Tests for VerificationEngine — real implementation.

Covers: verification.constraints.evaluator, verification.types, verification.verification.engine

Kind Name Line Description
class TestVerificationEngine 33
method TestVerificationEngine.test_init_defaults 34
method TestVerificationEngine.test_init_custom 39
method TestVerificationEngine.test_verify_empty_session 44
method TestVerificationEngine.test_verify_with_constraints 51
method TestVerificationEngine.test_verify_all_satisfied 61
method TestVerificationEngine.test_verify_not_satisfied 72
method TestVerificationEngine.test_verify_complete_session 84
method TestVerificationEngine.test_generate_feedback 92
method TestVerificationEngine.test_generate_feedback_empty 106

tests/verification/test_verification_models.py

source · 19 tests · 163 lines

Tests for verification model wrappers — real implementations.

Covers: verification.models.deepseek_r1, verification.models.grok4_minimax, verification.models.opus, verification.models.qwen_max

Kind Name Line Description
class TestGrokMiniMaxModel 30
method TestGrokMiniMaxModel.test_init_defaults 31
method TestGrokMiniMaxModel.test_init_custom 37
method TestGrokMiniMaxModel.test_capabilities 42
method TestGrokMiniMaxModel.test_verify 51
method TestGrokMiniMaxModel.test_analyze 59
method TestGrokMiniMaxModel.test_generate_proof 72
class TestDeepseekR1Model 80
method TestDeepseekR1Model.test_init_defaults 81
method TestDeepseekR1Model.test_capabilities 86
method TestDeepseekR1Model.test_verify 94
method TestDeepseekR1Model.test_generate_proof 101
class TestClaudeOpusModel 107
method TestClaudeOpusModel.test_init_defaults 108
method TestClaudeOpusModel.test_capabilities 113
method TestClaudeOpusModel.test_verify 121
method TestClaudeOpusModel.test_generate_proof 127
class TestQwenMaxModel 133
method TestQwenMaxModel.test_init_defaults 134
method TestQwenMaxModel.test_capabilities 139
method TestQwenMaxModel.test_verify 147
method TestQwenMaxModel.test_generate_proof 153
method TestQwenMaxModel.test_analyze_empty 159

Support files

Fixtures, package markers and helpers without test functions.