Orchestrata Ultimate › Tests › Reference › orchestrator › test_verification_gate
Tests reference — tests/orchestrator/test_verification_gate.py
Module of tests/orchestrator, split out because the directory page would be too large.
Prose pending.
tests/orchestrator/test_verification_gate.py
source · 38 tests · 913 lines
Tests for orchestrata_ultimate.orchestrator.verification_gate — the
Covers: core.base.traces, orchestrator.artifact_store, orchestrator.pipeline_router, orchestrator.pipeline_runner, orchestrator.verification_gate, verification.checkpoints.definitions, verification.escalation_handler, verification.integrations.intent_broker, verification.integrations.redis_manager, verification.orchestration.coordinator, verification.types, verification.verification.engine, core.packet/ (package)
| Kind | Name | Line | Description |
|---|---|---|---|
| function | test_gate_config_from_env_defaults_audit_only |
79 | Default env yields enabled + audit-only + the spec's 5-attempt cap; |
| function | test_worktype_constraint_source_total_over_worktypes |
101 | constraints_for is a TOTAL mapping: every WorkType member gets a |
| function | test_constraint_source_delegates_to_intent_broker_adapter |
120 | WorkTypeConstraintSource composes IntentBrokerAdapter rather than |
| function | test_artifact_context_builder_computes_actuals |
136 | file_exists/code_compiles reflect real ast.parse of CODE artifacts; |
| function | test_artifact_context_builder_flags_hardcoded_secret |
166 | A hardcoded-looking secret in a CODE artifact flips |
| function | test_artifact_context_builder_documentation_and_qa_payload |
191 | documentation_complete comes from a DOC_OUTPUT artifact; QA payload |
| function | test_open_session_creates_session_and_workflow |
229 | |
| function | test_open_session_returns_none_when_disabled |
239 | |
| function | test_checkpoint_for_mapping_is_exact |
250 | |
| function | test_after_stage_maps_capability_to_checkpoint_and_verifies |
277 | |
| function | test_after_stage_returns_none_for_pre_solution_capability |
293 | |
| function | test_finalize_not_met_increments_attempt_and_generates_feedback |
307 | |
| function | test_finalize_all_satisfied_completes_session |
328 | |
| function | test_max_attempts_escalates_via_escalation_handler |
356 | |
| function | test_finalize_returns_none_when_session_missing |
375 | |
| function | test_verdict_packet_built_via_coordinator_cxp |
383 | finalize() genuinely drives the composed VerificationCoordinator -> |
| function | test_session_state_persisted_to_redis |
418 | |
| function | test_pipeline_runner_default_constructs_gate_nonfatally |
439 | PipelineRunner() always has a .verification_gate; a hostile env |
| function | test_pipeline_run_audit_mode_records_but_never_fails |
456 | Audit-only (the default) computes and attaches a verdict but never |
| function | test_pipeline_run_enforce_mode_escalates_on_exhausted_verification |
496 | VERIFY_ENFORCE-equivalent config (enforce=True, max_attempts=1) with |
| function | test_production_seam_pipeline_kernel_gate_active |
544 | PipelineKernelClient._run_pipeline (the SPEC-003 US-004 |
| function | test_gate_config_from_env_invalid_max_attempts_falls_back |
611 | |
| function | test_worktype_constraint_source_unknown_worktype_falls_back_to_feature |
617 | |
| function | test_artifact_context_builder_secrets_clean_swallows_check_security_failure |
626 | A deliberately wrong-typed tree (not a real ast.Module) makes the |
| function | test_open_session_returns_none_when_constraint_source_raises |
646 | |
| function | test_after_stage_returns_none_when_session_not_found |
654 | |
| function | test_after_stage_returns_none_when_disabled |
662 | |
| function | test_after_stage_returns_none_when_engine_raises |
672 | |
| function | test_finalize_returns_none_when_disabled |
682 | |
| function | test_finalize_returns_none_when_engine_raises |
691 | |
| function | test_finalize_escalation_handling_failure_is_nonfatal |
703 | |
| function | test_finalize_cxp_build_failure_is_nonfatal |
722 | |
| function | test_persist_noop_when_session_missing |
745 | |
| function | test_persist_swallows_redis_save_failure |
751 | |
| function | test_pipeline_run_survives_verification_gate_open_session_raising |
780 | |
| function | test_after_stage_advances_the_workflow_off_constraint_evaluation |
814 | The first verified checkpoint moves the CXP-visible workflow forward. |
| function | test_after_stage_does_not_advance_once_per_stage |
844 | after_stage runs per STAGE; the workflow has one checkpoint PHASE. |
| function | test_finalize_completes_and_evicts_the_workflow |
881 | The run is over, so the workflow is finished AND dropped. |