Orchestrata Ultimate / RTM / 031-qa-volk
RTM: 031-qa-volk
Requirement to symbol to test rows for 031-qa-volk: QA Volk (U:Qa).
At a glance
| Item | Value |
|---|---|
| Requirement IDs | 55 |
Traced from src/ |
42 (76.4%) |
| Untraced | 13 |
Cited from tests/ |
6 (10.9%) |
Traced in src/ but not cited from tests/ |
36 |
Reading this matrix
This matrix lists each of the 55 requirement IDs of spec 031-qa-volk with the src/ symbols that cite it and the tests that cite it. 42 of them (76.4%) have at least one citing symbol and 13 have none.
6 requirements are also cited from tests/, and 36 are traced in code but never named by a test. A test citation is a @traces on a test function; it shows intent to cover, not that the test runs or reaches the symbol.
Rows showing none in the symbols column are the gaps to close first. The densest untraced groups are REQ-031-* (13).
Requirement to symbols to tests
| Requirement | Symbols in src/ |
Tests citing it |
|---|---|---|
REQ-031-001 _autofix_aioredis() rewrites import aioredis to import redis.asyncio as aioredis |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_aioredis L82orchestrata_ultimate/verification/autofix/redis_fixes _replace_aioredis_imports L43orchestrata_ultimate/verification/autofix/redis_fixes autofix_aioredis L19 |
none |
REQ-031-002 _autofix_aioredis() rewrites aioredis.from_url() to redis.asyncio.from_url() |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_aioredis L82orchestrata_ultimate/verification/autofix/redis_fixes _replace_aioredis_usage L61orchestrata_ultimate/verification/autofix/redis_fixes autofix_aioredis L19 |
none |
REQ-031-003 _autofix_sync_redis() rewrites synchronous redis.Redis() to... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_sync_redis L154orchestrata_ultimate/agents/volks/qa/_autofix transform L168orchestrata_ultimate/verification/autofix/redis_fixes _apply_sync_redis_fix L108+1 more |
none |
REQ-031-004 _autofix_f821_datetime() adds from datetime import datetime, timedelta when... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_f821_datetime L217orchestrata_ultimate/agents/volks/qa/_autofix transform L230orchestrata_ultimate/verification/autofix/format_fixes _add_datetime_import L134+2 more |
none |
REQ-031-005 _autofix_missing_stdlib_imports() detects missing stdlib imports by scanning for... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_missing_stdlib_imports L447orchestrata_ultimate/agents/volks/qa/_autofix transform L471orchestrata_ultimate/verification/autofix/import_fixes _add_stdlib_imports L168+1 more |
none |
REQ-031-006 _autofix_missing_barename_imports() adds missing third-party imports for known... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_missing_barename_imports L507orchestrata_ultimate/agents/volks/qa/_autofix transform L570orchestrata_ultimate/verification/autofix/import_fixes _add_barename_imports L219+2 more |
none |
REQ-031-007 _autofix_xadd_dict() serializes nested dict values in xadd calls using... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_xadd_dict L281orchestrata_ultimate/verification/autofix/redis_fixes autofix_xadd_dict L219 |
none |
REQ-031-008 _autofix_hset_dict() rewrites hset(name, mapping={...}) values to JSON-serialized... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_hset_dict L336orchestrata_ultimate/verification/autofix/redis_fixes autofix_hset_dict L251 |
none |
REQ-031-009 _autofix_redis_decode() adds decode_responses=True to Redis client constructors... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_redis_decode L395orchestrata_ultimate/verification/autofix/redis_fixes autofix_redis_decode L135 |
none |
REQ-031-010 _autofix_redis_host() replaces hardcoded "localhost" in Redis constructors with... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_redis_host L623orchestrata_ultimate/agents/volks/qa/_autofix _collect_test_files L658orchestrata_ultimate/agents/volks/qa/_autofix _replace_redis_host_in_content L681+2 more |
none |
REQ-031-011 _autofix_relative_imports() rewrites from .module import X to absolute import paths |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_relative_imports L714orchestrata_ultimate/agents/volks/qa/_autofix _detect_package_name L764orchestrata_ultimate/verification/autofix/import_fixes _detect_flat_package L97+2 more |
none |
REQ-031-012 _autofix_line_length() splits lines exceeding 80 characters at logical boundaries... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_line_length L792orchestrata_ultimate/verification/autofix/engine _run_tool_fixes L76orchestrata_ultimate/verification/autofix/format_fixes autofix_line_length L25 |
none |
REQ-031-013 _autofix_import_order() reorders imports to: stdlib first, third-party second, local... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_import_order L821orchestrata_ultimate/verification/autofix/engine _run_tool_fixes L76orchestrata_ultimate/verification/autofix/import_fixes autofix_import_order L122 |
none |
REQ-031-014 _autofix_unused_imports() removes import statements for names that are never... |
orchestrata_ultimate/agents/volks/qa/_autofix _autofix_unused_imports L850 |
none |
REQ-031-015 All 13 auto-fixers operate on all .py files in self.workspace |
orchestrata_ultimate/agents/volks/qa/_autofix _apply_py_file_fix L47orchestrata_ultimate/agents/volks/qa/_autofix _iter_workspace_py_files L29orchestrata_ultimate/agents/volks/qa/volk _run_autofix_pass L522+8 more |
none |
REQ-031-016 Auto-fix pass runs before Gate 1 (Syntax) on every cycle, including test-fix return cycles |
orchestrata_ultimate/agents/volks/qa/volk _handle_review L274orchestrata_ultimate/agents/volks/qa/volk _run_autofix_pass L522 |
none |
REQ-031-017 review_gate_syntax() (from review_checks.py) compiles every .py file in... |
orchestrata_ultimate/agents/volks/codedirector/review_checks review_gate_syntax L1339 |
none |
REQ-031-018 review_gate_syntax() returns a list of (code, filepath, description) tuples for... |
orchestrata_ultimate/agents/volks/codedirector/review_checks review_gate_syntax L1339 |
none |
REQ-031-019 Gate 1 failure immediately calls _bounce_for_fix() with label "GATE 1 FAIL: Syntax... |
orchestrata_ultimate/agents/volks/qa/volk _run_review_gate L543 |
none |
REQ-031-020 Gate 1 failure skips Gate 2, Gate 3, and all subsequent pipeline phases |
orchestrata_ultimate/agents/volks/qa/volk _handle_review L274 |
none |
REQ-031-021 review_gate_lint() (from review_checks.py) runs flake8 with critical error codes on... |
orchestrata_ultimate/agents/volks/codedirector/review_checks check_lint L848orchestrata_ultimate/agents/volks/codedirector/review_checks review_gate_lint L1381 |
none |
REQ-031-022 Gate 2 targets E9xx (syntax at runtime) and F8xx (undefined names, unused imports)... |
none | none |
REQ-031-023 Gate 2 failure calls _bounce_for_fix() with label "GATE 2 FAIL: Lint/style errors" |
orchestrata_ultimate/agents/volks/qa/volk _run_review_gate L543 |
none |
REQ-031-024 Gate 2 failure skips Gate 3 and all subsequent pipeline phases |
orchestrata_ultimate/agents/volks/qa/volk _handle_review L274 |
none |
REQ-031-025 review_gate_checklist() (from review_checks.py) runs deterministic structural checks... |
orchestrata_ultimate/agents/volks/codedirector/review_checks review_gate_checklist L1429 |
none |
REQ-031-026 Checklist gate verifies: traceability decorators present, import order correct, public... |
orchestrata_ultimate/agents/volks/codedirector/review_checks check_docstrings L529orchestrata_ultimate/agents/volks/codedirector/review_checks check_imports L181orchestrata_ultimate/agents/volks/codedirector/review_checks check_traceability L1049+1 more |
none |
REQ-031-027 Gate 3 failure calls _bounce_for_fix() with label "GATE 3 FAIL: Checklist violations" |
orchestrata_ultimate/agents/volks/qa/volk _run_review_gate L543 |
none |
REQ-031-028 get_fix_instructions() converts issue tuples to a structured, human-readable fix prompt |
orchestrata_ultimate/agents/volks/codedirector/review_checks get_fix_instructions L1617 |
none |
REQ-031-029 All three gates log status to stdout: " [U:Qa] Gate N/3: Syntax/Lint/Checklist..."... |
orchestrata_ultimate/agents/volks/qa/volk _run_review_gate L543 |
none |
REQ-031-030 When all three gates return empty lists, the pipeline proceeds to import validation |
orchestrata_ultimate/agents/volks/qa/volk _bounce_for_import_errors L588orchestrata_ultimate/agents/volks/qa/volk _handle_review L274 |
none |
REQ-031-031 CODE_REVIEW_PROMPT contains exactly 31 numbered checklist items covering all specified... |
none | none |
REQ-031-032 Items 1-6 cover Correctness: IMPORTS, NO_MOCKING, API_CORRECTNESS, FILE_COMPLETENESS,... |
none | none |
REQ-031-033 Items 7-9 cover Design: DESIGN, COMPLEXITY, NO_DUPLICATION |
none | none |
REQ-031-034 Items 10-12 cover Functions: FUNCTION_LENGTH, FUNCTION_ARGS, NO_PLACEHOLDER |
none | none |
REQ-031-035 Items 13-14 cover Error Handling: ERROR_HANDLING, EXCEPTIONS |
none | none |
REQ-031-036 Items 15-20 cover: RESOURCE_MANAGEMENT, NAMING, TYPE_HINTS, DEFAULT_VALUES,... |
none | none |
REQ-031-037 Items 21-29 cover Style and Python Best Practices: LINE_LENGTH, FORMATTING, STRINGS,... |
none | none |
REQ-031-038 Items 30-31 cover SECURITY and TESTS |
none | none |
REQ-031-039 LLM review call uses temperature=0.0, volk="U:Qa", and injects self._graph_context |
orchestrata_ultimate/agents/volks/qa/volk _run_llm_code_review L415 |
tests/agents/volks/qa/test_llm_review.py::test_llm_review_forwards_prompt_temperature_and_graph_context |
REQ-031-040 _parse_review_verdict() extracts "PASS" or "FAIL" from the REVIEW_VERDICT: line in... |
orchestrata_ultimate/agents/volks/qa/volk _parse_review_verdict L1097orchestrata_ultimate/agents/volks/qa/volk _run_llm_code_review L415 |
tests/agents/volks/qa/test_llm_review.py::test_llm_review_pass_returns_none |
REQ-031-041 _parse_review_issues() extracts actionable issues from the ISSUES: block when... |
orchestrata_ultimate/agents/volks/qa/volk _parse_review_issues L1118orchestrata_ultimate/agents/volks/qa/volk _run_llm_code_review L415 |
tests/agents/volks/qa/test_llm_review.py::test_llm_review_fail_bounces_to_cdtests/agents/volks/qa/test_llm_review.py::test_llm_review_fail_without_issues_still_bounces |
REQ-031-042 FAIL verdict triggers _bounce_for_fix() to U:Cd with parsed issues |
orchestrata_ultimate/agents/volks/qa/volk _run_llm_code_review L415 |
tests/agents/volks/qa/test_llm_review.py::test_handle_review_fail_bounces_instead_of_test_gentests/agents/volks/qa/test_llm_review.py::test_llm_review_fail_bounces_to_cd |
REQ-031-043 Review runs on every cycle, including when packet carries from_test_fix=True (G226) |
orchestrata_ultimate/agents/volks/qa/volk _handle_review L274orchestrata_ultimate/agents/volks/qa/volk _run_llm_code_review L415 |
tests/agents/volks/qa/test_llm_review.py::test_handle_review_runs_llm_review_before_test_fix_rerun |
REQ-031-044 QA_SYSTEM_PROMPT forbids unittest.mock, MagicMock, patch, AsyncMock, Mock imports |
none | none |
REQ-031-045 QA_SYSTEM_PROMPT forbids custom Mock/Fake/Stub/Dummy classes |
none | none |
REQ-031-046 QA_SYSTEM_PROMPT requires pytest framework (no unittest.TestCase) |
none | none |
REQ-031-047 QA_SYSTEM_PROMPT forbids asyncio.Awaitable and asyncio.Coroutine; requires... |
none | none |
REQ-031-048 QA_SYSTEM_PROMPT requires @traces decorator on every test function |
orchestrata_ultimate/agents/volks/qa/volk _build_trace_section L716 |
none |
REQ-031-049 Test prompt includes 6-phase structure: Analyze, Plan, Infrastructure Rules, Source... |
orchestrata_ultimate/agents/volks/qa/volk _build_import_section L694orchestrata_ultimate/agents/volks/qa/volk _handle_test_gen L747 |
none |
REQ-031-050 Generated tests use real Redis with the host from... |
orchestrata_ultimate/agents/volks/codedirector/review_checks check_real_infrastructure L758orchestrata_ultimate/agents/volks/qa/volk _handle_test_gen L747 |
none |
REQ-031-051 _extract_and_write_tests() parses TEST_FILE blocks from LLM response and writes to... |
orchestrata_ultimate/agents/volks/qa/_testgen _extract_and_write_tests L28orchestrata_ultimate/agents/volks/qa/_testgen _extract_code_block L65 |
none |
REQ-031-052 _validate_no_mocks() scans written test files for forbidden mock patterns |
orchestrata_ultimate/agents/volks/qa/_testgen _finalize_test_code L81orchestrata_ultimate/agents/volks/qa/_testgen _mock_gate L356orchestrata_ultimate/agents/volks/qa/_testgen _validate_no_mocks L121 |
none |
REQ-031-053 _retry_without_mocks() re-runs LLM generation with anti-mock instruction when mock... |
orchestrata_ultimate/agents/volks/qa/_testgen _finalize_test_code L81orchestrata_ultimate/agents/volks/qa/_testgen _mock_gate L356orchestrata_ultimate/agents/volks/qa/_testgen _retry_without_mocks L136 |
tests/agents/volks/qa/test_testgen.py::test_retry_without_mocks_forwards_temperature_volk_and_graph_contexttests/agents/volks/qa/test_testgen.py::test_retry_without_mocks_llm_exception_returns_none |
REQ-031-054 Each test file is capped at MAX 120 lines; longer output is split across multiple files |
orchestrata_ultimate/agents/volks/qa/volk _handle_test_gen L747 |
none |
REQ-031-055 _run_tests() executes pytest in self.workspace using workspace venv Python and... |
orchestrata_ultimate/agents/volks/qa/_testgen _build_pytest_command L445orchestrata_ultimate/agents/volks/qa/_testgen _build_test_env L487orchestrata_ultimate/agents/volks/qa/_testgen _import_gate L394+7 more |
none |