orchestrata_volks.harness.evaluators
Reference › components › volks › orchestrata_volks › harness › evaluators
Evaluator registry for the Volk Test Harness.
The evaluator registry of the harness. base defines the evaluator base, and the evaluators are file_exists (checks files), lint, syntax, trace (checks traceability) and llm_judge (an LLM scores the output).
7 modules, 710 lines of code.
Modules
| Module | Summary | LOC | Lifted from |
|---|---|---|---|
__init__ |
Evaluator registry for the Volk Test Harness. | 78 | lifted from orchestrata_ultimate.harness.evaluators |
base |
Base evaluator module for the Volk Test Harness. | 7 | lifted from orchestrata_ultimate.harness.evaluators.base |
file_exists |
Class placement of frozen harness.evaluators.file_exists (AD-77). |
63 | lifted from orchestrata_ultimate.harness.evaluators.file_exists |
lint |
Class placement of frozen harness.evaluators.lint (AD-77). |
175 | lifted from orchestrata_ultimate.harness.evaluators.lint |
llm_judge |
Class placement of frozen harness.evaluators.llm_judge (AD-77). |
141 | lifted from orchestrata_ultimate.harness.evaluators.llm_judge |
syntax |
Class placement of frozen harness.evaluators.syntax (AD-77). |
126 | lifted from orchestrata_ultimate.harness.evaluators.syntax |
trace |
Class placement of frozen harness.evaluators.trace (AD-77). |
120 | lifted from orchestrata_ultimate.harness.evaluators.trace |
Dependency diagram
