Orchestrata Ultimate › Tests › Reference › orchestrator › test_intent_grammar_accuracy

Tests reference — tests/orchestrator/test_intent_grammar_accuracy.py

Module of tests/orchestrator, split out because the directory page would be too large.

Prose pending.

tests/orchestrator/test_intent_grammar_accuracy.py

source · 14 tests · 429 lines

Test Standards Compliance (see AGENTS.md § Test Standards):

Covers: core.base.traces, core.paths, infra.prolog_bridge, orchestrator.intent_types, orchestrator.intent_vocabulary, orchestrator.pipeline_router

Kind Name Line Description
function test_lexicon_has_no_cross_category_stem_collisions 103 Two keywords in different categories that share a Porter stem make
function test_inflected_forms_reach_the_grammar_tier 147
function test_decisive_word_outranks_generic_verb 185
function test_work_type_is_resolved_by_majority_vote 218 REQ-003-US-001-065. Measured across the three corpora: leftmost 22/76,
function test_generic_verbs_stay_in_the_scoring_tier_registries 234 The generic-verb map changes GRAMMAR precedence only. A generic verb
function test_generic_verbs_round_trip_through_dict 250
function test_generic_verb_defaults_are_real_work_types 259
function test_every_work_type_has_keywords 271
function test_every_target_has_keywords 281
function test_the_four_measured_misleading_keywords_stay_out 291 memory, trace, integration and version each name a SUBSYSTEM
function test_grammar_accuracy_on_labelled_corpus 313 The regression floor. Written alongside the vocabulary, so its score
function test_grammar_accuracy_on_heldout_corpus 355 The generalization estimate. These sentences were written after the
function test_grammar_accuracy_on_raw_user_turns 384 The production-input benchmark: verbatim user turns, typos and all.
function test_every_raw_turn_carries_a_label_and_verbatim_text 415 The corpus is only worth its floor if the text is untouched. A