Orchestrata Ultimate › Tests › Reference › scripts › test_evaluate_semantic_graph_qa
Tests reference — tests/scripts/test_evaluate_semantic_graph_qa.py
Module of tests/scripts, split out because the directory page would be too large.
Prose pending.
tests/scripts/test_evaluate_semantic_graph_qa.py
source · 11 tests · 325 lines
Tests for scripts/evaluate_semantic_graph_qa.py — the 100-question
| Kind | Name | Line | Description |
|---|---|---|---|
| function | test_parse_questions_extracts_number_category_and_question |
156 | |
| function | test_parse_questions_defaults_category_to_general |
175 | |
| function | test_parse_questions_skips_blank_and_non_numbered_lines |
182 | |
| function | test_parse_questions_deduplicates_and_caps_keywords_at_eight |
195 | |
| function | test_parse_questions_stopword_only_question_has_no_keywords |
210 | |
| function | test_write_report_writes_markdown_with_summary_and_chunks |
225 | |
| function | test_evaluate_requires_api_key |
260 | |
| function | test_evaluate_reports_memgraph_connect_failure |
267 | |
| function | test_evaluate_scores_a_stopword_only_question_as_zero_coverage |
274 | Real (read-only) Memgraph search, against two questions with |
| function | test_main_reports_missing_questions_file |
302 | |
| function | test_main_runs_evaluation_and_writes_report |
308 |