Orchestrata Ultimate › Tests › Reference › scripts › test_flaky_test_hunter
Tests reference — tests/scripts/test_flaky_test_hunter.py
Module of tests/scripts, split out because the directory page would be too large.
Prose pending.
tests/scripts/test_flaky_test_hunter.py
source · 24 tests · 457 lines
Tests for scripts/flaky_test_hunter.py — the multi-run flaky test detector.
| Kind | Name | Line | Description |
|---|---|---|---|
| function | test_parse_failures_constraint_error |
55 | |
| function | test_parse_failures_entity_not_found |
67 | |
| function | test_parse_failures_assertion_error |
76 | |
| function | test_parse_failures_timeout |
83 | |
| function | test_parse_failures_connection_refused |
90 | |
| function | test_parse_failures_runtime_error |
96 | |
| function | test_parse_failures_module_not_found_error |
102 | |
| function | test_parse_failures_unknown_type_and_empty_message |
108 | |
| function | test_parse_failures_message_truncated_to_150_chars |
115 | |
| function | test_parse_failures_no_failed_lines_returns_empty |
122 | |
| function | test_classify_flakiness_flaky_and_consistent_failure |
131 | |
| function | test_classify_flakiness_late_failure_is_flaky_not_consistent |
186 | A test that passes in early runs and fails only in the last run is |
| function | test_parse_passes_short_summary_format |
220 | |
| function | test_parse_passes_verbose_progress_format |
232 | |
| function | test_parse_passes_no_passed_lines_returns_empty |
239 | |
| function | test_infer_root_cause_known_types |
260 | |
| function | test_infer_root_cause_unknown_type_default |
267 | |
| function | test_generate_report_with_flaky_and_consistent_failures |
279 | |
| function | test_generate_report_neither_flaky_nor_failing |
325 | |
| function | test_generate_junit_xml_writes_flaky_testcases |
342 | |
| function | test_main_no_tests_collected_prints_completed_fallback |
377 | When a run's pytest output has neither 'passed' nor 'failed' (e.g. zero |
| function | test_main_all_passing_returns_0 |
394 | |
| function | test_main_consistently_failing_returns_1 |
412 | |
| function | test_main_flaky_test_detected_with_junit_xml |
429 |