콘텐츠로 이동

unittest Result

Test Summary

Item Value
Execution ID 20260910_110813_905675
Pass FAIL
Latest 2026-09-10T11:08:13.905754+09:00
Duration 0.944653 seconds
Total 93
Passed 92
Failed 1
Errors 0
Skipped 0

Test Functions

  • Unit TEST
    • PATH0: test_envs/tests/unittest/ct_framework/python
PATH Test Function Pass Duration (s)
0 test_auto_os_uses_windows_venv_interpreter PASS 0.000399
0 test_check_contains_required_environment_state PASS 0.034667
0 test_configured_time_uses_project_utc_offset PASS 0.000251
0 test_os_selection_keeps_system_python PASS 0.000268
0 test_os_selection_restarts_with_system_python PASS 0.000333
0 test_project_config_contains_os_and_selected_model PASS 0.000197
0 test_set_configured_os_preserves_ollama_config PASS 0.000452
0 test_unix_hosts_use_bin_python PASS 0.000068
0 test_auto_platform_detects_linux PASS 0.000119
0 test_auto_platform_detects_macos PASS 0.000105
0 test_auto_platform_detects_windows PASS 0.000105
0 test_config_platform_uses_project_config PASS 0.000196
0 test_cross_platform_selection_is_rejected PASS 0.000276
0 test_serve_returns_success_when_server_is_already_running PASS 0.000751
0 test_setup_does_not_start_background_server PASS 0.001204
0 test_example_extension PASS 0.001310
0 test_catalog_files_are_not_used PASS 0.000099
0 test_cli_fixture_mode_overrides_marker PASS 0.012076
0 test_ct_markers_define_fixture_selection PASS 0.001964
0 test_fixture_meta_defines_tools_and_modes PASS 0.000087
0 test_marker_fixture_mode_is_default PASS 0.000077
0 test_mock_implementations_remain_available PASS 0.000078
0 test_test_cases_import_pytest_fixtures PASS 0.000071
0 test_environment_check_is_detected_from_issue_title PASS 0.000467
0 test_parse_current_pytest_request PASS 0.000097
0 test_parse_issue_form_markdown PASS 0.000069
0 test_runner_selection_maps_to_github_labels PASS 0.000137
0 test_self_hosted_runner_requires_an_os PASS 0.000112
0 test_unittest_request_is_detected_from_issue_title PASS 0.000238
0 test_pending_progress_prints_numeric_state PASS 0.000528
0 test_pending_results_use_test_id_and_execution_id FAIL 0.092445
0 test_pending_unittest_uses_execution_id_without_test_id PASS 0.049046
0 test_publish_latest_copies_markdown PASS 0.003085
0 test_unittest_report_does_not_call_local_llm PASS 0.045515
0 test_analysis_retries_invalid_json_and_writes_diagnostic_log PASS 0.044404
0 test_environment_model_is_configurable PASS 0.000860
0 test_explicit_model_has_highest_priority PASS 0.000789
0 test_installed_model_accepts_ollama_inventory_fields PASS 0.000080
0 test_internal_json_model_is_used_when_environment_is_missing PASS 0.001609
0 test_internal_json_url_is_used_when_environment_is_missing PASS 0.001343
0 test_missing_configured_model_is_rejected PASS 0.000797
0 test_non_empty_test_prompt_overrides_default_prompt PASS 0.037424
0 test_object_preset_supports_extensible_model_metadata PASS 0.000111
0 test_project_config_selected_model PASS 0.000075
0 test_numeric_error_metric_is_not_failure_log PASS 0.000108
0 test_markdown_first_report_contains_required_sections PASS 0.045130
0 test_mkdocs_publish_preserves_each_execution PASS 0.162305
0 test_unittest_markdown_lists_failed_functions PASS 0.045208
0 test_warning_count_controls_severity PASS 0.000102
0 test_digilent_measures_usb_transfer PASS 0.000093
0 test_digilent_requires_connection PASS 0.000126
0 test_network_packet_loopback PASS 0.000084
0 test_network_validates_port PASS 0.000093
0 test_uart_loopback_and_lifecycle PASS 0.000086
0 test_uart_requires_connection PASS 0.000071
0 test_usb_packetized_loopback PASS 0.000076
0 test_usb_requires_connection PASS 0.000068
0 test_latest_markdown_searches_nested_report_groups PASS 0.000763
0 test_pandoc_rejects_unknown_format PASS 0.000119
0 test_pytest_output_is_grouped_under_test_cases PASS 0.000083
0 test_unittest_output_is_grouped_separately PASS 0.000079
0 test_environment_comment_contains_detected_runner_values PASS 0.000695
0 test_issue_comment_contains_summary_and_evidence PASS 0.037442
0 test_pytest_comment_uses_test_cases_markdown_path PASS 0.037211
0 test_unittest_comment_uses_unittest_paths_without_llm PASS 0.035899
0 test_configuration_structure PASS 0.000147
0 test_docs_test_structure PASS 0.002564
0 test_pytest_case_structure PASS 0.000283
0 test_pytest_fixture_structure PASS 0.000114
0 test_report_structure PASS 0.000523
0 test_role_specific_tool_packages PASS 0.000152
0 test_top_level_structure PASS 0.000164
0 test_unittest_structure PASS 0.000118
0 test_junit_normalization PASS 0.038734
0 test_result_preserves_mock_hil_modes PASS 0.037749
0 test_result_rejects_unknown_status PASS 0.037671
0 test_result_rejects_unknown_test_mode PASS 0.037114
0 test_result_store_creates_canonical_result_and_logs PASS 0.043113
0 test_unittest_result_uses_flat_execution_files PASS 0.040837
0 test_fixture_mode_picker_supports_override PASS 0.000557
0 test_git_tasks_remain_shell_commands PASS 0.000363
0 test_launch_setup_delegates_to_foreground_tasks PASS 0.000347
0 test_ollama_server_task_is_foreground_process PASS 0.000337
0 test_python_setup_uses_platform_picker PASS 0.000338
0 test_python_tasks_run_as_managed_processes PASS 0.000326
0 test_report_tasks_include_html_and_docx PASS 0.000314
0 test_selected_preset_has_model_name PASS 0.000323
0 test_setup_1_uses_system_python PASS 0.000335
0 test_task_setup_uses_internal_model_config PASS 0.000489
0 test_test_case_id_picker_matches_ct_markers PASS 0.000369
0 test_test_case_tasks_support_all_and_test_id PASS 0.000340
0 test_vscode_json_contains_no_os_metadata PASS 0.000345
0 test_vscode_testing_uses_project_venv_and_pytest PASS 0.000365

Failed Functions

Test Function Status Failure
test_pending_results_use_test_id_and_execution_id FAIL self = def test_pending_results_use_test_id_and_execution_id(self) -> None: root = Path("test_envs/tests/.tmp/ct_framework/pending-results") docs = Path("test_envs/tests/.tmp/ct_framework/pending-docs") store = ResultStore(root) complete = ResultRecord("CT-PENDING-001", "PASS", "timing", 0.1, execution_id="20260101_000001_000001") missing = ResultRecord("CT-PENDING-002", "PASS", "timing", 0.1, execution_id="20260101_000002_000002") complete_path = store.save(complete) missing_path = store.save(missing) complete_markdown = root / "markdown" / complete.test_id / f"{complete.execution_id}_result.md" complete_markdown.parent.mkdir(parents=True, exist_ok=True) complete_markdown.write_text("# complete", encoding="utf-8") missing_markdown = root / "markdown" / missing.test_id / f"{missing.execution_id}_result.md" missing_markdown.unlink(missing_ok=True) > self.assertEqual(pending_result_paths(store=store, docs_root=docs), [missing_path]) E AssertionError: Lists differ: [Wind[93 chars]NG-001/20260101_000001_000001_result.json'), W[135 chars]on')] != [Wind[93 chars]NG-002/20260101_000002_000002_result.json')] E E First differing element 0: E Windo[72 chars]/test_cases/CT-PENDING-001/20260101_000001_000001_result.json') E Windo[72 chars]/test_cases/CT-PENDING-002/20260101_000002_000002_result.json') E E First list contains 1 additional elements. E First extra element 1: E WindowsPath('test_envs/tests/.tmp/ct_framework/pending-results/results/pytest/test_cases/CT-PENDING-002/20260101_000002_000002_result.json') E E - [WindowsPath('test_envs/tests/.tmp/ct_framework/pending-results/results/pytest/test_cases/CT-PENDING-001/20260101_000001_000001_result.json'), E - WindowsPath('test_envs/tests/.tmp/ct_framework/pending-results/results/pytest/test_cases/CT-PENDING-002/20260101_000002_000002_result.json')] E ? ^ E E + [WindowsPath('test_envs/tests/.tmp/ct_framework/pending-results/results/pytest/test_cases/CT-PENDING-002/20260101_000002_000002_result.json')] E ? ^ test_envs\tests\unittest\ct_framework\python\test_latest_result.py:36: AssertionError

Test Source

Item Value
Commit 04b01c672306ebdb4660d95ef7931ecf802579f9
Branch main

Logs

Item Value
Result log 20260910_110813_905675_result.log
Result json 20260910_110813_905675_result.json