콘텐츠로 이동

unittest Result

Test Summary


Item Value
Execution ID 20261024_200051_206796
Pass FAIL
Latest 2026-10-24T20:00:51.206980+09:00
Duration 2.596421 seconds
Total 123
Passed 121
Failed 1
Errors 0
Skipped 1


Test envs Value
test_os windows
test_name local_01
test_environment local
test_request mcp


Test Functions

  • Unit TEST
    • PATH0: test_envs/tests/unittest/ct_framework/python
PATH Test Function Pass Duration (s)
0 test_auto_os_uses_windows_venv_interpreter PASS 0.000659
0 test_combined_check_remains_available_to_runtime_consumers PASS 0.192921
0 test_combined_config_remains_available_to_runtime_consumers PASS 0.000501
0 test_configured_time_uses_project_utc_offset PASS 0.000465
0 test_os_selection_keeps_system_python PASS 0.000424
0 test_os_selection_restarts_with_system_python PASS 0.000659
0 test_project_config_is_split_by_environment_and_ollama PASS 0.000548
0 test_set_configured_os_updates_only_environment_config PASS 0.000799
0 test_split_checks_contain_required_environment_state PASS 0.001179
0 test_unix_hosts_use_bin_python PASS 0.000089
0 test_auto_platform_detects_linux PASS 0.000183
0 test_auto_platform_detects_macos PASS 0.000166
0 test_auto_platform_detects_windows PASS 0.000172
0 test_config_platform_uses_project_config PASS 0.000317
0 test_cross_platform_selection_is_rejected PASS 0.000241
0 test_serve_returns_success_when_server_is_already_running PASS 0.001048
0 test_setup_does_not_start_background_server PASS 0.001100
0 test_example_extension PASS 0.002123
0 test_cli_fixture_mode_overrides_marker PASS 0.035809
0 test_ct_markers_define_fixture_selection PASS 0.004578
0 test_fixture_meta_defines_tools_and_modes PASS 0.000106
0 test_legacy_config_catalog_is_not_used PASS 0.000126
0 test_marker_fixture_mode_is_default PASS 0.000096
0 test_mock_implementations_remain_available PASS 0.000102
0 test_test_cases_import_pytest_fixtures PASS 0.000482
0 test_environment_and_os_map_to_github_labels PASS 0.003868
0 test_environment_check_is_detected_from_issue_title PASS 0.000539
0 test_github_hosted_rejects_marker_resolved_hil PASS 0.000470
0 test_github_hosted_runner_rejects_pytest_hil PASS 0.000878
0 test_legacy_combined_runner_is_still_readable PASS 0.000823
0 test_local_mcp_is_not_a_github_issue_environment PASS 0.000154
0 test_markdown_and_mkdocs_publication_are_separate_outputs PASS 0.001528
0 test_parse_current_pytest_request PASS 0.000844
0 test_parse_issue_form_markdown PASS 0.000093
0 test_self_hosted_runner_accepts_pytest_hil PASS 0.000813
0 test_unittest_request_is_detected_from_issue_title PASS 0.000367
0 test_unknown_environment_is_rejected PASS 0.000095
0 test_unknown_pytest_id_is_rejected_by_catalog PASS 0.000856
0 test_pending_progress_prints_numeric_state PASS 0.000528
0 test_pending_results_use_test_id_and_execution_id PASS 0.194811
0 test_pending_unittest_uses_execution_id_without_test_id PASS 0.095611
0 test_publish_latest_copies_markdown PASS 0.002830
0 test_unittest_report_does_not_call_local_llm PASS 0.096771
0 test_analysis_retries_invalid_json_and_writes_diagnostic_log PASS 0.095468
0 test_environment_model_is_configurable PASS 0.002128
0 test_explicit_model_has_highest_priority PASS 0.001405
0 test_installed_model_accepts_ollama_inventory_fields PASS 0.000093
0 test_internal_json_model_is_used_when_environment_is_missing PASS 0.002449
0 test_internal_json_url_is_used_when_environment_is_missing PASS 0.002268
0 test_missing_configured_model_is_rejected PASS 0.001430
0 test_non_empty_test_prompt_overrides_default_prompt PASS 0.091058
0 test_object_preset_supports_extensible_model_metadata PASS 0.000097
0 test_project_config_selected_model PASS 0.000084
0 test_numeric_error_metric_is_not_failure_log PASS 0.000135
0 test_markdown_first_report_contains_required_sections PASS 0.101562
0 test_mkdocs_publish_preserves_each_execution PASS 0.341606
0 test_unittest_markdown_lists_failed_functions PASS 0.103662
0 test_warning_count_controls_severity PASS 0.000121
0 test_hil_requires_explicit_pytest_opt_in PASS 0.002354
0 test_mkdocs_update_requires_explicit_opt_in PASS 0.001331
0 test_ollama_test_plan_uses_allowlisted_targets_and_reports PASS 0.002572
0 test_pytest_command_uses_allowlisted_arguments_without_a_shell PASS 0.000187
0 test_pytest_list_exposes_allowlisted_ids_and_hil_gate PASS 0.002531
0 test_rejects_unknown_test_id_before_starting_process PASS 0.000644
0 test_unittest_list_exposes_extension_scopes PASS 0.008900
0 test_client_discovers_and_calls_test_inventory PASS 0.133229
0 test_server_advertises_the_workspace_logo PASS 0.005255
0 test_stdio_client_launches_external_server_process FAIL 0.000158
0 test_digilent_measures_usb_transfer PASS 0.000117
0 test_digilent_requires_connection PASS 0.000161
0 test_network_packet_loopback PASS 0.000110
0 test_network_validates_port PASS 0.000129
0 test_uart_loopback_and_lifecycle PASS 0.000117
0 test_uart_requires_connection PASS 0.000095
0 test_usb_packetized_loopback PASS 0.000105
0 test_usb_requires_connection PASS 0.000093
0 test_additional_docx_args_exclude_dynamic_report_paths PASS 0.000325
0 test_docx_conversion_uses_reference_document PASS 0.002161
0 test_html_conversion_does_not_use_reference_document PASS 0.001360
0 test_latest_markdown_searches_nested_report_groups PASS 0.001965
0 test_pandoc_falls_back_to_the_windows_per_user_install PASS 0.001497
0 test_pandoc_rejects_unknown_format PASS 0.000175
0 test_pytest_output_is_grouped_under_test_cases PASS 0.000140
0 test_reference_document_is_stored_outside_test_reports PASS 0.000114
0 test_reference_manifest_describes_the_editable_document PASS 0.000341
0 test_unittest_output_is_grouped_separately PASS 0.000122
0 test_environment_comment_contains_detected_runner_values PASS 0.001299
0 test_github_reporter_reuses_canonical_markdown PASS 0.090174
0 test_issue_comment_contains_summary_and_evidence FAIL 0.091021
0 test_pytest_comment_uses_test_cases_markdown_path PASS 0.087817
0 test_unittest_comment_uses_unittest_paths_without_llm PASS 0.089745
0 test_configuration_structure PASS 0.000263
0 test_docs_test_structure PASS 0.010614
0 test_pytest_case_structure PASS 0.000801
0 test_pytest_fixture_structure PASS 0.000190
0 test_report_structure PASS 0.001007
0 test_role_specific_tool_packages PASS 0.000272
0 test_top_level_structure PASS 0.000314
0 test_unittest_structure PASS 0.000202
0 test_junit_normalization PASS 0.087489
0 test_result_preserves_mock_hil_modes PASS 0.085683
0 test_result_rejects_unknown_status PASS 0.087413
0 test_result_rejects_unknown_test_mode PASS 0.087500
0 test_result_store_creates_canonical_result_and_logs PASS 0.099597
0 test_test_envs_is_the_first_json_section PASS 0.099215
0 test_unittest_result_uses_flat_execution_files PASS 0.094828
0 test_duplicate_test_ids_are_rejected PASS 0.004209
0 test_generated_catalog_matches_python_ct_markers PASS 0.003273
0 test_static_consumers_match_catalog_test_ids PASS 0.001034
0 test_fixture_mode_picker_supports_override PASS 0.001114
0 test_git_tasks_remain_shell_commands PASS 0.001088
0 test_launch_setup_delegates_to_foreground_tasks PASS 0.001069
0 test_ollama_server_task_is_foreground_process PASS 0.001051
0 test_python_setup_uses_platform_picker PASS 0.001036
0 test_python_tasks_run_as_managed_processes PASS 0.001057
0 test_report_tasks_include_html_and_docx PASS 0.001045
0 test_selected_preset_has_model_name PASS 0.001289
0 test_setup_1_uses_system_python PASS 0.001166
0 test_task_setup_uses_internal_model_config PASS 0.001175
0 test_test_case_id_picker_matches_ct_markers PASS 0.001476
0 test_test_case_tasks_support_all_and_test_id PASS 0.001114
0 test_vscode_json_contains_no_os_metadata PASS 0.001109
0 test_vscode_testing_uses_project_venv_and_pytest PASS 0.001048

Failed Functions

test_issue_comment_contains_summary_and_evidence

Item Value
Status FAIL
self = <test_envs.tests.unittest.ct_framework.python.test_reporting.ReportingTests testMethod=test_issue_comment_contains_summary_and_evidence>

    def test_issue_comment_contains_summary_and_evidence(self) -> None:
        result = ResultRecord("CT-001", "FAIL", "timing", 1.25, metrics={"jitter": 0.03})
        with patch.dict("os.environ", {"TEST_REQUEST": "local_vscode"}):
            comment = render_comment(result, Analysis("Threshold exceeded", "timing", 0.9, "test"))
        self.assertIn("**Result: FAIL**", comment)
        self.assertIn("| Test envs | Value |", comment)
        self.assertIn("| test_environment | local |", comment)
>       self.assertIn("| test_request | local_vscode |", comment)
E       AssertionError: '| test_request | local_vscode |' not found in '## Test Result\n\n**Result: FAIL**\n\n### Test envs\n\n| Test envs | Value |\n|---|---|\n| test_os | windows |\n| test_name | local_01 |\n| test_environment | local |\n| test_request | mcp |\n\n### Test\n- ID: CT-001\n- Category: timing\n- Fixture ID: Not applicable\n- Default Fixture Mode: Not applicable\n- Test Path: Not applicable\n- Interface: None\n- Equipment: None\n- Duration: 1.250 seconds\n\n### Measurement\n- jitter: 0.03\n\n### Statistics\n- None\n\n### Warning Summary\n- None\n\n### Analysis\nThreshold exceeded\n\n- Classification: timing\n- Confidence: 0.90\n- Local LLM analyzer: test\n\n### Evidence\n- [Workflow run and artifacts](Available in the workflow run)\n- MkDocs source: `docs/tests/pytest/CT-001.md`\n- Markdown result: `test_reports/markdown/pytest/test_cases/CT-001/20261024_200050_064009_result.md`\n- Commit: `41ad1b4fbfe9a29aa2446566bda29c27ad0db618`\n- Branch: `main`\n- Runner: local\n- Execution ID: `20261024_200050_064009`\n'

test_envs\tests\unittest\ct_framework\python\test_reporting.py:38: AssertionError


Test Source

Item Value
Commit 41ad1b4fbfe9a29aa2446566bda29c27ad0db618
Branch main

Logs

Item Value
Result log 20261024_200051_206796_result.log
Result json 20261024_200051_206796_result.json