콘텐츠로 이동

unittest Result

Test Summary


Item Value
Execution ID 20261024_194104_388963
Pass FAIL
Latest 2026-10-24T19:41:04.389142+09:00
Duration 2.995827 seconds
Total 120
Passed 118
Failed 1
Errors 0
Skipped 1


Test envs Value
test_os windows
test_name local_01
test_environment local
test_request mcp


Test Functions

  • Unit TEST
    • PATH0: test_envs/tests/unittest/ct_framework/python
PATH Test Function Pass Duration (s)
0 test_auto_os_uses_windows_venv_interpreter PASS 0.000584
0 test_check_contains_required_environment_state PASS 0.105284
0 test_configured_time_uses_project_utc_offset PASS 0.000309
0 test_os_selection_keeps_system_python PASS 0.000673
0 test_os_selection_restarts_with_system_python PASS 0.000624
0 test_project_config_contains_os_and_selected_model PASS 0.000607
0 test_set_configured_os_preserves_ollama_config PASS 0.000812
0 test_unix_hosts_use_bin_python PASS 0.000085
0 test_auto_platform_detects_linux PASS 0.000214
0 test_auto_platform_detects_macos PASS 0.000163
0 test_auto_platform_detects_windows PASS 0.000177
0 test_config_platform_uses_project_config PASS 0.000345
0 test_cross_platform_selection_is_rejected PASS 0.000247
0 test_serve_returns_success_when_server_is_already_running PASS 0.001727
0 test_setup_does_not_start_background_server PASS 0.000876
0 test_example_extension PASS 0.002218
0 test_cli_fixture_mode_overrides_marker PASS 0.037783
0 test_ct_markers_define_fixture_selection PASS 0.005831
0 test_fixture_meta_defines_tools_and_modes PASS 0.000105
0 test_legacy_config_catalog_is_not_used PASS 0.000111
0 test_marker_fixture_mode_is_default PASS 0.000086
0 test_mock_implementations_remain_available PASS 0.000090
0 test_test_cases_import_pytest_fixtures PASS 0.000465
0 test_environment_and_os_map_to_github_labels PASS 0.003910
0 test_environment_check_is_detected_from_issue_title PASS 0.000487
0 test_github_hosted_rejects_marker_resolved_hil PASS 0.000440
0 test_github_hosted_runner_rejects_pytest_hil PASS 0.000901
0 test_legacy_combined_runner_is_still_readable PASS 0.001199
0 test_local_mcp_is_not_a_github_issue_environment PASS 0.000335
0 test_markdown_and_mkdocs_publication_are_separate_outputs PASS 0.001831
0 test_parse_current_pytest_request PASS 0.000842
0 test_parse_issue_form_markdown PASS 0.000088
0 test_self_hosted_runner_accepts_pytest_hil PASS 0.000805
0 test_unittest_request_is_detected_from_issue_title PASS 0.000380
0 test_unknown_environment_is_rejected PASS 0.000092
0 test_unknown_pytest_id_is_rejected_by_catalog PASS 0.000858
0 test_pending_progress_prints_numeric_state PASS 0.000821
0 test_pending_results_use_test_id_and_execution_id PASS 0.251978
0 test_pending_unittest_uses_execution_id_without_test_id PASS 0.122009
0 test_publish_latest_copies_markdown PASS 0.003754
0 test_unittest_report_does_not_call_local_llm PASS 0.121244
0 test_analysis_retries_invalid_json_and_writes_diagnostic_log PASS 0.120399
0 test_environment_model_is_configurable PASS 0.000875
0 test_explicit_model_has_highest_priority PASS 0.000486
0 test_installed_model_accepts_ollama_inventory_fields PASS 0.000091
0 test_internal_json_model_is_used_when_environment_is_missing PASS 0.007689
0 test_internal_json_url_is_used_when_environment_is_missing PASS 0.003409
0 test_missing_configured_model_is_rejected PASS 0.000582
0 test_non_empty_test_prompt_overrides_default_prompt PASS 0.107658
0 test_object_preset_supports_extensible_model_metadata PASS 0.000091
0 test_project_config_selected_model PASS 0.000119
0 test_numeric_error_metric_is_not_failure_log PASS 0.000118
0 test_markdown_first_report_contains_required_sections PASS 0.111606
0 test_mkdocs_publish_preserves_each_execution PASS 0.445974
0 test_unittest_markdown_lists_failed_functions PASS 0.119727
0 test_warning_count_controls_severity PASS 0.000214
0 test_hil_requires_explicit_pytest_opt_in PASS 0.001426
0 test_mkdocs_update_requires_explicit_opt_in PASS 0.000380
0 test_pytest_command_uses_allowlisted_arguments_without_a_shell PASS 0.000172
0 test_pytest_list_exposes_allowlisted_ids_and_hil_gate PASS 0.001205
0 test_rejects_unknown_test_id_before_starting_process PASS 0.000544
0 test_unittest_list_exposes_extension_scopes PASS 0.008591
0 test_client_discovers_and_calls_test_inventory PASS 0.129012
0 test_server_advertises_the_workspace_logo PASS 0.004774
0 test_stdio_client_launches_external_server_process FAIL 0.000136
0 test_digilent_measures_usb_transfer PASS 0.000107
0 test_digilent_requires_connection PASS 0.000145
0 test_network_packet_loopback PASS 0.000102
0 test_network_validates_port PASS 0.000117
0 test_uart_loopback_and_lifecycle PASS 0.000103
0 test_uart_requires_connection PASS 0.000088
0 test_usb_packetized_loopback PASS 0.000095
0 test_usb_requires_connection PASS 0.000085
0 test_additional_docx_args_exclude_dynamic_report_paths PASS 0.000311
0 test_docx_conversion_uses_reference_document PASS 0.002173
0 test_html_conversion_does_not_use_reference_document PASS 0.001345
0 test_latest_markdown_searches_nested_report_groups PASS 0.001946
0 test_pandoc_falls_back_to_the_windows_per_user_install PASS 0.001139
0 test_pandoc_rejects_unknown_format PASS 0.000153
0 test_pytest_output_is_grouped_under_test_cases PASS 0.000121
0 test_reference_document_is_stored_outside_test_reports PASS 0.000095
0 test_reference_manifest_describes_the_editable_document PASS 0.000388
0 test_unittest_output_is_grouped_separately PASS 0.000119
0 test_environment_comment_contains_detected_runner_values PASS 0.000442
0 test_github_reporter_reuses_canonical_markdown PASS 0.105807
0 test_issue_comment_contains_summary_and_evidence FAIL 0.109117
0 test_pytest_comment_uses_test_cases_markdown_path PASS 0.105286
0 test_unittest_comment_uses_unittest_paths_without_llm PASS 0.107767
0 test_configuration_structure PASS 0.000191
0 test_docs_test_structure PASS 0.011549
0 test_pytest_case_structure PASS 0.000826
0 test_pytest_fixture_structure PASS 0.000187
0 test_report_structure PASS 0.000961
0 test_role_specific_tool_packages PASS 0.000269
0 test_top_level_structure PASS 0.000307
0 test_unittest_structure PASS 0.000205
0 test_junit_normalization PASS 0.109687
0 test_result_preserves_mock_hil_modes PASS 0.105954
0 test_result_rejects_unknown_status PASS 0.110303
0 test_result_rejects_unknown_test_mode PASS 0.106574
0 test_result_store_creates_canonical_result_and_logs PASS 0.114752
0 test_test_envs_is_the_first_json_section PASS 0.117463
0 test_unittest_result_uses_flat_execution_files PASS 0.117703
0 test_duplicate_test_ids_are_rejected PASS 0.004595
0 test_generated_catalog_matches_python_ct_markers PASS 0.004080
0 test_static_consumers_match_catalog_test_ids PASS 0.001821
0 test_fixture_mode_picker_supports_override PASS 0.001051
0 test_git_tasks_remain_shell_commands PASS 0.001271
0 test_launch_setup_delegates_to_foreground_tasks PASS 0.001097
0 test_ollama_server_task_is_foreground_process PASS 0.000944
0 test_python_setup_uses_platform_picker PASS 0.000918
0 test_python_tasks_run_as_managed_processes PASS 0.000940
0 test_report_tasks_include_html_and_docx PASS 0.000917
0 test_selected_preset_has_model_name PASS 0.000977
0 test_setup_1_uses_system_python PASS 0.001328
0 test_task_setup_uses_internal_model_config PASS 0.000951
0 test_test_case_id_picker_matches_ct_markers PASS 0.001262
0 test_test_case_tasks_support_all_and_test_id PASS 0.001086
0 test_vscode_json_contains_no_os_metadata PASS 0.001024
0 test_vscode_testing_uses_project_venv_and_pytest PASS 0.000907

Failed Functions

test_issue_comment_contains_summary_and_evidence

Item Value
Status FAIL
self = <test_envs.tests.unittest.ct_framework.python.test_reporting.ReportingTests testMethod=test_issue_comment_contains_summary_and_evidence>

    def test_issue_comment_contains_summary_and_evidence(self) -> None:
        result = ResultRecord("CT-001", "FAIL", "timing", 1.25, metrics={"jitter": 0.03})
        comment = render_comment(result, Analysis("Threshold exceeded", "timing", 0.9, "test"))
        self.assertIn("**Result: FAIL**", comment)
        self.assertIn("| Test envs | Value |", comment)
        self.assertIn("| test_environment | local |", comment)
>       self.assertIn("| test_request | local_vscode |", comment)
E       AssertionError: '| test_request | local_vscode |' not found in '## Test Result\n\n**Result: FAIL**\n\n### Test envs\n\n| Test envs | Value |\n|---|---|\n| test_os | windows |\n| test_name | local_01 |\n| test_environment | local |\n| test_request | mcp |\n\n### Test\n- ID: CT-001\n- Category: timing\n- Fixture ID: Not applicable\n- Default Fixture Mode: Not applicable\n- Test Path: Not applicable\n- Interface: None\n- Equipment: None\n- Duration: 1.250 seconds\n\n### Measurement\n- jitter: 0.03\n\n### Statistics\n- None\n\n### Warning Summary\n- None\n\n### Analysis\nThreshold exceeded\n\n- Classification: timing\n- Confidence: 0.90\n- Local LLM analyzer: test\n\n### Evidence\n- [Workflow run and artifacts](Available in the workflow run)\n- MkDocs source: `docs/tests/pytest/CT-001.md`\n- Markdown result: `test_reports/markdown/pytest/test_cases/CT-001/20261024_194103_041972_result.md`\n- Commit: `88321a40803c78bb00fac1010fd62197ede0ead6`\n- Branch: `main`\n- Runner: local\n- Execution ID: `20261024_194103_041972`\n'

test_envs\tests\unittest\ct_framework\python\test_reporting.py:37: AssertionError


Test Source

Item Value
Commit 88321a40803c78bb00fac1010fd62197ede0ead6
Branch main

Logs

Item Value
Result log 20261024_194104_388963_result.log
Result json 20261024_194104_388963_result.json