콘텐츠로 이동

unittest Result

Test Summary


Item Value
Execution ID 20261024_195933_055077
Pass FAIL
Latest 2026-10-24T19:59:33.055256+09:00
Duration 2.708452 seconds
Total 123
Passed 121
Failed 1
Errors 0
Skipped 1


Test envs Value
test_os windows
test_name local_01
test_environment local
test_request mcp


Test Functions

  • Unit TEST
    • PATH0: test_envs/tests/unittest/ct_framework/python
PATH Test Function Pass Duration (s)
0 test_auto_os_uses_windows_venv_interpreter PASS 0.000612
0 test_combined_check_remains_available_to_runtime_consumers PASS 0.226492
0 test_combined_config_remains_available_to_runtime_consumers PASS 0.000651
0 test_configured_time_uses_project_utc_offset PASS 0.000686
0 test_os_selection_keeps_system_python PASS 0.000776
0 test_os_selection_restarts_with_system_python PASS 0.001051
0 test_project_config_is_split_by_environment_and_ollama PASS 0.000771
0 test_set_configured_os_updates_only_environment_config PASS 0.001406
0 test_split_checks_contain_required_environment_state PASS 0.001525
0 test_unix_hosts_use_bin_python PASS 0.000102
0 test_auto_platform_detects_linux PASS 0.000361
0 test_auto_platform_detects_macos PASS 0.000317
0 test_auto_platform_detects_windows PASS 0.000308
0 test_config_platform_uses_project_config PASS 0.000585
0 test_cross_platform_selection_is_rejected PASS 0.000457
0 test_serve_returns_success_when_server_is_already_running PASS 0.001399
0 test_setup_does_not_start_background_server PASS 0.001328
0 test_example_extension PASS 0.002723
0 test_cli_fixture_mode_overrides_marker PASS 0.044688
0 test_ct_markers_define_fixture_selection PASS 0.006272
0 test_fixture_meta_defines_tools_and_modes PASS 0.000127
0 test_legacy_config_catalog_is_not_used PASS 0.000117
0 test_marker_fixture_mode_is_default PASS 0.000098
0 test_mock_implementations_remain_available PASS 0.000096
0 test_test_cases_import_pytest_fixtures PASS 0.000540
0 test_environment_and_os_map_to_github_labels PASS 0.003560
0 test_environment_check_is_detected_from_issue_title PASS 0.000464
0 test_github_hosted_rejects_marker_resolved_hil PASS 0.000452
0 test_github_hosted_runner_rejects_pytest_hil PASS 0.001207
0 test_legacy_combined_runner_is_still_readable PASS 0.001606
0 test_local_mcp_is_not_a_github_issue_environment PASS 0.000347
0 test_markdown_and_mkdocs_publication_are_separate_outputs PASS 0.002628
0 test_parse_current_pytest_request PASS 0.000906
0 test_parse_issue_form_markdown PASS 0.000105
0 test_self_hosted_runner_accepts_pytest_hil PASS 0.000900
0 test_unittest_request_is_detected_from_issue_title PASS 0.000419
0 test_unknown_environment_is_rejected PASS 0.000102
0 test_unknown_pytest_id_is_rejected_by_catalog PASS 0.000996
0 test_pending_progress_prints_numeric_state PASS 0.000697
0 test_pending_results_use_test_id_and_execution_id PASS 0.234503
0 test_pending_unittest_uses_execution_id_without_test_id PASS 0.102979
0 test_publish_latest_copies_markdown PASS 0.003762
0 test_unittest_report_does_not_call_local_llm PASS 0.102235
0 test_analysis_retries_invalid_json_and_writes_diagnostic_log PASS 0.097631
0 test_environment_model_is_configurable PASS 0.002205
0 test_explicit_model_has_highest_priority PASS 0.001491
0 test_installed_model_accepts_ollama_inventory_fields PASS 0.000097
0 test_internal_json_model_is_used_when_environment_is_missing PASS 0.002865
0 test_internal_json_url_is_used_when_environment_is_missing PASS 0.002979
0 test_missing_configured_model_is_rejected PASS 0.001399
0 test_non_empty_test_prompt_overrides_default_prompt PASS 0.090717
0 test_object_preset_supports_extensible_model_metadata PASS 0.000098
0 test_project_config_selected_model PASS 0.000087
0 test_numeric_error_metric_is_not_failure_log PASS 0.000126
0 test_markdown_first_report_contains_required_sections PASS 0.104110
0 test_mkdocs_publish_preserves_each_execution PASS 0.355664
0 test_unittest_markdown_lists_failed_functions PASS 0.090323
0 test_warning_count_controls_severity PASS 0.000115
0 test_hil_requires_explicit_pytest_opt_in PASS 0.001960
0 test_mkdocs_update_requires_explicit_opt_in PASS 0.001202
0 test_ollama_test_plan_uses_allowlisted_targets_and_reports PASS 0.002082
0 test_pytest_command_uses_allowlisted_arguments_without_a_shell PASS 0.000093
0 test_pytest_list_exposes_allowlisted_ids_and_hil_gate PASS 0.002226
0 test_rejects_unknown_test_id_before_starting_process PASS 0.000517
0 test_unittest_list_exposes_extension_scopes PASS 0.009542
0 test_client_discovers_and_calls_test_inventory PASS 0.123879
0 test_server_advertises_the_workspace_logo PASS 0.005448
0 test_stdio_client_launches_external_server_process FAIL 0.000151
0 test_digilent_measures_usb_transfer PASS 0.000110
0 test_digilent_requires_connection PASS 0.000150
0 test_network_packet_loopback PASS 0.000106
0 test_network_validates_port PASS 0.000127
0 test_uart_loopback_and_lifecycle PASS 0.000106
0 test_uart_requires_connection PASS 0.000092
0 test_usb_packetized_loopback PASS 0.000101
0 test_usb_requires_connection PASS 0.000091
0 test_additional_docx_args_exclude_dynamic_report_paths PASS 0.000335
0 test_docx_conversion_uses_reference_document PASS 0.002119
0 test_html_conversion_does_not_use_reference_document PASS 0.002236
0 test_latest_markdown_searches_nested_report_groups PASS 0.001696
0 test_pandoc_falls_back_to_the_windows_per_user_install PASS 0.001168
0 test_pandoc_rejects_unknown_format PASS 0.000147
0 test_pytest_output_is_grouped_under_test_cases PASS 0.000127
0 test_reference_document_is_stored_outside_test_reports PASS 0.000099
0 test_reference_manifest_describes_the_editable_document PASS 0.000295
0 test_unittest_output_is_grouped_separately PASS 0.000116
0 test_environment_comment_contains_detected_runner_values PASS 0.001297
0 test_github_reporter_reuses_canonical_markdown PASS 0.092561
0 test_issue_comment_contains_summary_and_evidence FAIL 0.090571
0 test_pytest_comment_uses_test_cases_markdown_path PASS 0.086773
0 test_unittest_comment_uses_unittest_paths_without_llm PASS 0.087630
0 test_configuration_structure PASS 0.000269
0 test_docs_test_structure PASS 0.010470
0 test_pytest_case_structure PASS 0.000805
0 test_pytest_fixture_structure PASS 0.000186
0 test_report_structure PASS 0.000991
0 test_role_specific_tool_packages PASS 0.000270
0 test_top_level_structure PASS 0.000302
0 test_unittest_structure PASS 0.000201
0 test_junit_normalization PASS 0.086368
0 test_result_preserves_mock_hil_modes PASS 0.085776
0 test_result_rejects_unknown_status PASS 0.086576
0 test_result_rejects_unknown_test_mode PASS 0.085785
0 test_result_store_creates_canonical_result_and_logs PASS 0.097232
0 test_test_envs_is_the_first_json_section PASS 0.105741
0 test_unittest_result_uses_flat_execution_files PASS 0.105286
0 test_duplicate_test_ids_are_rejected PASS 0.003398
0 test_generated_catalog_matches_python_ct_markers PASS 0.003579
0 test_static_consumers_match_catalog_test_ids PASS 0.001109
0 test_fixture_mode_picker_supports_override PASS 0.001671
0 test_git_tasks_remain_shell_commands PASS 0.001131
0 test_launch_setup_delegates_to_foreground_tasks PASS 0.001111
0 test_ollama_server_task_is_foreground_process PASS 0.001082
0 test_python_setup_uses_platform_picker PASS 0.001075
0 test_python_tasks_run_as_managed_processes PASS 0.001082
0 test_report_tasks_include_html_and_docx PASS 0.001638
0 test_selected_preset_has_model_name PASS 0.001245
0 test_setup_1_uses_system_python PASS 0.001127
0 test_task_setup_uses_internal_model_config PASS 0.001678
0 test_test_case_id_picker_matches_ct_markers PASS 0.001490
0 test_test_case_tasks_support_all_and_test_id PASS 0.001089
0 test_vscode_json_contains_no_os_metadata PASS 0.001110
0 test_vscode_testing_uses_project_venv_and_pytest PASS 0.001159

Failed Functions

test_issue_comment_contains_summary_and_evidence

Item Value
Status FAIL
self = <test_envs.tests.unittest.ct_framework.python.test_reporting.ReportingTests testMethod=test_issue_comment_contains_summary_and_evidence>

    def test_issue_comment_contains_summary_and_evidence(self) -> None:
        result = ResultRecord("CT-001", "FAIL", "timing", 1.25, metrics={"jitter": 0.03})
        with patch.dict("os.environ", {"TEST_REQUEST": "local_vscode"}):
            comment = render_comment(result, Analysis("Threshold exceeded", "timing", 0.9, "test"))
        self.assertIn("**Result: FAIL**", comment)
        self.assertIn("| Test envs | Value |", comment)
        self.assertIn("| test_environment | local |", comment)
>       self.assertIn("| test_request | local_vscode |", comment)
E       AssertionError: '| test_request | local_vscode |' not found in '## Test Result\n\n**Result: FAIL**\n\n### Test envs\n\n| Test envs | Value |\n|---|---|\n| test_os | windows |\n| test_name | local_01 |\n| test_environment | local |\n| test_request | mcp |\n\n### Test\n- ID: CT-001\n- Category: timing\n- Fixture ID: Not applicable\n- Default Fixture Mode: Not applicable\n- Test Path: Not applicable\n- Interface: None\n- Equipment: None\n- Duration: 1.250 seconds\n\n### Measurement\n- jitter: 0.03\n\n### Statistics\n- None\n\n### Warning Summary\n- None\n\n### Analysis\nThreshold exceeded\n\n- Classification: timing\n- Confidence: 0.90\n- Local LLM analyzer: test\n\n### Evidence\n- [Workflow run and artifacts](Available in the workflow run)\n- MkDocs source: `docs/tests/pytest/CT-001.md`\n- Markdown result: `test_reports/markdown/pytest/test_cases/CT-001/20261024_195931_899069_result.md`\n- Commit: `41ad1b4fbfe9a29aa2446566bda29c27ad0db618`\n- Branch: `main`\n- Runner: local\n- Execution ID: `20261024_195931_899069`\n'

test_envs\tests\unittest\ct_framework\python\test_reporting.py:38: AssertionError


Test Source

Item Value
Commit 41ad1b4fbfe9a29aa2446566bda29c27ad0db618
Branch main

Logs

Item Value
Result log 20261024_195933_055077_result.log
Result json 20261024_195933_055077_result.json