VS Code Environment

VS Code Files

Go To VS Code Testing

• VS Code Testing
  https://code.visualstudio.com/docs/debugtest/testing

• VS Code Testing for Python
  https://code.visualstudio.com/docs/python/testing

.vscode/
├── settings.json    # Python interpreter, analysis, and Testing
├── launch.json      # Run and Debug configurations
└── tasks.json       # Setup, check, test, report, and MkDocs tasks

There is currently no .vscode/extensions.json; extension recommendations are not managed by the repository.

settings

• VS Code Testing for Python
  https://code.visualstudio.com/docs/python/testing

• Source: .vscode/settings.json Connected VS Code features: Testing and Python Extension

  {
    //.venv
    //Python Automatic Environment Activation 
    //    true: automatically activate venv  (.\.venv\Scripts\Activate.ps1)
    //    false: do not automatically activate venv  
    "python.terminal.activateEnvironment": false,
  
    //venv path for Python
    "python.defaultInterpreterPath": "${workspaceFolder}/.venv/Scripts/python.exe",
  
    //Python Testing Configuration
    "python.testing.pytestEnabled": true,
    "python.testing.unittestEnabled": false,
    "python.testing.pytestArgs": [
      "-p",
      "no:cacheprovider",
      "test_envs/tests/pytest",
      "test_envs/tests/unittest"
    ],
    "python.testing.cwd": "${workspaceFolder}",
    "python.testing.autoTestDiscoverOnSaveEnabled": true,
    "python.analysis.extraPaths": [
      "${workspaceFolder}"
    ]
  }
  

-p no:cacheprovider disables pytest's cache provider, so VS Code discovery and execution do not create or update .pytest_cache.

tasks

• Tasks
  https://code.visualstudio.com/docs/debugtest/tasks

• Source: .vscode/tasks.json
  Connected VS Code feature: Run Tasks

  {
      "version": "2.0.0",
      "tasks": [
          //Setup Task Section
          // This section contains tasks for setting up the development environment, including selecting the OS, installing Python virtual environment, and installing Ollama and local LLM.
          // Each task is labeled with a "SETUP" prefix for easy identification.
          {
              "label": "SETUP 1: Select Operating System",
              "type": "process",
              "command": "python",
              "args": [
                  "-m",
                  "test_envs.tools.configuration",
                  "select-os"
              ],
              "presentation": {
                  "reveal": "always",
                  "panel": "dedicated",
                  "clear": true
              },
              "problemMatcher": []
          },
          {
              "label": "SETUP 2: Install Python Virtual Environment",
              "type": "process",
              "command": "python",
              "args": [
                  "-m",
                  "test_envs.test_pipeline.environment_setup",
                  "python"
              ],
              "problemMatcher": []
          },
          {
              "label": "SETUP 3: Install Ollama and Local LLM",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "test_envs.test_pipeline.environment_setup",
                  "ollama"
              ],
              "problemMatcher": []
          },
          // Check Task Section
          // This section contains tasks for checking the environment and running the Ollama server.
          // Each task is labeled with a "CHECK" prefix for easy identification.
          {
              "label": "CHECK 1: Refresh Environment Check File",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "test_envs.tools.configuration",
                  "check"
              ],
              "problemMatcher": []
          },
          {
              "label": "CHECK 2: Show Environment Configuration",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "test_envs.tools.configuration",
                  "config"
              ],
              "problemMatcher": []
          },
          {
              "label": "CHECK 3: Run Ollama Server (Foreground)",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "test_envs.test_pipeline.environment_setup",
                  "serve"
              ],
              "presentation": {
                  "reveal": "always",
                  "panel": "dedicated",
                  "clear": true
              },
              "problemMatcher": []
          },
          // Test Case Task Section
          // "TEST CASE" prefix for easy identification and Input Section for test case ID and fixture mode
          {
              "label": "TEST CASE: ALL",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "pytest",
                  "-p",
                  "no:cacheprovider",
                  "test_envs/tests/pytest/test_cases",
                  "--fixture-mode",
                  "${input:fixtureMode}"
              ],
              "group": {
                  "kind": "test",
                  "isDefault": true
              },
              "problemMatcher": []
          },
          {
              "label": "TEST CASE: TEST ID",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "pytest",
                  "-p",
                  "no:cacheprovider",
                  "test_envs/tests/pytest/test_cases",
                  "--test-id",
                  "${input:testCaseId}",
                  "--fixture-mode",
                  "${input:fixtureMode}"
              ],
              "group": {
                  "kind": "test",
                  "isDefault": false
              },
              "problemMatcher": []
          },
          // Report Task Section
          // This section contains tasks for generating and converting test reports.
          // Each task is labeled with a "REPORT" prefix for easy identification.
          {
              "label": "REPORT-Mkdocs: Generate Markdown to Pytest/Unittest",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "test_envs.tools.test_result",
                  "--pending",
                  "--docs"
              ],
              "problemMatcher": []
          },
          {
              "label": "REPORT-Pandoc: Convert Latest Markdown to HTML",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "test_envs.tools.pandoc_reporter",
                  "--latest",
                  "--format",
                  "html"
              ],
              "problemMatcher": []
          },
          {
              "label": "REPORT-Pandoc: Convert Latest Markdown to DOCX",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "test_envs.tools.pandoc_reporter",
                  "--latest",
                  "--format",
                  "docx"
              ],
              "problemMatcher": []
          },
          // MkDocs Task Section
          // This section contains tasks for serving and building MkDocs documentation.
          // Each task is labeled with a "MkDocs" prefix for easy identification.
          {
              "label": "MkDocs: Serve Local 8000",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "mkdocs",
                  "serve"
              ],
              "problemMatcher": []
          },
          {
              "label": "MkDocs: Serve Local 8080",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "mkdocs",
                  "serve",
                  "-a",
                  "0.0.0.0:8080"
              ],
              "problemMatcher": []
          },
          {
              "label": "MkDocs: Serve Remote ",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "mkdocs",
                  "serve",
                  "-a",
                  "0.0.0.0:8000"
              ],
              "problemMatcher": []
          },
          {
              "label": "MkDocs: Build",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "mkdocs",
                  "build"
              ]
          },
          {
              "label": "MkDocs: Build Strict",
              "type": "process",
              "command": "${config:python.defaultInterpreterPath}",
              "args": [
                  "-m",
                  "mkdocs",
                  "build",
                  "--strict"
              ]
          }
      ],
      // End of tasks array
      // End of tasks section
  
      // Inputs section (Test case and fixture mode inputs)
      // "TEST CASE: TEST ID", and "TEST CASE: ALL"
      "inputs": [
          {
              "id": "testCaseId",
              "type": "pickString",
              "description": "TEST ID",
              "options": [
                  "CT-UART-001",
                  "CT-USB-001",
                  "CT-NETWORK-001"
              ],
              "default": "CT-UART-001"
          },
          {
              "id": "fixtureMode",
              "type": "pickString",
              "description": "Fixture mode",
              "options": [
                  "marker",
                  "mock",
                  "hil"
              ],
              "default": "marker"
          }
      ]
  }
  

launch

• Run and Debug https://code.visualstudio.com/docs/debugtest/debugging https://code.visualstudio.com/docs/debugtest/debugging-configuration

• Source: .vscode/launch.json Connected VS Code feature: Run and Debug

  {
    "version": "0.2.0",
    "configurations": [
      //
      // Setup Section : OS and Python/LLM Envs
      {
        "name": "SETUP 1: Select Operating System",
        "type": "debugpy",
        "request": "launch",
        "python": "python",
        "module": "test_envs.tools.configuration",
        "args": ["config"],
        "preLaunchTask": "SETUP 1: Select Operating System",
        "console": "internalConsole",
        "internalConsoleOptions": "neverOpen",
        "cwd": "${workspaceFolder}",
        "justMyCode": true
      },
      {
        "name": "SETUP 2: Install Python Virtual Environment",
        "type": "debugpy",
        "request": "launch",
        "python": "python",
        "module": "test_envs.tools.configuration",
        "args": ["config"],
        "preLaunchTask": "SETUP 2: Install Python Virtual Environment",
        "console": "internalConsole",
        "internalConsoleOptions": "neverOpen",
        "cwd": "${workspaceFolder}",
        "justMyCode": true
      },
      {
        "name": "SETUP 3: Install Ollama and Local LLM",
        "type": "debugpy",
        "request": "launch",
        "python": "${config:python.defaultInterpreterPath}",
        "module": "test_envs.tools.configuration",
        "args": ["config"],
        "preLaunchTask": "SETUP 3: Install Ollama and Local LLM",
        "console": "internalConsole",
        "internalConsoleOptions": "neverOpen",
        "cwd": "${workspaceFolder}",
        "justMyCode": true
      },
      {
        "name": "CHECK 1: Refresh Environment Check File",
        "type": "debugpy",
        "request": "launch",
        "python": "${config:python.defaultInterpreterPath}",
        "module": "test_envs.tools.configuration",
        "args": ["config"],
        "preLaunchTask": "CHECK 1: Refresh Environment Check File",
        "console": "internalConsole",
        "internalConsoleOptions": "neverOpen",
        "cwd": "${workspaceFolder}",
        "justMyCode": true
      },
      // Run and Debug Section
      {
        "name": "Run : Extension Module (Not Support Now)",
        "type": "debugpy",
        "request": "launch",
        "python": "${config:python.defaultInterpreterPath}",
        "module": "test_envs.tools.extension_runner",
        "args": ["--module", "test_envs.tools.extensions.example"],
        "console": "integratedTerminal",
        "cwd": "${workspaceFolder}",
        "justMyCode": true
      },
      // Reporting Section (Mkdocs Markdown and Pandoc(HTML/DOCX))
      {
        "name": "REPORT-Mkdocs: Generate Markdown to Pytest/Unittest",
        "type": "debugpy",
        "request": "launch",
        "python": "${config:python.defaultInterpreterPath}",
        "module": "test_envs.tools.test_result",
        "args": ["--pending", "--docs"],
        "console": "integratedTerminal",
        "cwd": "${workspaceFolder}",
        "justMyCode": true
      },
      {
        "name": "REPORT-Pandoc: Convert Latest Markdown to HTML",
        "type": "debugpy",
        "request": "launch",
        "python": "${config:python.defaultInterpreterPath}",
        "module": "test_envs.tools.pandoc_reporter",
        "args": ["--latest", "--format", "html"],
        "console": "integratedTerminal",
        "cwd": "${workspaceFolder}",
        "justMyCode": true
      },
      {
        "name": "REPORT-Pandoc: Convert Latest Markdown to DOCX",
        "type": "debugpy",
        "request": "launch",
        "python": "${config:python.defaultInterpreterPath}",
        "module": "test_envs.tools.pandoc_reporter",
        "args": ["--latest", "--format", "docx"],
        "console": "integratedTerminal",
        "cwd": "${workspaceFolder}",
        "justMyCode": true
      }
    ],
    // End of Configurations Section
  
    // Inputs Section for fixture mode selection (Not use currently, reserved for future use)
    "inputs": [
      {
        "id": "fixtureMode",
        "type": "pickString",
        "description": "Fixture mode",
        "options": ["marker", "mock", "hil"],
        "default": "marker"
      }
    ]
  }
  

Run and Debug

Source: .vscode/launch.json

Run and Debug-Setup and Check

“Project Python” means ${config:python.defaultInterpreterPath}.

These four configurations intentionally overlap with Run Tasks. The matching Task performs the setup or check operation through preLaunchTask; after it succeeds, Run and Debug executes test_envs.tools.configuration config to show the current configuration.

Setup 1 and Setup 2 use system python. Setup 3 and later configurations use the interpreter selected by python.defaultInterpreterPath.

Run and Debug-Extension Module

This configuration is a placeholder and is not part of the currently supported test workflow. It has no matching Task. A future implementation will connect extension modules to GDB or another target debugger.

Run and Debug-Report

These configurations overlap with Tasks-Report, but they do not use preLaunchTask. Run and Debug starts the same Python modules through debugpy, while Run Tasks executes them directly as foreground processes. Use Run Tasks for normal report generation and Run and Debug when breakpoints or debugger inspection are required.

Run and Debug-Inputs

Run Tasks

Source: .vscode/tasks.json

Every Task has type: process, runs in the foreground, and has no isBackground flag. Setup 1 and Setup 2 use system python; all later Tasks use ${config:python.defaultInterpreterPath}.

Tasks-Setup and Check

The dedicated-terminal presentation is configured for Setup 1 and Check 3. Closing or stopping Check 3 ends the foreground server process owned by that Task.

Setup 1 through Setup 3 and Check 1 are also exposed through Run and Debug-Setup and Check. In Run and Debug, each matching Task runs first through preLaunchTask.

Tasks-TEST CASE

Both Tasks disable the pytest cache provider and execute test_envs/tests/pytest/test_cases.

Tasks-Report

The same report operations are available through Run and Debug-Report. Run Tasks is the normal execution path; Run and Debug uses debugpy when debugger inspection is needed.

Tasks-MkDocs

The MkDocs: Serve Remote source label currently contains a trailing space.

Tasks-Inputs

OS selection is not a Task or launch input. It is managed by test_envs/configs/config.json through the Setup 1 command.

Testing

• Pytest and Unittest
  

• Testing Coverage
  

Discovery model

VS Code Testing
└── Microsoft Python extension
    └── pytest adapter
        ├── test_envs/tests/pytest
        │   └── CT test cases: mock or hil
        └── test_envs/tests/unittest
            └── unittest.TestCase collected by pytest

Discovery lifecycle

Open workspace
      ↓
Load settings.json
      ↓
Select .venv/Scripts/python.exe
      ↓
Run pytest collection from workspace root
      ↓
Build the unified Testing tree

Execution contracts

The Testing panel supports running or debugging the full tree, a folder, a module, a class, or one test function. CT normalization is handled by test_envs/tests/pytest/conftest.py; unittest normalization is handled by test_envs/tests/unittest/conftest.py.

Discovery troubleshooting

Python Extension