gitops/optimclaw

Fork 0

mirror of https://github.com/outbackdingo/optimclaw.git synced 2026-08-25 14:53:34 +00:00

Files

T

History

e24c33ff90 fix(ci): flush profraw coverage data in E2E teardown (#550 )

The ironclaw binary only handles SIGINT (via tokio::signal::ctrl_c),
not SIGTERM. When conftest.py sent SIGTERM during teardown, the OS
killed the process immediately without running atexit handlers, so
LLVM never flushed .profraw files. cargo llvm-cov report then found
zero profraw files and failed.

- Send SIGINT instead of SIGTERM so the existing ctrl_c handler
  triggers graceful shutdown → main() returns → atexit runs → profraw
  flushed
- Increase shutdown wait from 5s to 10s for graceful cleanup
- Add a diagnostic step to verify profraw files exist before the
  report step, making future issues visible in CI logs

Co-authored-by: Claude Opus 4.6 <[email protected]>

2026-03-04 20:05:46 +00:00

scenarios

Add automated QA: schema validator, CI matrix, Docker build, and P1 test coverage (#353 )

2026-02-27 09:09:45 +04:00

conftest.py

fix(ci): flush profraw coverage data in E2E teardown (#550 )

2026-03-04 20:05:46 +00:00

helpers.py

Add automated QA: schema validator, CI matrix, Docker build, and P1 test coverage (#353 )

2026-02-27 09:09:45 +04:00

mock_llm.py

Add automated QA: schema validator, CI matrix, Docker build, and P1 test coverage (#353 )

2026-02-27 09:09:45 +04:00

pyproject.toml

Add automated QA: schema validator, CI matrix, Docker build, and P1 test coverage (#353 )

2026-02-27 09:09:45 +04:00

README.md

Add automated QA: schema validator, CI matrix, Docker build, and P1 test coverage (#353 )

2026-02-27 09:09:45 +04:00

README.md

IronClaw E2E Tests

Browser-level end-to-end tests for the IronClaw web gateway using Python + Playwright.

Prerequisites

Python 3.11+
Rust toolchain (for building ironclaw)
Chromium (installed via Playwright)

Setup

cd tests/e2e
pip install -e .
playwright install chromium

Build ironclaw

The tests need the ironclaw binary built with libsql support:

cargo build --no-default-features --features libsql

Run tests

# From repo root
pytest tests/e2e/ -v

# Run a single scenario
pytest tests/e2e/scenarios/test_chat.py -v

# With visible browser (not headless)
HEADED=1 pytest tests/e2e/scenarios/test_connection.py -v

Architecture

Tests start two subprocesses:

Mock LLM (mock_llm.py) -- fake OpenAI-compat server with canned responses
IronClaw -- the real binary with gateway enabled, pointing to the mock LLM

Then Playwright drives a headless Chromium browser against the gateway, making DOM assertions.

Scenarios

File	What it tests
`test_connection.py`	Auth, tab navigation, connection status
`test_chat.py`	Send message, SSE streaming, response rendering
`test_skills.py`	ClawHub search, skill install/remove

Adding new scenarios

Create tests/e2e/scenarios/test_<name>.py
Use the page fixture for a fresh browser page
Use selectors from helpers.py (update SEL dict if new elements are needed)
Keep tests deterministic -- use the mock LLM, not real providers