optimclaw/COVERAGE_PLAN.md

IronClaw Coverage Plan: 63.3% to 95%

Generated 2025-03-06 from Codecov

Current State

Metric	Value
Current coverage	48,571 / 76,694 lines = 63.33%
Target	72,859 / 76,694 lines = 95.0%
Gap	24,288 lines need coverage
Files >= 95%	43 / 239
Files < 95%	196 (27,872 total misses)

Module Summary

Sorted by uncovered lines (descending):

Module	Lines	Hits	Miss	Coverage	Priority
channels/	14,079	8,677	5,402	61.6%	P0
tools/	13,445	9,407	4,038	70.0%	P1
agent/	9,152	6,096	3,056	66.6%	P0
setup/	3,005	462	2,543	15.4%	P1
extensions/	3,540	1,298	2,242	36.7%	P0
cli/	2,834	697	2,137	24.6%	P1
history/	1,626	0	1,626	0.0%	P0
llm/	7,029	5,776	1,253	82.2%	P2
(root)	4,122	3,121	1,001	75.7%	P2
worker/	1,274	480	794	37.7%	P1
sandbox/	1,615	897	718	55.5%	P2
registry/	1,588	1,107	481	69.7%	P2
db/	921	441	480	47.9%	P1
workspace/	2,006	1,584	422	79.0%	P2
orchestrator/	1,199	795	404	66.3%	P2
config/	1,464	1,095	369	74.8%	P2
hooks/	1,379	1,081	298	78.4%	P2
secrets/	687	407	280	59.2%	P2
skills/	1,714	1,585	129	92.5%	P3
context/	693	586	107	84.6%	P3
estimation/	467	369	98	79.0%	P3
safety/	1,424	1,337	87	93.9%	P3
evaluation/	226	152	74	67.3%	P3
pairing/	498	446	52	89.6%	P3
tunnel/	391	368	23	94.1%	P3
observability/	316	307	9	97.2%	Done

Top 40 Files by Uncovered Lines

These files account for the vast majority of the coverage gap:

File	Lines	Miss	Coverage	Lines to 95%
src/extensions/manager.rs	2,404	2,083	13.3%	1,962
src/setup/wizard.rs	2,150	1,789	16.8%	1,681
src/history/store.rs	1,486	1,486	0.0%	1,411
src/channels/web/server.rs	1,985	993	50.0%	893
src/channels/wasm/wrapper.rs	2,237	934	58.2%	822
src/agent/thread_ops.rs	1,044	763	26.9%	710
src/cli/tool.rs	757	735	2.9%	697
src/setup/channels.rs	645	596	7.6%	563
src/agent/commands.rs	587	587	0.0%	557
src/main.rs	740	522	29.4%	485
src/channels/web/handlers/jobs.rs	513	456	11.1%	430
src/tools/builder/core.rs	524	456	13.0%	429
src/worker/job.rs	1,078	467	56.7%	413
src/channels/web/handlers/chat.rs	564	417	26.1%	388
src/tools/wasm/wrapper.rs	1,005	436	56.6%	385
src/channels/signal.rs	1,814	472	74.0%	381
src/tools/mcp/auth.rs	472	378	19.9%	354
src/worker/container.rs	350	330	5.7%	312
src/tools/builtin/job.rs	1,014	359	64.6%	308
src/cli/mcp.rs	322	319	0.9%	302
src/cli/oauth_defaults.rs	730	335	54.1%	298
src/llm/nearai_chat.rs	854	340	60.2%	297
src/sandbox/container.rs	407	317	22.1%	296
src/tools/mcp/client.rs	341	291	14.7%	273
src/registry/installer.rs	765	311	59.3%	272
src/orchestrator/job_manager.rs	405	270	33.3%	249
src/channels/web/handlers/routines.rs	249	249	0.0%	236
src/agent/scheduler.rs	559	263	53.0%	235
src/tools/wasm/storage.rs	296	243	17.9%	228
src/channels/repl.rs	233	233	0.0%	221
src/llm/session.rs	413	242	41.4%	221
src/worker/claude_bridge.rs	629	247	60.7%	215
src/agent/agent_loop.rs	523	234	55.2%	207
src/worker/api.rs	258	207	19.8%	194
src/sandbox/proxy/http.rs	307	192	37.5%	176
src/channels/wasm/storage.rs	182	182	0.0%	172
src/cli/registry.rs	177	177	0.0%	168
src/llm/reasoning.rs	1,163	219	81.2%	160
src/tools/builder/testing.rs	308	174	43.5%	158
src/db/postgres.rs	166	166	0.0%	157

---

Tier 1 -- High-Impact Unit Tests (~8,500 lines)

Pure logic, serialization, and database queries testable in isolation without real infrastructure. Highest coverage gain per unit of effort.

src/history/store.rs -- 0% -> 95% (+1,411 lines)

PostgreSQL repository layer (conversations, jobs, actions, LLM calls, estimation snapshots). Test query construction and result mapping. Can use the libSQL backend as a real in-memory database or test doubles for the Database trait.

Tests to write:

• test_store_conversation_crud -- create, read, update, delete conversations
• test_store_job_lifecycle -- insert job, update status through state machine
• test_store_action_recording -- record and query job actions
• test_store_llm_call_tracking -- insert and aggregate LLM call records
• test_store_estimation_snapshots -- save and retrieve estimation data

src/history/analytics.rs -- 0% -> 95% (+133 lines)

Aggregation queries (JobStats, ToolStats). Test the query builders and result deserialization.

Tests to write:

• test_job_stats_aggregation -- verify counts, durations, success rates
• test_tool_stats_ranking -- verify tool usage frequency sorting
• test_analytics_empty_db -- graceful handling of no data

src/extensions/manager.rs -- 13.3% -> 95% (+1,962 lines)

Largest single file gap. Extension lifecycle orchestration (install, auth, activate, remove), config parsing, and state transitions.

Tests to write:

• test_extension_install_from_manifest -- parse manifest, create extension record
• test_extension_auth_flow -- OAuth token setup, credential storage
• test_extension_activate_deactivate -- state transitions, tool registration
• test_extension_remove_cleanup -- remove extension, clean up artifacts
• test_extension_config_validation -- reject invalid configs, handle defaults
• test_extension_list_filtering -- filter by status, type, search query
• test_extension_capability_check -- verify required capabilities before activation

src/extensions/discovery.rs -- 27.8% -> 95% (+125 lines)

Extension discovery from filesystem and registry.

Tests to write:

• test_discover_local_extensions -- scan directory, parse manifests
• test_discover_skip_invalid -- gracefully skip malformed extension dirs
• test_discover_dedup -- handle duplicate extensions across paths

src/tools/builder/core.rs -- 13% -> 95% (+429 lines)

BuildRequirement, SoftwareType, Language types and project scaffolding.

Tests to write:

• test_build_requirement_parsing -- deserialize from JSON
• test_scaffold_project_structure -- verify generated file tree
• test_language_detection -- detect language from file extensions
• test_software_type_constraints -- validate type-specific requirements

src/tools/builder/testing.rs -- 43.5% -> 95% (+158 lines)

Test harness integration for built tools.

Tests to write:

• test_harness_setup_teardown -- lifecycle of test environment
• test_harness_run_tests -- execute tests and capture results
• test_harness_failure_reporting -- verify error details on test failure

src/tools/mcp/auth.rs -- 19.9% -> 95% (+354 lines)

OAuth token management for MCP servers.

Tests to write:

• test_token_refresh_on_expiry -- auto-refresh when token expires
• test_token_header_injection -- correct Authorization header format
• test_token_persistence -- save/load tokens across restarts
• test_oauth_pkce_flow -- code verifier/challenge generation
• test_auth_config_parsing -- parse various auth config formats

src/tools/mcp/client.rs -- 14.7% -> 95% (+273 lines)

JSON-RPC client for MCP protocol.

Tests to write:

• test_jsonrpc_request_serialization -- correct JSON-RPC 2.0 format
• test_jsonrpc_response_parsing -- handle success, error, and batch responses
• test_jsonrpc_error_codes -- map MCP error codes to ToolError
• test_tool_list_discovery -- parse tools/list response
• test_tool_call_roundtrip -- serialize call, parse result

src/tools/wasm/storage.rs -- 17.9% -> 95% (+228 lines)

WASM tool persistence (store, load, delete, list).

Tests to write:

• test_wasm_tool_store_roundtrip -- store and retrieve tool binary + metadata
• test_wasm_tool_delete -- remove tool and verify gone
• test_wasm_tool_list_filtering -- filter by name, capability
• test_wasm_tool_update_metadata -- update without re-uploading binary

src/tools/wasm/wrapper.rs -- 56.6% -> 95% (+385 lines)

Tool trait wrapper for WASM modules.

Tests to write:

• test_wasm_param_marshalling -- JSON params to WASM component model types
• test_wasm_output_conversion -- WASM return values to ToolOutput
• test_wasm_error_propagation -- WASM traps to ToolError
• test_wasm_fuel_exhaustion -- verify fuel limit enforcement
• test_wasm_memory_limit -- verify memory ceiling

src/tools/wasm/loader.rs -- 62.4% -> 95% (+156 lines)

WASM tool discovery from filesystem.

Tests to write:

• test_loader_scan_directory -- find .wasm files with capabilities.json
• test_loader_skip_invalid -- skip files without valid WIT exports
• test_loader_cache_invalidation -- reload when file changes

src/tools/builtin/job.rs -- 64.6% -> 95% (+308 lines)

Job management tools (CreateJob, ListJobs, JobStatus, CancelJob).

Tests to write:

• test_create_job_params -- validate required/optional parameters
• test_list_jobs_formatting -- verify output structure
• test_job_status_transitions -- query status at each state
• test_cancel_job_running -- cancel an in-progress job
• test_cancel_job_completed -- error on already-completed job

src/secrets/store.rs -- 48.1% -> 95% (+145 lines)

Encrypted secret storage.

Tests to write:

• test_secret_store_roundtrip -- store encrypted, retrieve decrypted
• test_secret_update -- overwrite existing secret
• test_secret_delete -- remove and verify inaccessible
• test_secret_list_redacted -- list shows names but not values

src/llm/session.rs -- 41.4% -> 95% (+221 lines)

Session token management with auto-renewal.

Tests to write:

• test_session_token_parsing -- parse sess_xxx format
• test_session_expiry_detection -- detect expired tokens
• test_session_auto_renewal -- trigger renewal before expiry
• test_session_concurrent_renewal -- only one renewal in flight

src/llm/nearai_chat.rs -- 60.2% -> 95% (+297 lines)

NEAR AI Chat Completions provider.

Tests to write:

• test_nearai_request_building -- correct endpoint, headers, body
• test_nearai_response_parsing -- parse streaming and non-streaming responses
• test_nearai_tool_message_flattening -- tool messages flattened to text
• test_nearai_auth_modes -- session token vs API key auth
• test_nearai_error_handling -- rate limits, auth failures, server errors

src/llm/mod.rs -- 53.7% -> 95% (+112 lines)

Provider factory and backend selection.

Tests to write:

• test_provider_factory_nearai -- select NEAR AI from config
• test_provider_factory_openai -- select OpenAI from config
• test_provider_factory_ollama -- select Ollama from config
• test_provider_factory_invalid -- error on unknown backend

src/llm/reasoning.rs -- 81.2% -> 95% (+160 lines)

Planning, tool selection, evaluation logic.

Tests to write:

• test_reasoning_step_parsing -- parse planning steps from LLM output
• test_tool_selection_scoring -- rank tools by relevance
• test_evaluation_rubric -- score completions against criteria
• test_reasoning_with_no_tools -- handle tool-less responses

src/db/postgres.rs -- 0% -> 95% (+157 lines)

PostgreSQL backend delegation to Store + Repository.

Tests to write:

• test_postgres_backend_delegates -- verify delegation pattern (trait-level)
• test_postgres_connection_config -- TLS, pool size, timeout parsing

src/workspace/mod.rs -- 75.9% -> 95% (+109 lines)

Memory operations (write, read, search, tree).

Tests to write:

• test_workspace_write_read -- write document, read it back
• test_workspace_search_hybrid -- FTS + vector search via RRF
• test_workspace_tree -- directory listing of memory filesystem
• test_workspace_overwrite -- update existing document

src/workspace/embeddings.rs -- 35.1% -> 95% (~100 lines)

Embedding provider abstraction.

Tests to write:

• test_embedding_dimension_handling -- verify dimension config
• test_embedding_batch_processing -- batch multiple chunks
• test_embedding_provider_fallback -- graceful degradation when unavailable

---

Tier 2 -- Trace Tests (~7,000 lines)

End-to-end tests that exercise the agent loop, worker, scheduler, and dispatcher by replaying LLM traces through TestRig (see tests/support/test_rig.rs). Each trace test covers multiple modules simultaneously, making them high-leverage.

Each trace test needs:

1. A JSON fixture in tests/fixtures/llm_traces/
2. A test file in tests/ using TestRigBuilder

Trace: Thread Operations

Covers: agent/thread_ops.rs (+710 lines)

Test thread creation, listing, switching, and deletion via trace replay.

Fixture: thread_operations.json Tests:

• test_thread_create_and_switch -- create thread, switch to it, verify context
• test_thread_list -- list all threads, verify metadata
• test_thread_delete -- delete thread, verify removal
• test_thread_switch_nonexistent -- error handling for missing thread

Trace: Agent Commands

Covers: agent/commands.rs (+557 lines)

Test slash commands through the agent loop.

Fixture: agent_commands.json Tests:

• test_command_help -- /help returns command list
• test_command_clear -- /clear resets conversation
• test_command_compact -- /compact triggers summarization
• test_command_undo_redo -- /undo then /redo restores state
• test_command_status -- /status shows agent state

Trace: Worker Multi-Turn Execution

Covers: worker/job.rs (+413 lines), agent/agent_loop.rs (+207 lines)

Test multi-turn tool calling, error recovery, and completion flows.

Fixture: worker_multi_turn.json Tests:

• test_worker_sequential_tools -- call tool A, then tool B based on A's result
• test_worker_tool_error_recovery -- tool fails, agent retries or adapts
• test_worker_max_turns -- verify turn limit enforcement

Trace: Scheduler Parallel Jobs

Covers: agent/scheduler.rs (+235 lines)

Test parallel job dispatch and completion tracking.

Fixture: scheduler_parallel.json Tests:

• test_scheduler_parallel_dispatch -- dispatch 3 jobs, all complete
• test_scheduler_job_dependency -- job B waits for job A
• test_scheduler_stuck_detection -- detect and recover stuck job

Trace: Dispatcher Skill Selection

Covers: agent/dispatcher.rs (+153 lines)

Test skill-aware routing and tool attenuation.

Fixture: dispatcher_skills.json Tests:

• test_dispatcher_skill_match -- match message to skill, inject prompt
• test_dispatcher_tool_attenuation -- installed skill loses dangerous tools
• test_dispatcher_no_skill -- fallback when no skill matches

Trace: Routine Execution

Covers: agent/routine_engine.rs (~80 lines), agent/routine.rs (~40 lines)

Test cron tick and event-triggered routine execution.

Fixture: routine_execution.json Tests:

• test_routine_cron_trigger -- routine fires on schedule
• test_routine_event_trigger -- routine fires on matching event
• test_routine_guardrails -- routine respects policy constraints

Trace: Compaction and Context Pressure

Covers: agent/compaction.rs (~50 lines), agent/context_monitor.rs (~30 lines)

Test turn summarization and memory pressure detection.

Fixture: compaction_flow.json Tests:

• test_compaction_triggers_at_threshold -- summarize when context exceeds limit
• test_compaction_preserves_recent -- keep recent turns intact
• test_context_pressure_warning -- emit warning at high usage

Trace: Job Tool Coverage

Covers: tools/builtin/job.rs (+308 lines), tools/builtin/skill_tools.rs (+110 lines)

Test job and skill management tools through agent execution.

Fixture: job_and_skill_tools.json Tests:

• test_create_and_list_jobs -- create job, list shows it
• test_job_status_query -- query status of running job
• test_skill_list_and_search -- list local skills, search registry

Trace: Memory Tools

Covers: tools/builtin/memory.rs (~20 lines), workspace/ (+109 lines)

Test memory operations through agent tool calls.

Fixture: memory_tools.json Tests:

• test_memory_write_and_search -- write doc, search finds it
• test_memory_read_by_path -- read specific document
• test_memory_tree -- list memory filesystem structure

Trace: Extension Management

Covers: tools/builtin/extension_tools.rs (~40 lines)

Test extension lifecycle via agent tool calls.

Fixture: extension_management.json Tests:

• test_extension_install_via_tool -- agent installs an extension
• test_extension_auth_via_tool -- agent configures auth
• test_extension_activate_via_tool -- agent activates extension

Trace: Self-Repair

Covers: agent/self_repair.rs (~40 lines)

Test stuck job detection and recovery.

Fixture: self_repair.json Tests:

• test_stuck_job_detected -- job stuck for > threshold triggers repair
• test_stuck_job_recovered -- recovery restarts job successfully
• test_stuck_job_fails_permanently -- recovery fails, job marked failed

Trace: Heartbeat

Covers: agent/heartbeat.rs (+80 lines)

Test periodic proactive execution.

Fixture: heartbeat.json Tests:

• test_heartbeat_periodic_fire -- heartbeat triggers at interval
• test_heartbeat_reads_checklist -- reads HEARTBEAT.md, processes items
• test_heartbeat_notification -- sends notification on findings

---

Tier 3 -- Web/Channel Handler Tests (~4,500 lines)

Test HTTP handlers and SSE/WS endpoints using axum_test or tower::ServiceExt::oneshot with a real router and in-memory database.

src/channels/web/server.rs -- 50% -> 95% (+893 lines)

The single biggest web gap. 40+ API endpoints.

Tests to write:

• test_api_health -- GET /health returns 200
• test_api_chat_submit -- POST /api/chat sends message
• test_api_jobs_list -- GET /api/jobs returns job list
• test_api_jobs_create -- POST /api/jobs creates job
• test_api_routines_crud -- full CRUD cycle for routines
• test_api_settings_get_set -- GET/PUT settings
• test_api_memory_search -- POST /api/memory/search
• test_api_extensions_list -- GET /api/extensions
• test_api_skills_list -- GET /api/skills
• test_api_sse_connect -- SSE stream connects and receives events
• test_api_auth_required -- endpoints reject missing/bad tokens
• test_api_cors_headers -- verify CORS configuration

src/channels/web/handlers/chat.rs -- 26.1% -> 95% (+388 lines)

Chat message submission and SSE streaming.

Tests to write:

• test_chat_submit_message -- submit message, receive response
• test_chat_sse_stream -- verify SSE event format
• test_chat_thread_context -- messages scoped to thread
• test_chat_invalid_payload -- reject malformed requests

src/channels/web/handlers/jobs.rs -- 11.1% -> 95% (+430 lines)

Job CRUD endpoints.

Tests to write:

• test_jobs_list_empty -- empty list returns []
• test_jobs_create_and_get -- create, then GET by ID
• test_jobs_cancel -- cancel running job
• test_jobs_filter_by_status -- filter by pending/running/completed
• test_jobs_pagination -- limit/offset parameters

src/channels/web/handlers/routines.rs -- 0% -> 95% (+236 lines)

Routine CRUD endpoints.

Tests to write:

• test_routines_create -- POST creates routine
• test_routines_list -- GET lists all routines
• test_routines_update -- PUT updates routine config
• test_routines_delete -- DELETE removes routine
• test_routines_history -- GET history for a routine

src/channels/web/handlers/extensions.rs -- 0% -> 95% (+129 lines)

Extension management endpoints.

Tests to write:

• test_extensions_list -- list installed extensions
• test_extensions_install -- install from manifest URL
• test_extensions_activate -- activate/deactivate toggle
• test_extensions_remove -- remove installed extension

src/channels/web/handlers/memory.rs -- 0% -> 95% (+110 lines)

Memory/workspace endpoints.

Tests to write:

• test_memory_search -- search returns ranked results
• test_memory_write -- write a document
• test_memory_read -- read by path
• test_memory_tree -- tree returns filesystem structure

src/channels/web/handlers/settings.rs -- 0% -> 95% (+103 lines)

Settings endpoints.

Tests to write:

• test_settings_get -- retrieve current settings
• test_settings_update -- update individual setting
• test_settings_validation -- reject invalid setting values

src/channels/web/handlers/static_files.rs -- 0% -> 95% (+97 lines)

Static file serving.

Tests to write:

• test_static_index_html -- GET / serves index.html
• test_static_css_js -- serve CSS/JS with correct content types
• test_static_404 -- missing file returns 404

src/channels/wasm/wrapper.rs -- 58.2% -> 95% (+822 lines)

WASM channel wrapper (message routing, lifecycle).

Tests to write:

• test_wasm_channel_start -- initialize WASM channel module
• test_wasm_channel_message_routing -- route incoming message to WASM
• test_wasm_channel_response -- return WASM response to caller
• test_wasm_channel_error_handling -- handle WASM trap gracefully
• test_wasm_channel_lifecycle -- start, process, shutdown

src/channels/wasm/loader.rs -- 38.1% -> 95% (+141 lines)

WASM channel discovery.

Tests to write:

• test_channel_loader_scan -- find channel WASM modules
• test_channel_loader_validation -- reject invalid modules
• test_channel_loader_manifest -- parse channel capabilities

src/channels/wasm/storage.rs -- 0% -> 95% (+172 lines)

WASM channel state persistence.

Tests to write:

• test_channel_storage_save_load -- persist and restore channel state
• test_channel_storage_isolation -- per-channel state isolation
• test_channel_storage_cleanup -- remove state on channel uninstall

src/channels/signal.rs -- 74% -> 95% (+381 lines)

Signal protocol channel.

Tests to write:

• test_signal_message_send -- send encrypted message
• test_signal_message_receive -- decrypt incoming message
• test_signal_attachment_handling -- handle media attachments
• test_signal_group_message -- group chat routing
• test_signal_error_handling -- handle connection failures

src/channels/repl.rs -- 0% -> 95% (+221 lines)

Simple REPL channel.

Tests to write:

• test_repl_input_parsing -- parse user input lines
• test_repl_output_formatting -- format agent responses
• test_repl_multiline -- handle multi-line input
• test_repl_special_commands -- handle /quit, /help

---

Tier 4 -- CLI Tests (~2,100 lines)

CLI subcommands can be tested by invoking clap-parsed command structs directly or by calling the handler functions with constructed arguments.

src/cli/tool.rs -- 2.9% -> 95% (+697 lines)

Tool CLI (install, list, remove, build).

Tests to write:

• test_cli_tool_list -- list installed tools
• test_cli_tool_install_local -- install from local .wasm file
• test_cli_tool_install_registry -- install from registry
• test_cli_tool_remove -- remove installed tool
• test_cli_tool_build -- scaffold and build tool project
• test_cli_tool_info -- display tool details

src/cli/mcp.rs -- 0.9% -> 95% (+302 lines)

MCP server management CLI.

Tests to write:

• test_cli_mcp_list -- list configured MCP servers
• test_cli_mcp_add -- add MCP server config
• test_cli_mcp_remove -- remove MCP server config
• test_cli_mcp_tools -- list tools from MCP server
• test_cli_mcp_test_connection -- verify MCP server reachable

src/cli/oauth_defaults.rs -- 54.1% -> 95% (+298 lines)

OAuth default configurations.

Tests to write:

• test_oauth_defaults_loading -- load default OAuth configs
• test_oauth_url_construction -- build auth/token URLs
• test_oauth_scope_merging -- merge requested scopes with defaults
• test_oauth_provider_lookup -- lookup by provider name

src/cli/registry.rs -- 0% -> 95% (+168 lines)

Registry CLI commands.

Tests to write:

• test_cli_registry_search -- search for packages
• test_cli_registry_install -- install package from registry
• test_cli_registry_info -- display package details

src/cli/status.rs -- 0% -> 95% (+142 lines)

Status display commands.

Tests to write:

• test_cli_status_gathering -- collect system status info
• test_cli_status_formatting -- render status output
• test_cli_status_components -- check individual components

src/cli/memory.rs -- 15.5% -> 95% (+138 lines)

Memory CLI subcommands.

Tests to write:

• test_cli_memory_search -- search workspace from CLI
• test_cli_memory_write -- write document from CLI
• test_cli_memory_read -- read document from CLI
• test_cli_memory_tree -- display memory tree

src/cli/doctor.rs -- 28.7% -> 95% (+115 lines)

Diagnostic checks.

Tests to write:

• test_doctor_check_database -- verify DB connectivity check
• test_doctor_check_llm -- verify LLM provider check
• test_doctor_check_tools -- verify tool availability check
• test_doctor_report_format -- verify output format

src/cli/config.rs -- 36.5% -> 95% (~100 lines)

Config CLI subcommands.

Tests to write:

• test_cli_config_get -- read config value
• test_cli_config_set -- write config value
• test_cli_config_list -- list all config keys
• test_cli_config_reset -- reset to defaults

---

Tier 5 -- Setup/Infra Tests (~2,400 lines)

Hardest to test: interactive wizards, Docker, process spawning. Strategy: extract pure logic into testable functions, test the interactive parts by injecting mock input.

src/setup/wizard.rs -- 16.8% -> 95% (+1,681 lines)

7-step interactive onboarding wizard. Refactor to extract validation functions, step logic, and config generation into testable units.

Tests to write:

• test_wizard_step_validation -- each step validates input correctly
• test_wizard_config_generation -- generate config from wizard answers
• test_wizard_default_values -- verify sensible defaults
• test_wizard_skip_completed -- skip already-configured steps
• test_wizard_llm_backend_selection -- provider-specific config paths
• test_wizard_channel_setup -- channel configuration logic

src/setup/channels.rs -- 7.6% -> 95% (+563 lines)

Channel setup helpers.

Tests to write:

• test_channel_setup_defaults -- default channel configuration
• test_channel_setup_validation -- reject invalid channel configs
• test_channel_setup_telegram -- Telegram-specific setup logic
• test_channel_setup_signal -- Signal-specific setup logic
• test_channel_setup_webhook -- webhook URL validation

src/setup/prompts.rs -- 24.8% -> 95% (+147 lines)

Terminal prompt utilities.

Tests to write:

• test_prompt_select -- selection from list
• test_prompt_confirm -- yes/no confirmation
• test_prompt_secret -- masked input
• test_prompt_validation -- input validation rules

src/sandbox/container.rs -- 22.1% -> 95% (+296 lines)

Docker container lifecycle. Test command construction without actual Docker.

Tests to write:

• test_container_config_to_docker_args -- generate correct docker run args
• test_container_volume_mounts -- workspace mount configuration
• test_container_env_scrubbing -- sensitive env vars removed
• test_container_resource_limits -- CPU/memory limit args
• test_container_network_config -- proxy network setup

src/sandbox/manager.rs -- 59% -> 95% (+114 lines)

Sandbox orchestration.

Tests to write:

• test_sandbox_policy_enforcement -- policy to container config mapping
• test_sandbox_cleanup -- cleanup on job completion
• test_sandbox_concurrent_limit -- enforce max concurrent containers

src/sandbox/proxy/http.rs -- 37.5% -> 95% (+176 lines)

HTTP proxy for container network access.

Tests to write:

• test_proxy_allowlist_enforcement -- block disallowed domains
• test_proxy_credential_injection -- inject auth headers
• test_proxy_connect_tunnel -- HTTPS CONNECT method handling
• test_proxy_logging -- request/response logging

src/worker/container.rs -- 5.7% -> 95% (+312 lines)

Worker execution loop (runs inside containers).

Tests to write:

• test_worker_tool_dispatch -- dispatch tool call, return result
• test_worker_llm_interaction -- send prompt, receive response
• test_worker_turn_limit -- enforce max turns
• test_worker_error_propagation -- tool error surfaces to agent

src/worker/claude_bridge.rs -- 60.7% -> 95% (+215 lines)

Claude CLI bridge.

Tests to write:

• test_claude_command_construction -- build claude CLI command
• test_claude_output_parsing -- parse claude CLI JSON output
• test_claude_error_handling -- handle CLI crashes gracefully
• test_claude_config_injection -- inject config dir and model

src/worker/api.rs -- 19.8% -> 95% (+194 lines)

Worker HTTP client to orchestrator.

Tests to write:

• test_worker_api_request_building -- correct endpoint URLs and headers
• test_worker_api_response_parsing -- parse orchestrator responses
• test_worker_api_auth_token -- bearer token injection
• test_worker_api_retry -- retry on transient failures

src/main.rs -- 29.4% -> 95% (+485 lines)

Entry point and startup. Extract startup logic into testable functions.

Tests to write:

• test_cli_arg_parsing -- verify clap argument parsing
• test_startup_config_loading -- config from env + file
• test_startup_channel_selection -- select channels from config
• test_startup_feature_flags -- feature-gated code paths

---

Tier 6 -- Remaining Files to 95% (~2,000 lines)

Smaller files that each need a handful of additional tests.

File	Lines Needed	Test Focus
src/tools/builtin/skill_tools.rs	110	skill_list, skill_search, skill_install, skill_remove
src/hooks/bundled.rs	115	bundled hook execution, hook discovery
src/registry/installer.rs	272	package download, verification, installation
src/registry/artifacts.rs	72	artifact packaging, checksums
src/orchestrator/job_manager.rs	249	container lifecycle, job routing
src/orchestrator/api.rs	125	LLM proxy, event dispatch endpoints
src/app.rs	137	AppBuilder configuration, startup sequence
src/service.rs	120	service lifecycle, signal handling
src/config/channels.rs	55	channel config parsing
src/config/sandbox.rs	61	sandbox config parsing
src/config/tunnel.rs	43	tunnel config parsing
src/config/mod.rs	63	config merging, env override
src/config/database.rs	38	database URL parsing
src/evaluation/success.rs	34	success evaluator logic
src/evaluation/metrics.rs	40	metrics collection
src/context/manager.rs	57	concurrent job context isolation
src/context/memory.rs	36	action recording, conversation memory

---

Execution Priority

Maximize coverage gain per unit of effort:

Order	Category	Lines Gained	Effort
1	Trace tests (Tier 2)	~7,000	Medium (high leverage, each test covers many modules)
2	Unit tests for 0% files (Tier 1 subset)	~3,500	Low (pure logic, no infrastructure)
3	Web handler tests (Tier 3)	~4,500	Medium (axum_test + in-memory DB)
4	Extension/MCP/WASM unit tests (Tier 1 remainder)	~3,500	Medium
5	CLI subcommand tests (Tier 4)	~2,100	Low-Medium
6	Setup wizard extraction + tests (Tier 5)	~2,400	High (requires refactoring)
7	LLM provider tests (Tier 1 subset)	~800	Medium
8	Remaining small files (Tier 6)	~2,000	Low

Notes

• All trace tests require --features libsql and use TestRigBuilder from tests/support/
• Web handler tests can use axum::test helpers or build the router directly
• CLI tests should call handler functions directly, not shell out to the binary
• Setup wizard tests require extracting pure logic from interactive prompts first
• Sandbox/container tests should verify command construction, not run Docker
• Worker tests can use TraceLlm for the LLM provider, same as trace tests