* perf: build system prompt once per turn, skip tools on force-text, fix nudge role (#565)
Three fixes to agentic loop prompt handling:
1. Build system prompt once per turn instead of every tool iteration.
`build_system_prompt_with_tools` is now pub; callers pass the result
via `ReasoningContext::system_prompt` to avoid rebuilding ~1,500 tokens
per iteration.
2. Skip `## Available Tools` section when `force_text = true`. The
dispatcher passes a no-tools prompt variant on the final iteration,
saving ~460 tokens and removing misleading instructions.
3. Change nudge message from `Role::System` to `Role::User`. A second
system message mid-conversation is unsupported by most providers.
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* fix: revert nudge role change to keep ChatMessage::system
Copilot review correctly identified that using Role::User for the nudge
breaks compact_messages_for_retry, which uses rposition for Role::User
to find the last real user message. Role::Assistant would cause
back-to-back assistant messages. Since no production issues were reported
with the original system role, revert to ChatMessage::system.
[skip-regression-check]
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
* fix: address PR review — omit tool guidance when tools empty, rename shadowed var
- Conditionalize "Call tools…" guidelines and "## Tool Call Style" section
in the system prompt so they are only included when tools are non-empty.
Previously the force-text (no-tools) prompt still contained misleading
tool-calling instructions. (Copilot review comment)
- Rename `system_prompt` → `cached_prompt` in dispatcher to avoid shadowing
the earlier workspace identity `system_prompt` variable. (Copilot review)
- Add regression tests: `test_system_prompt_with_tools_contains_tool_guidance`
and extended assertions in `test_system_prompt_without_tools_omits_tools_section`.
Co-Authored-By: Claude Opus 4.6 <[email protected]>
---------
Co-authored-by: Claude Opus 4.6 (1M context) <[email protected]>
Co-authored-by: [email protected] <[email protected]>
* test: add unit tests across 20 modules for coverage push
Add 300+ unit tests covering config, context, evaluation, extensions,
LLM, secrets, tools/builder, and tools/mcp modules. All tests are
pure unit tests (no mocks) exercising serde roundtrips, edge cases,
error paths, and business logic.
Co-Authored-By: Claude Opus 4.6 <[email protected]>
* fix(tests): replace hardcoded /tmp paths with tempfile::tempdir
The e2e_metrics_test::test_metrics_collected_from_tool_trace test was
failing because setup_test_dir() created /tmp/ironclaw_metrics_test but
the fixture referenced /tmp/ironclaw_e2e_test/hello.txt (path mismatch).
Added LlmTrace::replace_paths() to substitute fixture paths at runtime,
then converted all 12 test files from hardcoded /tmp/ironclaw_* paths to
tempfile::tempdir(). Tests are now isolated, parallel-safe, and leave no
debris on disk.
Regression test: test_metrics_collected_from_tool_trace now passes
consistently regardless of prior /tmp state.
Co-Authored-By: Claude Opus 4.6 <[email protected]>
---------
Co-authored-by: Claude Opus 4.6 <[email protected]>
* test: add 29 E2E trace tests for worker, threading, tools, workspace, and routines (#571-575)
Add comprehensive E2E test coverage across five test files:
- e2e_worker_coverage (7 tests): parallel tool calls, error feedback, unknown tools,
invalid params, rate limiting, iteration limits, planning mode
- e2e_thread_scheduling (3 tests + 2 deferred): multi-turn state, undo/redo, concurrent dispatch
- e2e_builtin_tool_coverage (8 tests): time parse/diff/invalid, routine CRUD/history,
job create/status/list/cancel, HTTP replay
- e2e_workspace_coverage (6 tests): chunked search, multi-doc search, hybrid search,
directory tree, document lifecycle, identity in system prompt
- e2e_routine_heartbeat (5 tests): cron triggers, event matching, cooldown enforcement,
heartbeat findings, empty checklist skip
Infrastructure: extend TestRig with database/workspace/trace_llm accessors, register
job and routine tools by default, add with_extra_tools() for custom stub tools.
Includes 24 JSON trace fixtures across worker/, threading/, tools/, and workspace/.
Co-Authored-By: Claude Opus 4.6 <[email protected]>
* fix: use 6-field cron format in routine_create_list fixture
The cron 0.13 crate accepts both 6 and 7 fields, but the routine_create
tool documents 6-field format. Align the fixture to match.
[skip-regression-check]
Co-Authored-By: Claude Opus 4.6 <[email protected]>
* fix: eliminate vacuous passes and silently-skipped assertions in E2E tests
- job_create_status: replace job_status (needs dynamic UUID) with list_jobs,
assert both succeed via completed() not just started()
- job_list_cancel: keep cancel_job but explicitly assert it fails with
invalid canned job_id "latest", verify create_job + list_jobs succeed
- unknown_tool_name: add !is_empty() guard before .all() to prevent
vacuous pass on empty iterator
- workspace tests: change `if let Some(ws)` to `.expect()` so assertions
are never silently skipped when workspace/trace_llm is available
[skip-regression-check]
Co-Authored-By: Claude Opus 4.6 <[email protected]>
* feat: add template substitution to TraceLlm for dynamic tool result forwarding
Add {{call_id.json_path}} template syntax to trace fixtures, enabling
tool results from one step to flow into subsequent steps' arguments.
TraceLlm extracts variables from Role::Tool messages (stripping the
safety layer's <tool_output> XML wrapper and unescaping entities) and
substitutes them in canned tool_call arguments before returning.
This fixes job_create_status and job_list_cancel tests to properly test
job_status and cancel_job with real dynamic UUIDs from create_job,
instead of using invalid canned IDs that silently failed.
Also adds tool result content assertions to job_create_status to verify
the actual tool output contains expected data (job_id, title).
[skip-regression-check]
Co-Authored-By: Claude Opus 4.6 <[email protected]>
* fix: address PR review feedback on E2E tests
- undo_redo_cycle: assert exactly 3 turns instead of >= 2
- tool_error_feedback: use tempfile::tempdir() instead of hardcoded /tmp path,
patch fixture path at runtime for CI portability
- worker_timeout → iteration_limit: rename to accurately describe what's tested
- post_plan_work_remaining → simple_echo_flow: rename, test doesn't exercise planning
- identity_in_system_prompt: seed IDENTITY.md before test, assert system prompt
contains the seeded content instead of just checking Role::System exists
[skip-regression-check]
Co-Authored-By: Claude Opus 4.6 <[email protected]>
* fix: strengthen workspace E2E test assertions per PR review
- write_chunk_search: assert memory_search was called and returned
payment/architecture-related results
- multi_document_search: assert memory_search was called for
cross-document search
- hybrid_search_with_embeddings: assert both memory_write and
memory_search were called to confirm write-then-search pipeline
- directory_tree: assert tree output contains expected alpha/beta
project paths
[skip-regression-check]
Co-Authored-By: Claude Opus 4.6 <[email protected]>
---------
Co-authored-by: Claude Opus 4.6 <[email protected]>
OutBack Dingo