prompt: Hello! Introduce yourself briefly.

response_matches: (?i)(hello|hi|hey|assistant|agent|help)


prompt: What is 47 * 23? Reply with just the number.


prompt: Use the echo tool to repeat the message: 'Spot check passed'


prompt: What is the current date and time? Use the time tool.


prompt: Given this JSON: {"users": [{"name": "Alice"}, {"name": "Bob"}]}, use the json tool to extract the second user's name.


prompt: Use the shell tool to run: echo 'benchmark test'


prompt: Use the list_dir tool to list the contents of the /tmp directory.


prompt: Write the text 'ironclaw spot check' to /tmp/ironclaw_spot_test.txt using the write_file tool, then read it back using the read_file tool and tell me what it says.


prompt: Run a shell command to output the JSON string '{"status": "ok", "code": 200}', then use the json tool to extract the status field.


prompt: First get the current time using the time tool, then use the echo tool to repeat it back.

tools_used: time echo


prompt: What is the capital of France? Answer directly without using any tools.


prompt: What time is it right now?

tools_not_used: shell echo


prompt: Use the json tool to validate whether this is valid JSON: {"key": "value", "num": 42}


prompt:
Save these daily tasks to /tmp/bench-daily.md:
1. Review PR #42
2. Update API docs
3. Deploy to staging
Then read the file back and confirm what was saved.

response_contains:
PR #42
docs
staging


prompt: Write a reminder to /tmp/bench-reminder.md: Dentist appointment on March 5th at 2pm with Dr. Smith. Then read the file back and tell me when the appointment is and with whom.

response_contains:
March 5
Smith


prompt:
Save these meeting notes to /tmp/bench-meeting.md:
Meeting: Project Phoenix sync
Attendees: Alice, Bob, Carol
Decisions:
- Launch date: April 15th
- Budget: $50k approved
- Bob owns frontend, Carol owns backend
Then read the file back and tell me who owns the frontend and what the launch date is.

response_contains:
Bob
frontend
April 15


prompt: Write 'Morning standup: discussed blockers on auth service' to /tmp/bench-log.md. Then append a new line 'Afternoon: resolved API timeout issue in payment gateway' to the same file. Finally read the full file and summarize what happened.

response_contains: auth timeout


prompt:
Save the following project context to /tmp/bench-project.md:
Project Ironclad uses Rust for the backend, React for the frontend, and PostgreSQL for the database. The API is deployed on AWS ECS. The lead developer is Sarah and the PM is James. The sprint ends on March 20th.
Then read it back and answer: What database does the project use, and who is the PM?

response_contains: PostgreSQL James


prompt:
Write the following to /tmp/bench-todo.md:
- [ ] Fix login bug (priority: HIGH)
- [ ] Write unit tests (priority: medium)
- [ ] Update README (priority: low)
- [ ] Security audit (priority: HIGH)
Then read it back and tell me which tasks are high priority.

response_contains:
login bug
security audit


prompt: Save 'Team standup at 9am, then client demo at 2pm' to /tmp/bench-monday.md and 'Sprint retro at 11am, team lunch at noon' to /tmp/bench-tuesday.md. Then read both files and tell me what's happening on Tuesday.

response_contains: retro lunch


prompt: Write 'User preference: dark mode, timezone: PST, language: English' to /tmp/bench-prefs.md. Then read it back, and rewrite the file changing the timezone to EST. Finally read it one more time and confirm the timezone is now EST.