3 people de214c23e0 feat: add LLM_CHEAP_MODEL for generic smart routing across all backends (#1081) ...

* feat: add LLM_CHEAP_MODEL for generic smart routing across all backends

Add generic cheap model support that works with any LLM backend, not just
NearAI. New env vars: LLM_CHEAP_MODEL (cheap model for any backend) and
SMART_ROUTING_CASCADE (top-level cascade flag).

Resolution order: LLM_CHEAP_MODEL > NEARAI_CHEAP_MODEL (backward compat).
Registry-based providers (OpenAI, Anthropic, Groq, etc.) clone their
RegistryProviderConfig with the cheap model swapped in. Bedrock returns
an explicit error (not yet supported). All error paths use ok_or_else
with proper LlmError variants -- no unwrap/expect in production code.

* refactor: address Gemini review — remove unnecessary async, extract cheap_model_name()

- Remove async from create_cheap_provider_for_backend() and
  create_cheap_llm_provider() — neither contains .await calls
- Extract duplicated cheap model resolution logic into
  LlmConfig::cheap_model_name() helper method (DRY)
- Revert tests from tokio::test async back to sync #[test]
- Add test_cheap_model_name_resolution() unit test for the helper

---------

Co-authored-by: SMKRV <[email protected]>

2026-03-16 08:06:51 +00:00

..

agent

Fix subagent monitor events being treated as user input (#1173)

2026-03-15 06:00:19 +00:00

channels

fix(extensions): fix lifecycle bugs + comprehensive E2E tests (#1070)

2026-03-12 16:36:08 -07:00

cli

style: fix formatting in cli/mod.rs and mcp/auth.rs (#1071)

2026-03-12 13:21:49 -07:00

config

feat: add LLM_CHEAP_MODEL for generic smart routing across all backends (#1081)

2026-03-16 08:06:51 +00:00

context

fix: resolve deferred review items from PRs #883, #848, #788 (#915)

2026-03-11 07:12:45 +00:00

db

fix: resolve bug_bash UX/logging issues (#1054 #1055 #1058) (#1072)

2026-03-12 15:27:50 -07:00

document_extraction

feat: WASM channel attachments with LLM pipeline integration (#596)

2026-03-07 18:01:40 +00:00

estimation

Add automated QA: schema validator, CI matrix, Docker build, and P1 test coverage (#353)

2026-02-27 09:09:45 +04:00

evaluation

chore: remove dead code (#648) (#703)

2026-03-08 08:26:04 +00:00

extensions

fix(extensions): fix lifecycle bugs + comprehensive E2E tests (#1070)

2026-03-12 16:36:08 -07:00

history

fix(agent): block thread_id-based context pollution across users (#760)

2026-03-11 16:52:31 -07:00

hooks

feat: extend lifecycle hooks with declarative bundles (#176)

2026-02-19 23:00:54 +00:00

import

fix(ci): WASM WIT compat sqlite3 duplicate symbol conflict (#953)

2026-03-11 11:48:24 -07:00

llm

feat: add LLM_CHEAP_MODEL for generic smart routing across all backends (#1081)

2026-03-16 08:06:51 +00:00

observability

feat: 10 infrastructure improvements from zeroclaw (#126)

2026-02-17 19:35:56 +00:00

orchestrator

feat(orchestrator): read ORCHESTRATOR_PORT env var for configurable API port (#1113)

2026-03-16 07:58:48 +00:00

pairing

fix(security): use OsRng for all security-critical key and token generation (#519)

2026-03-06 02:36:38 +00:00

registry

fix(ci): disambiguate WASM bundle filenames to prevent tool/channel collision (#964)

2026-03-11 17:02:11 -07:00

safety

refactor: extract safety module into ironclaw_safety crate (#1024)

2026-03-12 17:54:24 +00:00

sandbox

fix(security): require explicit SANDBOX_ALLOW_FULL_ACCESS to enable FullAccess policy (#967)

2026-03-12 00:57:05 +00:00

secrets

refactor: centralize test credential constants into testing::credentials (#829)

2026-03-10 13:25:32 -07:00

setup

feat: add LLM_CHEAP_MODEL for generic smart routing across all backends (#1081)

2026-03-16 08:06:51 +00:00

skills

feat(skills): exclude_keywords veto in skill activation scoring (#688)

2026-03-08 20:23:41 -07:00

testing

feat(routines): enable tool access in lightweight routine execution (#257) (#730)

2026-03-12 11:38:27 -07:00

tools

Fix subagent monitor events being treated as user input (#1173)

2026-03-15 06:00:19 +00:00

transcription

feat(transcription): add Chat Completions API provider for audio transcription (#1130)

2026-03-16 07:57:58 +00:00

tunnel

fix: drain tunnel pipes to prevent zombie process (#735)

2026-03-11 16:53:38 -07:00

webhooks

Add generic host-verified /webhook/tools/{tool} ingress (#757)

2026-03-11 03:36:25 +00:00

worker

fix: resolve deferred review items from PRs #883, #848, #788 (#915)

2026-03-11 07:12:45 +00:00

workspace

chore: periodic sync main into staging (resolved conflicts) (#1098)

2026-03-12 21:32:19 -07:00

app.rs

fix: add tool_info schema discovery for WASM tools (#1086)

2026-03-12 16:30:38 -07:00

boot_screen.rs

Fix skills system: enable by default, fix registry and install (#300)

2026-02-23 10:04:02 -08:00

bootstrap.rs

fix(security): make unsafe env::set_var calls safe with explicit invariants (#968)

2026-03-12 00:59:58 +00:00

error.rs

refactor: make src/llm/ self-contained for crate extraction (#767)

2026-03-09 22:31:17 +00:00

lib.rs

Add generic host-verified /webhook/tools/{tool} ingress (#757)

2026-03-11 03:36:25 +00:00

main.rs

feat(cli): add cron subcommand for managing scheduled routines (#1017)

2026-03-12 12:47:23 -07:00

NETWORK_SECURITY.md

fix: Network Security Findings (#201)

2026-02-19 22:01:57 +00:00

service.rs

fix(service): set CLI_ENABLED=false in macOS launchd plist (#1079)

2026-03-12 15:26:37 -07:00

settings.rs

fix: job token budget, iteration cap → Failed, web cancel stops worker (#788)

2026-03-10 02:19:56 +00:00

timezone.rs

feat(timezone): add timezone-aware session context (#671)

2026-03-08 08:01:56 +00:00

tracing_fmt.rs

refactor: encapsulate leaked abstractions into owning modules (#778)

2026-03-10 04:39:51 +00:00

util.rs

merge: resolve conflicts for PR #800 and #822 into staging (#881)

2026-03-10 11:19:23 -07:00