mirror of
https://github.com/outbackdingo/optimclaw.git
synced 2026-08-27 08:00:17 +00:00
Improve test infrastructure: StubChannel, gateway helpers, security tests, search edge cases (#623)
* feat(testing): add StubChannel test double for Channel trait Adds StubChannel to src/testing.rs alongside StubLlm. Supports message injection via mpsc sender, response/status capture, and configurable health check toggling. Includes handle methods for use after ownership transfer to ChannelManager. Co-Authored-By: Claude Opus 4.6 <[email protected]> * feat(testing): wire StubChannel into TestHarnessBuilder Add with_stub_channel() builder method that creates a StubChannel pre-registered in a ChannelManager. Tests can inject messages via the sender and verify routing through the manager. The channel field on TestHarness is Optional, defaulting to None for backward compat. Co-Authored-By: Claude Opus 4.6 <[email protected]> * test: gate external-service tests behind integration feature flag Replace silent try_connect() skip pattern with explicit feature gating. cargo test now runs only self-contained tests. cargo test --features integration runs tests requiring PostgreSQL. Co-Authored-By: Claude Opus 4.6 <[email protected]> * test(channels): add ChannelManager unit tests using StubChannel Cover add/start_all stream merging, respond routing, unknown channel errors, health_check_all with mixed health, empty-channels error path, and injection channel merging -- all via StubChannel test double. Co-Authored-By: Claude Opus 4.6 <[email protected]> * docs: document test tier separation (unit/integration/live) Co-Authored-By: Claude Opus 4.6 <[email protected]> * ci: add architecture boundary check script Grep-based checks for three architecture boundaries: - Direct database driver usage (tokio_postgres/libsql) outside src/db/ - .unwrap()/.expect() in production code (warning only) - Direct std::env::var reads outside config layer (warning only) The DB driver check is a hard violation; the other two are warnings for gradual cleanup. Run with: bash scripts/check-boundaries.sh Co-Authored-By: Claude Opus 4.6 <[email protected]> * test(search): add RRF edge case tests for empty inputs, limits, and config modes Co-Authored-By: Claude Opus 4.6 <[email protected]> * test(security): add regression tests for skill installer ZIP and SSRF protections Add 11 regression tests covering the security controls in skill_tools: ZIP extraction safety: - Valid SKILL.md extraction works correctly - Non-SKILL.md entries are ignored (returns error) - Path traversal entries (../../SKILL.md) do not match - Nested path entries (subdir/SKILL.md) do not match - Oversized entries (>1MB uncompressed) are rejected SSRF prevention: - Loopback addresses (127.0.0.1) are blocked - Private ranges (10.x, 172.16.x, 192.168.x) are blocked - Link-local addresses (169.254.x) are blocked - Public IPs (8.8.8.8, 1.1.1.1) are allowed - IPv4-mapped IPv6 unwrapping logic works correctly - Metadata endpoints and .internal/.local hostnames are blocked - Normal hostnames (github.com, clawhub.dev) are allowed Also documents a known gap: url::Url::host_str() returns bracketed IPv6 addresses that std::net::IpAddr cannot parse, so IPv4-mapped IPv6 URLs currently bypass IP-based checks in validate_fetch_url. Co-Authored-By: Claude Opus 4.6 <[email protected]> * refactor(testing): extract TestGatewayBuilder to eliminate gateway test duplication Both ws_gateway_integration.rs and openai_compat_integration.rs manually constructed GatewayState with 19+ fields. Extracted to a shared builder in src/channels/web/test_helpers.rs that provides sensible defaults and lets tests override only what they need. Co-Authored-By: Claude Opus 4.6 <[email protected]> * docs: add implementation plans for testing batches 1 and 2 Co-Authored-By: Claude Opus 4.6 <[email protected]> * fix(security): close IPv6 SSRF bypass in validate_fetch_url validate_fetch_url used host_str() which returns bracketed IPv6 (e.g. "[::ffff:7f00:1]") that IpAddr::parse() cannot handle, silently skipping IP-based SSRF checks for all IPv6 URLs. Switch to url::Host enum matching to extract proper IpAddr values without string parsing. IPv4-mapped IPv6 addresses like ::ffff:127.0.0.1 are now correctly unwrapped and blocked. Co-Authored-By: Claude Opus 4.6 <[email protected]> * test(skills): add activation criteria limits enforcement tests Adds test_activation_criteria_enforce_limits to verify that enforce_limits() correctly trims excess patterns (>5), keywords (>20), and tags (>10), and filters out short keywords/tags (<3 chars). Co-Authored-By: Claude Opus 4.6 <[email protected]> * test(wasm): add security regression tests for WASM tool loader Add 6 tests covering: tool name path separator rejection, empty name rejection, nonexistent file handling, invalid WASM bytes rejection, dotfile discovery behavior, and subdirectory non-recursion. Co-Authored-By: Claude Opus 4.6 <[email protected]> * refactor: address PR review feedback - Remove plan files from repo (ilblackdragon review) - Replace CLAUDE.md test tier rules with pointer to check-boundaries.sh - Add Check 4 to check-boundaries.sh: enforces integration tests are gated behind the 'integration' feature flag Co-Authored-By: Claude Opus 4.6 <[email protected]> * ci: add try_connect silent-skip pattern check to check-boundaries.sh Check 5 catches try_connect() and similar silent-skip patterns in integration tests. Tests should use feature gates to fail loudly when prerequisites are missing, not silently return. Co-Authored-By: Claude Opus 4.6 <[email protected]> * fix(security): harden skill fetch SSRF checks * fix(scripts): use bash arrays in check-boundaries.sh tier violation check Refactor Check 4 in check-boundaries.sh to use bash arrays and printf instead of string concatenation with echo -e. This is more robust with special characters in filenames and avoids portability concerns with echo -e. [skip-regression-check] Co-Authored-By: Claude Opus 4.6 <[email protected]> --------- Co-authored-by: Claude Opus 4.6 <[email protected]>
This commit is contained in:
co-authored by
Claude Opus 4.6
parent
cf96a3253c
commit
45ec691f4c
@@ -380,8 +380,8 @@ impl Tool for SkillInstallTool {
|
||||
/// - Non-HTTPS URLs (except in tests)
|
||||
/// - URLs pointing to private, loopback, or link-local IP addresses
|
||||
/// - URLs without a host
|
||||
pub fn validate_fetch_url(url_str: &str) -> Result<(), ToolError> {
|
||||
let parsed = url::Url::parse(url_str)
|
||||
pub fn validate_fetch_url(url_str: &str) -> Result<reqwest::Url, ToolError> {
|
||||
let parsed = reqwest::Url::parse(url_str)
|
||||
.map_err(|e| ToolError::ExecutionFailed(format!("Invalid URL '{}': {}", url_str, e)))?;
|
||||
|
||||
// Require HTTPS
|
||||
@@ -393,30 +393,20 @@ pub fn validate_fetch_url(url_str: &str) -> Result<(), ToolError> {
|
||||
}
|
||||
|
||||
let host = parsed
|
||||
.host_str()
|
||||
.host()
|
||||
.ok_or_else(|| ToolError::ExecutionFailed("URL has no host".to_string()))?;
|
||||
|
||||
// Check if host is an IP address and reject private ranges.
|
||||
// Use reqwest::Url host variants to get proper IpAddr values -- host_str()
|
||||
// returns bracketed IPv6 (e.g. "[::1]") which IpAddr cannot parse.
|
||||
// Unwrap IPv4-mapped IPv6 addresses (e.g. ::ffff:192.168.1.1) to catch
|
||||
// SSRF bypasses that encode private IPv4 addresses as IPv6.
|
||||
if let Ok(raw_ip) = host.parse::<std::net::IpAddr>() {
|
||||
let ip = match raw_ip {
|
||||
std::net::IpAddr::V6(v6) => v6
|
||||
.to_ipv4_mapped()
|
||||
.map(std::net::IpAddr::V4)
|
||||
.unwrap_or(std::net::IpAddr::V6(v6)),
|
||||
other => other,
|
||||
};
|
||||
if ip.is_loopback() || ip.is_unspecified() || is_private_ip(&ip) || is_link_local_ip(&ip) {
|
||||
return Err(ToolError::ExecutionFailed(format!(
|
||||
"URL points to a private/loopback/link-local address: {}",
|
||||
host
|
||||
)));
|
||||
}
|
||||
if let Some(ip) = host_ip_addr(&host) {
|
||||
validate_fetch_ip(&ip, &host.to_string())?;
|
||||
}
|
||||
|
||||
// Reject common internal hostnames
|
||||
let host_lower = host.to_lowercase();
|
||||
// Reject common internal hostnames, including FQDN forms with a trailing dot.
|
||||
let host_lower = normalize_domain(host.to_string().as_str()).to_lowercase();
|
||||
if host_lower == "localhost"
|
||||
|| host_lower == "metadata.google.internal"
|
||||
|| host_lower.ends_with(".internal")
|
||||
@@ -428,9 +418,100 @@ pub fn validate_fetch_url(url_str: &str) -> Result<(), ToolError> {
|
||||
)));
|
||||
}
|
||||
|
||||
Ok(parsed)
|
||||
}
|
||||
|
||||
fn host_ip_addr(host: &url::Host<&str>) -> Option<std::net::IpAddr> {
|
||||
match host {
|
||||
url::Host::Ipv4(v4) => Some(std::net::IpAddr::V4(*v4)),
|
||||
url::Host::Ipv6(v6) => Some(normalize_ip(std::net::IpAddr::V6(*v6))),
|
||||
url::Host::Domain(_) => None,
|
||||
}
|
||||
}
|
||||
|
||||
fn normalize_ip(ip: std::net::IpAddr) -> std::net::IpAddr {
|
||||
match ip {
|
||||
std::net::IpAddr::V6(v6) => v6
|
||||
.to_ipv4_mapped()
|
||||
.map(std::net::IpAddr::V4)
|
||||
.unwrap_or(std::net::IpAddr::V6(v6)),
|
||||
other => other,
|
||||
}
|
||||
}
|
||||
|
||||
fn validate_fetch_ip(ip: &std::net::IpAddr, display_host: &str) -> Result<(), ToolError> {
|
||||
if ip.is_loopback() || ip.is_unspecified() || is_private_ip(ip) || is_link_local_ip(ip) {
|
||||
return Err(ToolError::ExecutionFailed(format!(
|
||||
"URL points to a private/loopback/link-local address: {}",
|
||||
display_host
|
||||
)));
|
||||
}
|
||||
|
||||
Ok(())
|
||||
}
|
||||
|
||||
fn normalize_domain(host: &str) -> &str {
|
||||
host.trim_end_matches('.')
|
||||
}
|
||||
|
||||
fn validate_resolved_addrs(host: &str, addrs: &[std::net::SocketAddr]) -> Result<(), ToolError> {
|
||||
if addrs.is_empty() {
|
||||
return Err(ToolError::ExecutionFailed(format!(
|
||||
"DNS resolution returned no addresses for {}",
|
||||
host
|
||||
)));
|
||||
}
|
||||
|
||||
for addr in addrs {
|
||||
let ip = normalize_ip(addr.ip());
|
||||
validate_fetch_ip(&ip, host)?;
|
||||
}
|
||||
|
||||
Ok(())
|
||||
}
|
||||
|
||||
fn build_fetch_client_builder() -> reqwest::ClientBuilder {
|
||||
reqwest::Client::builder()
|
||||
.timeout(std::time::Duration::from_secs(15))
|
||||
.user_agent("ironclaw/0.1")
|
||||
.redirect(reqwest::redirect::Policy::none())
|
||||
}
|
||||
|
||||
async fn build_safe_fetch_client(parsed: &reqwest::Url) -> Result<reqwest::Client, ToolError> {
|
||||
let host = parsed
|
||||
.host()
|
||||
.ok_or_else(|| ToolError::ExecutionFailed("URL has no host".to_string()))?;
|
||||
|
||||
match host {
|
||||
url::Host::Ipv4(_) | url::Host::Ipv6(_) => build_fetch_client_builder()
|
||||
.build()
|
||||
.map_err(|e| ToolError::ExecutionFailed(format!("HTTP client error: {}", e))),
|
||||
url::Host::Domain(domain) => {
|
||||
let lookup_host = normalize_domain(domain);
|
||||
let port = parsed
|
||||
.port_or_known_default()
|
||||
.ok_or_else(|| ToolError::ExecutionFailed("URL has no valid port".to_string()))?;
|
||||
|
||||
let addrs: Vec<std::net::SocketAddr> = tokio::net::lookup_host((lookup_host, port))
|
||||
.await
|
||||
.map_err(|e| {
|
||||
ToolError::ExecutionFailed(format!(
|
||||
"DNS resolution failed for {}: {}",
|
||||
lookup_host, e
|
||||
))
|
||||
})?
|
||||
.collect();
|
||||
|
||||
validate_resolved_addrs(domain, &addrs)?;
|
||||
|
||||
build_fetch_client_builder()
|
||||
.resolve_to_addrs(domain, &addrs)
|
||||
.build()
|
||||
.map_err(|e| ToolError::ExecutionFailed(format!("HTTP client error: {}", e)))
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
fn is_private_ip(ip: &std::net::IpAddr) -> bool {
|
||||
match ip {
|
||||
std::net::IpAddr::V4(v4) => {
|
||||
@@ -463,16 +544,10 @@ fn is_link_local_ip(ip: &std::net::IpAddr) -> bool {
|
||||
/// `PK\x03\x04` magic bytes) and extracts `SKILL.md` automatically. Plain
|
||||
/// text responses are returned as-is.
|
||||
pub async fn fetch_skill_content(url: &str) -> Result<String, ToolError> {
|
||||
validate_fetch_url(url)?;
|
||||
let parsed = validate_fetch_url(url)?;
|
||||
let client = build_safe_fetch_client(&parsed).await?;
|
||||
|
||||
let client = reqwest::Client::builder()
|
||||
.timeout(std::time::Duration::from_secs(15))
|
||||
.user_agent("ironclaw/0.1")
|
||||
.redirect(reqwest::redirect::Policy::none())
|
||||
.build()
|
||||
.map_err(|e| ToolError::ExecutionFailed(format!("HTTP client error: {}", e)))?;
|
||||
|
||||
let response = client.get(url).send().await.map_err(|e| {
|
||||
let response = client.get(parsed.clone()).send().await.map_err(|e| {
|
||||
ToolError::ExecutionFailed(format!("Failed to fetch skill from {}: {}", url, e))
|
||||
})?;
|
||||
|
||||
@@ -797,6 +872,12 @@ mod tests {
|
||||
assert!(err.to_string().contains("internal hostname"));
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_validate_fetch_url_rejects_localhost_fqdn() {
|
||||
let err = super::validate_fetch_url("https://localhost./skill.md").unwrap_err();
|
||||
assert!(err.to_string().contains("internal hostname"));
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_validate_fetch_url_rejects_metadata_endpoint() {
|
||||
let err =
|
||||
@@ -817,6 +898,41 @@ mod tests {
|
||||
assert!(err.to_string().contains("Only HTTPS"));
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_validate_fetch_url_rejects_ipv4_mapped_ipv6_loopback() {
|
||||
let err = super::validate_fetch_url("https://[::ffff:127.0.0.1]/skill.md").unwrap_err();
|
||||
assert!(err.to_string().contains("private") || err.to_string().contains("loopback"));
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_validate_fetch_url_rejects_ipv6_loopback() {
|
||||
let err = super::validate_fetch_url("https://[::1]/skill.md").unwrap_err();
|
||||
assert!(err.to_string().contains("private") || err.to_string().contains("loopback"));
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_validate_resolved_addrs_rejects_loopback_hostname() {
|
||||
let addrs = vec![
|
||||
"127.0.0.1:443".parse::<std::net::SocketAddr>().unwrap(),
|
||||
"[::1]:443".parse::<std::net::SocketAddr>().unwrap(),
|
||||
];
|
||||
|
||||
let err = super::validate_resolved_addrs("example.com", &addrs).unwrap_err();
|
||||
assert!(err.to_string().contains("private") || err.to_string().contains("loopback"));
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_validate_resolved_addrs_allows_public_hostname() {
|
||||
let addrs = vec![
|
||||
"8.8.8.8:443".parse::<std::net::SocketAddr>().unwrap(),
|
||||
"[2606:4700:4700::1111]:443"
|
||||
.parse::<std::net::SocketAddr>()
|
||||
.unwrap(),
|
||||
];
|
||||
|
||||
assert!(super::validate_resolved_addrs("example.com", &addrs).is_ok());
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_extract_skill_from_zip_deflate() {
|
||||
// Build a real ZIP with flate2 + manual header construction.
|
||||
@@ -890,4 +1006,265 @@ mod tests {
|
||||
let err = super::extract_skill_from_zip(&zip).unwrap_err();
|
||||
assert!(err.to_string().contains("does not contain SKILL.md"));
|
||||
}
|
||||
|
||||
// ── ZIP extraction security regression tests ────────────────────────
|
||||
|
||||
/// Helper: build a minimal ZIP local file header with Store compression.
|
||||
fn build_zip_entry_store(file_name: &str, content: &[u8]) -> Vec<u8> {
|
||||
let mut zip = Vec::new();
|
||||
zip.extend_from_slice(&[0x50, 0x4B, 0x03, 0x04]); // signature
|
||||
zip.extend_from_slice(&[0x0A, 0x00]); // version needed (1.0)
|
||||
zip.extend_from_slice(&[0x00, 0x00]); // flags
|
||||
zip.extend_from_slice(&[0x00, 0x00]); // compression: store (0)
|
||||
zip.extend_from_slice(&[0x00, 0x00, 0x00, 0x00]); // mod time/date
|
||||
zip.extend_from_slice(&[0x00, 0x00, 0x00, 0x00]); // crc32
|
||||
zip.extend_from_slice(&(content.len() as u32).to_le_bytes()); // compressed size
|
||||
zip.extend_from_slice(&(content.len() as u32).to_le_bytes()); // uncompressed size
|
||||
zip.extend_from_slice(&(file_name.len() as u16).to_le_bytes()); // filename length
|
||||
zip.extend_from_slice(&0u16.to_le_bytes()); // extra field length
|
||||
zip.extend_from_slice(file_name.as_bytes());
|
||||
zip.extend_from_slice(content);
|
||||
zip
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_zip_extract_valid_skill() {
|
||||
let content = b"---\nname: hello\n---\n# Hello Skill\nDoes things.\n";
|
||||
let zip = build_zip_entry_store("SKILL.md", content);
|
||||
let result = super::extract_skill_from_zip(&zip).unwrap();
|
||||
assert_eq!(result, std::str::from_utf8(content).unwrap());
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_zip_extract_ignores_non_skill_entries() {
|
||||
// ZIP with README.md and src/main.rs but no SKILL.md -- should error.
|
||||
let mut zip = Vec::new();
|
||||
zip.extend_from_slice(&build_zip_entry_store("README.md", b"# Readme"));
|
||||
zip.extend_from_slice(&build_zip_entry_store("src/main.rs", b"fn main() {}"));
|
||||
|
||||
let err = super::extract_skill_from_zip(&zip).unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("does not contain SKILL.md"),
|
||||
"Expected 'does not contain SKILL.md' error, got: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_zip_extract_path_traversal_rejected() {
|
||||
// An entry named "../../SKILL.md" must NOT match the exact "SKILL.md" check.
|
||||
let content = b"---\nname: evil\n---\n# Malicious path traversal\n";
|
||||
let zip = build_zip_entry_store("../../SKILL.md", content);
|
||||
|
||||
let err = super::extract_skill_from_zip(&zip).unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("does not contain SKILL.md"),
|
||||
"Path traversal entry should not match SKILL.md, got: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_zip_extract_nested_path_not_matched() {
|
||||
// An entry named "subdir/SKILL.md" must NOT match the exact "SKILL.md" check.
|
||||
let content = b"---\nname: nested\n---\n# Nested\n";
|
||||
let zip = build_zip_entry_store("subdir/SKILL.md", content);
|
||||
|
||||
let err = super::extract_skill_from_zip(&zip).unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("does not contain SKILL.md"),
|
||||
"Nested path should not match SKILL.md, got: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_zip_extract_oversized_rejected() {
|
||||
// Create a ZIP entry whose declared uncompressed_size exceeds MAX_DECOMPRESSED (1 MB).
|
||||
let oversized_claim: u32 = 2 * 1024 * 1024; // 2 MB
|
||||
let small_body = b"tiny";
|
||||
|
||||
let mut zip = Vec::new();
|
||||
zip.extend_from_slice(&[0x50, 0x4B, 0x03, 0x04]); // signature
|
||||
zip.extend_from_slice(&[0x0A, 0x00]); // version needed
|
||||
zip.extend_from_slice(&[0x00, 0x00]); // flags
|
||||
zip.extend_from_slice(&[0x00, 0x00]); // compression: store
|
||||
zip.extend_from_slice(&[0x00, 0x00, 0x00, 0x00]); // mod time/date
|
||||
zip.extend_from_slice(&[0x00, 0x00, 0x00, 0x00]); // crc32
|
||||
zip.extend_from_slice(&(small_body.len() as u32).to_le_bytes()); // compressed size (actual)
|
||||
zip.extend_from_slice(&oversized_claim.to_le_bytes()); // uncompressed size (forged)
|
||||
zip.extend_from_slice(&8u16.to_le_bytes()); // filename length
|
||||
zip.extend_from_slice(&0u16.to_le_bytes()); // extra field length
|
||||
zip.extend_from_slice(b"SKILL.md");
|
||||
zip.extend_from_slice(small_body);
|
||||
|
||||
let err = super::extract_skill_from_zip(&zip).unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("too large"),
|
||||
"Oversized entry should be rejected, got: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
// ── SSRF prevention regression tests ────────────────────────────────
|
||||
|
||||
#[test]
|
||||
fn test_is_private_ip_blocks_loopback() {
|
||||
let loopback: std::net::IpAddr = "127.0.0.1".parse().unwrap();
|
||||
// is_private_ip checks v4.is_private() which does NOT include loopback,
|
||||
// but validate_fetch_url checks is_loopback() separately. Test the full flow.
|
||||
assert!(loopback.is_loopback());
|
||||
// Also verify via validate_fetch_url
|
||||
assert!(super::validate_fetch_url("https://127.0.0.1/skill.md").is_err());
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_is_private_ip_blocks_private_ranges() {
|
||||
let cases: Vec<(&str, bool)> = vec![
|
||||
("10.0.0.1", true),
|
||||
("10.255.255.255", true),
|
||||
("172.16.0.1", true),
|
||||
("172.31.255.255", true),
|
||||
("192.168.1.1", true),
|
||||
("192.168.0.0", true),
|
||||
];
|
||||
for (ip_str, expect_private) in cases {
|
||||
let ip: std::net::IpAddr = ip_str.parse().unwrap();
|
||||
assert_eq!(
|
||||
super::is_private_ip(&ip),
|
||||
expect_private,
|
||||
"Expected is_private_ip({}) = {}",
|
||||
ip_str,
|
||||
expect_private
|
||||
);
|
||||
}
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_is_private_ip_blocks_link_local() {
|
||||
// 169.254.0.0/16 range (link-local)
|
||||
let cases = vec!["169.254.1.1", "169.254.0.1", "169.254.255.255"];
|
||||
for ip_str in cases {
|
||||
let ip: std::net::IpAddr = ip_str.parse().unwrap();
|
||||
// is_private_ip includes v4.is_link_local()
|
||||
assert!(
|
||||
super::is_private_ip(&ip),
|
||||
"Expected is_private_ip({}) = true (link-local)",
|
||||
ip_str
|
||||
);
|
||||
}
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_is_private_ip_allows_public() {
|
||||
let public_ips = vec!["8.8.8.8", "1.1.1.1", "93.184.216.34", "151.101.1.67"];
|
||||
for ip_str in public_ips {
|
||||
let ip: std::net::IpAddr = ip_str.parse().unwrap();
|
||||
assert!(
|
||||
!super::is_private_ip(&ip),
|
||||
"Expected is_private_ip({}) = false (public IP)",
|
||||
ip_str
|
||||
);
|
||||
assert!(!ip.is_loopback(), "Expected {} is not loopback", ip_str);
|
||||
}
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_is_private_ip_blocks_ipv4_mapped_ipv6() {
|
||||
// Test the IPv4-mapped unwrapping logic end-to-end through
|
||||
// validate_fetch_url. IPv6 URLs like https://[::ffff:127.0.0.1]/path
|
||||
// must be correctly detected as private/loopback.
|
||||
|
||||
// ::ffff:127.0.0.1 mapped -> 127.0.0.1 (loopback) -- must be blocked
|
||||
let err = super::validate_fetch_url("https://[::ffff:127.0.0.1]/skill.md").unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("private") || err.to_string().contains("loopback"),
|
||||
"IPv4-mapped loopback should be blocked, got: {}",
|
||||
err
|
||||
);
|
||||
|
||||
// ::ffff:192.168.1.1 mapped -> 192.168.1.1 (private) -- must be blocked
|
||||
let err = super::validate_fetch_url("https://[::ffff:192.168.1.1]/skill.md").unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("private") || err.to_string().contains("loopback"),
|
||||
"IPv4-mapped private should be blocked, got: {}",
|
||||
err
|
||||
);
|
||||
|
||||
// ::ffff:10.0.0.1 mapped -> 10.0.0.1 (private) -- must be blocked
|
||||
let err = super::validate_fetch_url("https://[::ffff:10.0.0.1]/skill.md").unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("private") || err.to_string().contains("loopback"),
|
||||
"IPv4-mapped 10.x should be blocked, got: {}",
|
||||
err
|
||||
);
|
||||
|
||||
// ::ffff:8.8.8.8 mapped -> 8.8.8.8 (public) -- must be allowed
|
||||
assert!(
|
||||
super::validate_fetch_url("https://[::ffff:8.8.8.8]/skill.md").is_ok(),
|
||||
"IPv4-mapped public IP should be allowed"
|
||||
);
|
||||
|
||||
// Pure IPv6 loopback ::1 -- must be blocked
|
||||
let err = super::validate_fetch_url("https://[::1]/skill.md").unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("private") || err.to_string().contains("loopback"),
|
||||
"IPv6 loopback should be blocked, got: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_is_restricted_host_blocks_metadata() {
|
||||
// Cloud metadata endpoint (AWS/GCP/Azure style)
|
||||
let err =
|
||||
super::validate_fetch_url("https://169.254.169.254/latest/meta-data/").unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("private") || err.to_string().contains("link-local"),
|
||||
"Metadata IP should be blocked, got: {}",
|
||||
err
|
||||
);
|
||||
|
||||
// GCP metadata hostname
|
||||
let err =
|
||||
super::validate_fetch_url("https://metadata.google.internal/something").unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("internal hostname"),
|
||||
"metadata.google.internal should be blocked, got: {}",
|
||||
err
|
||||
);
|
||||
|
||||
// Generic .internal domain
|
||||
let err = super::validate_fetch_url("https://service.internal/api").unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("internal hostname"),
|
||||
".internal domains should be blocked, got: {}",
|
||||
err
|
||||
);
|
||||
|
||||
// .local domain
|
||||
let err = super::validate_fetch_url("https://myhost.local/skill.md").unwrap_err();
|
||||
assert!(
|
||||
err.to_string().contains("internal hostname"),
|
||||
".local domains should be blocked, got: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn test_is_restricted_host_allows_normal() {
|
||||
let allowed = vec![
|
||||
"https://github.com/repo/SKILL.md",
|
||||
"https://clawhub.dev/api/v1/download?slug=foo",
|
||||
"https://raw.githubusercontent.com/user/repo/main/SKILL.md",
|
||||
"https://example.com/skills/deploy.md",
|
||||
];
|
||||
for url in allowed {
|
||||
assert!(
|
||||
super::validate_fetch_url(url).is_ok(),
|
||||
"Expected validate_fetch_url({}) to succeed",
|
||||
url
|
||||
);
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
@@ -919,4 +919,162 @@ mod tests {
|
||||
assert!(!config.client_id.is_empty());
|
||||
assert!(config.client_secret.is_some());
|
||||
}
|
||||
|
||||
// ---------------------------------------------------------------
|
||||
// Security regression tests
|
||||
// ---------------------------------------------------------------
|
||||
|
||||
use std::sync::Arc;
|
||||
|
||||
use crate::tools::registry::ToolRegistry;
|
||||
use crate::tools::wasm::{WasmRuntimeConfig, WasmToolRuntime};
|
||||
|
||||
/// Helper: create a WasmToolLoader backed by a real runtime + registry.
|
||||
fn make_loader() -> super::WasmToolLoader {
|
||||
let runtime = Arc::new(
|
||||
WasmToolRuntime::new(WasmRuntimeConfig::for_testing())
|
||||
.expect("failed to create WASM runtime for test"),
|
||||
);
|
||||
let registry = Arc::new(ToolRegistry::new());
|
||||
super::WasmToolLoader::new(runtime, registry)
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn test_tool_name_rejects_path_separators() {
|
||||
let dir = TempDir::new().unwrap();
|
||||
// Create a valid wasm file so the name check is the only failure path
|
||||
let wasm_path = dir.path().join("dummy.wasm");
|
||||
std::fs::File::create(&wasm_path).unwrap();
|
||||
|
||||
let loader = make_loader();
|
||||
|
||||
for bad_name in &["../evil", "foo/bar", "foo\\bar"] {
|
||||
let result = loader.load_from_files(bad_name, &wasm_path, None).await;
|
||||
assert!(
|
||||
result.is_err(),
|
||||
"Expected error for name {:?}, got Ok",
|
||||
bad_name
|
||||
);
|
||||
let err = result.unwrap_err();
|
||||
assert!(
|
||||
matches!(err, WasmLoadError::InvalidName(_)),
|
||||
"Expected InvalidName for {:?}, got: {}",
|
||||
bad_name,
|
||||
err
|
||||
);
|
||||
}
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn test_tool_name_rejects_empty() {
|
||||
let dir = TempDir::new().unwrap();
|
||||
let wasm_path = dir.path().join("dummy.wasm");
|
||||
std::fs::File::create(&wasm_path).unwrap();
|
||||
|
||||
let loader = make_loader();
|
||||
let result = loader.load_from_files("", &wasm_path, None).await;
|
||||
|
||||
assert!(result.is_err(), "Expected error for empty name, got Ok");
|
||||
let err = result.unwrap_err();
|
||||
assert!(
|
||||
matches!(err, WasmLoadError::InvalidName(_)),
|
||||
"Expected InvalidName for empty string, got: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn test_load_nonexistent_wasm_file() {
|
||||
let loader = make_loader();
|
||||
let bogus_path = std::path::PathBuf::from("/tmp/nonexistent_tool_12345.wasm");
|
||||
|
||||
let result = loader.load_from_files("bogus", &bogus_path, None).await;
|
||||
assert!(
|
||||
result.is_err(),
|
||||
"Expected error for nonexistent file, got Ok"
|
||||
);
|
||||
let err = result.unwrap_err();
|
||||
assert!(
|
||||
matches!(err, WasmLoadError::WasmNotFound(_)),
|
||||
"Expected WasmNotFound, got: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn test_load_invalid_wasm_bytes() {
|
||||
let dir = TempDir::new().unwrap();
|
||||
let wasm_path = dir.path().join("invalid.wasm");
|
||||
|
||||
// Write random invalid bytes (not a valid WASM module)
|
||||
let mut f = std::fs::File::create(&wasm_path).unwrap();
|
||||
f.write_all(b"this is not a valid wasm module at all")
|
||||
.unwrap();
|
||||
|
||||
let loader = make_loader();
|
||||
let result = loader.load_from_files("invalid", &wasm_path, None).await;
|
||||
|
||||
assert!(
|
||||
result.is_err(),
|
||||
"Expected error for invalid WASM bytes, got Ok"
|
||||
);
|
||||
// The error should come from WASM compilation or registration, not name validation
|
||||
let err = result.unwrap_err();
|
||||
assert!(
|
||||
!matches!(err, WasmLoadError::InvalidName(_)),
|
||||
"Got InvalidName instead of a compilation/registration error: {}",
|
||||
err
|
||||
);
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn test_discover_skips_dotfiles() {
|
||||
let dir = TempDir::new().unwrap();
|
||||
|
||||
// Create a dotfile .wasm and a normal .wasm
|
||||
std::fs::File::create(dir.path().join(".hidden.wasm")).unwrap();
|
||||
std::fs::File::create(dir.path().join("visible.wasm")).unwrap();
|
||||
|
||||
let tools = discover_tools(dir.path()).await.unwrap();
|
||||
|
||||
// The current implementation discovers ALL .wasm files including dotfiles.
|
||||
// This test documents the current behavior: .hidden.wasm IS discovered
|
||||
// with the stem ".hidden". A future hardening pass could add dotfile
|
||||
// filtering, at which point this assertion should be updated.
|
||||
assert!(
|
||||
tools.contains_key("visible"),
|
||||
"visible.wasm should be discovered"
|
||||
);
|
||||
assert!(
|
||||
tools.contains_key(".hidden"),
|
||||
"dotfile .hidden.wasm is currently discovered (no dotfile filter yet)"
|
||||
);
|
||||
assert_eq!(tools.len(), 2);
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn test_discover_tools_ignores_subdirectories() {
|
||||
let dir = TempDir::new().unwrap();
|
||||
|
||||
// Create a top-level wasm file
|
||||
std::fs::File::create(dir.path().join("top_level.wasm")).unwrap();
|
||||
|
||||
// Create a subdirectory with a wasm file inside
|
||||
let sub_dir = dir.path().join("subdir");
|
||||
std::fs::create_dir(&sub_dir).unwrap();
|
||||
std::fs::File::create(sub_dir.join("nested.wasm")).unwrap();
|
||||
|
||||
let tools = discover_tools(dir.path()).await.unwrap();
|
||||
|
||||
// Only top-level files should be discovered (read_dir is not recursive)
|
||||
assert_eq!(tools.len(), 1, "Only top-level .wasm files should be found");
|
||||
assert!(
|
||||
tools.contains_key("top_level"),
|
||||
"top_level.wasm should be discovered"
|
||||
);
|
||||
assert!(
|
||||
!tools.contains_key("nested"),
|
||||
"nested.wasm inside subdir should NOT be discovered"
|
||||
);
|
||||
}
|
||||
}
|
||||
|
||||
Reference in New Issue
Block a user