Skip to navigation
Secure

Guardrail tester

Run a sample through the Security Gateway before your rules meet real traffic

The guardrail tester runs a sample through the Security Gateway like a real tool call and shows what each stage did. Use it after every rule change, since edits go live on save.

Open Security → Guardrail tester. It appears once guardrails are enabled and uses your live configuration.

Run a test

  1. Paste a sample, ideally a real argument or result from Tool call logs, or pick a built-in one.
  2. Click Test guardrails.
  3. Read the feed.

Read the feed

  1. Entity scan: each matched entity or custom rule, badged Redact, Log, or Block
  2. Pre-run guardrail verdicts: badged Pass, Log, or Block
  3. Tool call: “Tool call ran” or “Tool call skipped”
  4. Post-run guardrail verdicts
  5. Outcome: “Response delivered” or the guardrail that blocked it

Evaluation failed means the guardrail returned no verdict. Rerun the sample.

What to test

CaseSampleExpect
PositiveCustomer CUST-00547 is requesting a refund.Customer IDs matches
NegativeThe CUSTODIAL bank holds the assets.No match
EdgeThe customer ID is 12345.Whatever you intended

For an AI Guardrail, test one violating sample and one that touches the subject innocently. If either result is wrong, rewrite the instruction.

Next: watch real traffic in Violations and alerts.