Trace Governance
Trace Governance turns a request hierarchy into a read-only passport: which rules matched, what security and harness risks appeared, how evaluations scored, and which policy controls those findings implicate.
Open it from Trace detail → Governance tab in the hierarchy explorer. This is operational governance from production telemetry — not a questionnaire-based GRC product.
Prerequisites
Section titled “Prerequisites”- A project with a working telemetry source (traces)
- For rule matches and stored evaluations: the Shield360 intelligence ClickHouse binding for the environment
- Optional: a prior AI Analysis run so Otter
prompt_injection/tool_misusefindings can merge into the same report
Governance tab on a trace
Section titled “Governance tab on a trace”- Open a trace from Telemetry → Traces (or from a widget / Otter pill).
- In the hierarchy explorer, select the Governance tab (shield icon).
- Review:
- Risk summary and session metrics (spans, tools, errors, cost when reported)
- Security & policy findings (deterministic checks + evaluation fails + Otter security dims when available)
- Matched rules with links into the Rule Engine
- Policy controls mapped to NIST AI RMF, EU AI Act, and OWASP ASI categories
- Evaluations stored for spans in the tree
- Click a span chip to jump selection in the hierarchy.
- Use Export JSON to download a passport envelope (schema version,
report_id, report body).
Each report includes a stable report_id. Stamp the same value on CI or release metadata with the OpenTelemetry attribute shield360.governance.report_id when you want exports correlated to a build.
from shield360.semcov import SemanticConvention
# After you export a passport and read passport["report_id"]:span.set_attribute( SemanticConvention.SHIELD360_GOVERNANCE_REPORT_ID, report_id,)span.setAttribute('shield360.governance.report_id', reportId);What the report includes
Section titled “What the report includes”| Section | Source |
|---|---|
| Harness metrics | Hierarchy walk (depth, LLM/tool/retrieval/HTTP/DB counts, coding-agent modes) |
| Rule matches | Rule Engine evaluation per unique span field map (context, prompt, evaluation, alert) |
| Deterministic security | Span errors, generation health, agent loops, coding-agent policy signals |
| Otter security | Latest stored AI Analysis prompt_injection and tool_misuse (no extra LLM call) |
| Evaluations | Rows from Shield360 evaluation storage for spans in the tree |
| Policy controls | Modular packs under policy-packs/ (NIST AI RMF, EU AI Act, OWASP ASI) |
Large trees may truncate rule evaluation and evaluation queries; the UI shows a truncated note when that happens.
Extending policy pack coverage
Section titled “Extending policy pack coverage”Policy control mappings live as one file per framework under the Shield360 client:
src/client/src/lib/platform/governance/policy-packs/ index.ts # registry + matcher types.ts # definePolicyPack helpers nist-ai-rmf.ts eu-ai-act.ts owasp-asi.tsTo deepen coverage for an existing framework, append controls to that framework’s file (control_id, title, finding_categories, optional min_severity / rationale).
To add a new pack:
- Create
policy-packs/<name>.tswithdefinePolicyPack({ id, framework, version, controls }). - Import it in
policy-packs/index.tsand append it toPOLICY_PACKS. - If the framework id is new, extend
GovernancePolicyFrameworkintypes/governance-report.ts.
The Governance tab and passport export pick up registered packs automatically — no other wiring.
Rule Engine fields for coding agents
Section titled “Rule Engine fields for coding agents”Governance and the Rule Engine condition builder share extended fields so policies can match coding-agent and tool attributes, including:
gen_ai.tool.name/gen_ai.tool.call.namecoding_agent.clientcoding_agent.policy.permission_modecoding_agent.content_capture_modecoding_agent.user.classificationcoding_agent.session.outcomecoding_agent.tool.name
Author rules in the Rule Engine, then confirm matches on the Governance tab for a live trace.
| Method | Path | Purpose |
|---|---|---|
GET | /api/telemetry/request/span/:id/governance | Build report JSON |
GET | /api/telemetry/request/span/:id/governance/export | Passport envelope for evidence download |
Enterprise deployments audit report views and passport exports (metadata only — never raw prompts or secrets).
Related
Section titled “Related”- AI Analysis — Otter improvement + security dimensions
- Traces — hierarchy explorer hosting the Governance tab
- Privacy & Governance (coding agents) — capture modes and redaction
- Agent Governance Toolkit — Microsoft policy span integration (separate from this UI)