Agent Behaviour Drift Sentinel: detects silent behavioural drift in agent execution traces against a signed baseline. Reference implementation of the public SHPBL behaviour specification.
Drift Sentinel has 7 tools with basic schemas and descriptions, but significant gaps prevent production use. Tool names lack action verbs (ingest_traces, set_baseline are acceptable; explain_drift, calibrate, configure_suppression are vague). Most critically: 4 of 7 tools have incomplete input schemas with missing property descriptions (apply_calibration and configure_suppression have empty properties {}). Parameter descriptions are minimal (1-3 words: 'Agent identifier', 'Baseline name'). No output schemas documented. Error handling exists (SentinelError) but provides no recovery guidance. Tool descriptions are 10-15 words, meeting minimum length but lacking WHEN/WHY context. No tool annotations (readOnlyHint/destructiveHint). Composition is reasonable (single responsibility per tool), but parameter naming lacks type suffixes (keyRef is opaque; should be key_id or key_name).
Create a new signed baseline version carrying an approved calibration profile.
Propose a calibration profile from labelled findings; never mutates thresholds.
Compare a trace set against a signed baseline and report divergence.
Declare maintenance windows and known change markers.
Dimension-level attribution plus replay of the most divergent episode.
Ingest caller-supplied agent execution traces and return a traceSetRef.
Sign and store a behaviour profile as a named baseline version.
Two tools (apply_calibration, configure_suppression) have empty input schemas with no property definitions.
Parameter descriptions are 1-3 words ('Agent identifier', 'Baseline name'). Rubric requires 10-1024 chars with format/constraint details. LLMs cannot infer parameter meaning from minimal labels.
No output schemas documented. LLMs cannot plan downstream calls or extract required fields. Rubric baseline: 100% of A+ tools have documented return types.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 38 | 2026-07-28+ | v2 |
Tool names lack action verbs or are vague. 'explain_drift' and 'calibrate' do not clearly signal what happens. Rubric: 90% of A+ tools start with action verb (get_, create_, update_, delete_, search_, list_).
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). Agents cannot distinguish safe reads from destructive writes. set_baseline, apply_calibration, configure_suppression are WRITE operations but unmarked.