Admina is a governed AI development framework providing governance engines for AI agents, LLMs, and autonomous systems. It includes injection firewall, PII redaction, loop breaker, hash chain, forensic audit logging, and EU AI Act compliance checking.
Five tools with basic schemas and descriptions, but significant gaps in parameter documentation, error handling, and output schema clarity. All tools have descriptions (10-50 chars, below the 50-200 char baseline for LLM optimization). Schemas present but parameters lack detailed constraints and format guidance. No evidence of error recovery patterns, confirmation steps for destructive operations, or output schema documentation. Risk annotations (READ_ONLY, WRITE) are present but not integrated into tool definitions as formal annotations.
Execute a stock trade
Get current stock price for a ticker symbol
Query patient medical records
Read a file from the filesystem
Send an email
Descriptions are too short (10-50 chars vs. 50-200 char baseline). LLMs cannot determine when to select tools or understand prerequisites. E.g., 'Get current stock price for a ticker symbol' lacks context on data freshness, market hours, or when to use vs. alternatives.
execute_trade (WRITE operation) lacks confirmation/dry-run pattern. Agents can execute irreversible trades without user approval. No error guidance on failed trades (insufficient funds, market closed, invalid quantity).
query_patient_records (healthcare data) has no permission checks, audit logging, or PII handling guidance. HIPAA-regulated data requires explicit access control and compliance documentation.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 55 | 2026-07-28+ | v2 |
read_file lacks path traversal protection and input validation. No description of allowed directories, symlink handling, or file size limits. LLMs could be tricked into reading /etc/passwd or other sensitive files.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields. E.g., does get_stock_price return {price, currency, timestamp} or just a number?