Self-hosted AI session analysis with Next.js server and Claude Code plugin for local-first AI collaboration analysis
BetterPrompt exhibits severe definition quality gaps across all 14 tools. Most tools lack visible input schemas in the provided source code, only 4 of 14 have documented parameters (scan-sessions, save-stage-output, get-stage-output, save-domain-results, save-user-prefs). Descriptions are present but generic and under-optimized for LLM selection (e.g., 'Extract structured data from parsed AI sessions' lacks WHEN/WHY context). No output schemas are documented. No error handling guidance, no parameter constraints (enums, ranges), no idempotent/destructive hints. Tool names follow verb_noun convention (positive), but composition issues exist: scan-sessions, extract-data, and get-prompt-context appear to form a pipeline without clear separation of concerns. No evidence of pagination, rate limiting, or recovery guidance. Security: no visible secret injection patterns, no permission gates, no audit trail declarations.
Classify developer type based on session analysis
Extract structured data from parsed AI sessions
Generate analysis report from processed session data
Retrieve previously saved domain analysis results
Retrieve prompt context for analysis pipeline
Get current progress of an analysis run
Retrieve previously saved analysis stage output
Retrieve user preferences and settings
10 of 14 tools have no visible input schema in source code.
Descriptions are generic and under 50 characters for 10 tools (e.g., 'Extract structured data from parsed AI sessions'). Missing WHEN/WHY context and actionable guidance for LLM selection.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields without knowing response structure.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 37 | 2025-06-18+ | v2 |
Save domain analysis results to persistent storage
Save analysis stage output to persistent storage
Save user preferences and settings
Scan and discover AI coding sessions from multiple sources (Claude Code, Cursor, etc.)
Synchronize analysis results to team storage
Verify and validate evidence from analysis sessions
No error handling guidance. Tools lack recovery hints, error categorization (retryable/user-fixable/fatal), or actionable error messages.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint) visible. Risk metadata is inferred from tool names, not declared.