Critical gaps across all dimensions. Tool definitions lack visible input schemas in source code, cannot verify parameter types, constraints, or descriptions. Tool descriptions are present but generic (10-50 chars typical), providing minimal LLM guidance. No evidence of structured output schemas, error handling guidance, or parameter validation rules. 40 tools defined but implementation details not inspectable from provided source. Naming follows verb_noun convention (positive), but without schema visibility, cannot assess parameter quality or composition patterns.
Perform safety checks before editing code
Perform bulk queries across the codebase
Create a plan for code changes
Classify a file by its type and purpose
Detect dead code in the project
Explain the codebase structure and architecture
Explain the risks of planned changes
Get the diff for a file
Find code elements by their file location
No input schemas visible in source code. Cannot verify parameter types, constraints, enums, or descriptions.
Tool descriptions are generic and under 50 characters (e.g., 'Get current session context', 'Get token usage statistics'). Descriptions must be 50-200 chars and explain WHAT, WHEN, and WHY to use the tool.
No output schemas documented. LLMs cannot infer what fields to expect or plan downstream tool calls. Responses must be structured with typed fields.
No error handling guidance visible. Tools must return actionable error messages (e.g., 'User not found. Try search_users() first.') not raw error codes.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 36 | 2026-07-28+ | v2 |
Find code elements by their signature
Find a specific function in the codebase
Find similar code patterns in the codebase
Find all usages of a code element
Get the call graph for a function or module
Get recent changes in the project
Get detailed information about a specific class
Get complexity metrics for code
Get constraints for code modifications
Get file metadata and information
Get detailed information about a specific function
Get detailed information about a generic code element
Get detailed information about a specific module
Get all routes in the project
Get current session context
Analyze the impact of git diffs
Analyze the impact of potential changes
List all files in the project
List all modules in the project
Query the AI context for the project
Read the contents of a file
Rename code elements across the codebase
Reset the current session context
Check the scope of planned changes
Search for functions by name or pattern
Perform rich search with multiple criteria
Replace secrets in the codebase
Scan for secrets in the codebase
Perform semantic search across the codebase
Perform taint analysis on the codebase
Get token usage statistics
Destructive tools (reset_session, secrets_replace, rename) lack confirmation or dry-run patterns. Agents need explicit confirmation before irreversible operations.