Agent runtime and MCP server for scientific computing with integrated LLM support, tool execution, and project management
14 tools with basic schemas and descriptions, but significant gaps in parameter documentation and output schema clarity. Most tools have verb-noun naming (read_file, write_file, execute_shell) which is good. However, descriptions are often terse (10-50 chars), parameter descriptions are minimal or missing, and output schemas are not documented. No tool annotations (readOnlyHint, destructiveHint, idempotentHint) despite clear risk levels. Error handling guidance is absent. Tools like execute_shell and call_mcp_tool are high-risk but lack confirmation/dry-run patterns. Composition is reasonable (single responsibility per tool), but chaining support is weak, no clear ID/reference propagation documented.
Signal task completion with optional result summary
Call a tool from a configured MCP server
Edit file by replacing text matching a pattern
Execute Python code in a managed runtime
Execute R code in a managed runtime
Execute shell commands with optional timeout and working directory
Fetch biological sequence data from public databases
Search for text patterns in files
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields. Critical for tools like list_mcp_servers, fetch_biological_data, and grep which return structured data.
High-risk tools (execute_shell, execute_python, execute_r, call_mcp_tool, write_file, edit_file) lack confirmation/dry-run patterns and destructiveHint annotations. No guidance on irreversible consequences.
Parameter descriptions are minimal or absent. 'pattern' in grep, 'parameters' in use_skill, 'arguments' in call_mcp_tool lack detail on format, constraints, or examples. Violates pattern:tool-description baseline (100% of A+ tools have param descriptions).
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 53 | 2026-07-28+ | v2 |
List directory contents with optional recursive traversal
List configured MCP servers from wisp configuration
Read file contents with optional line range selection
Search for files matching patterns in a directory
Execute a skill from the project's SKILL.md files
Write or create a file with specified content
No error handling guidance. Tools like fetch_biological_data (external API), execute_shell (timeout/failure), and call_mcp_tool (server unavailable) provide no recovery hints. Violates pattern:recovery-guide.
Tool descriptions are too brief (10-60 chars). Baseline for A+ tools is 194 chars. Descriptions like 'Execute shell commands' and 'Execute Python code' lack WHEN to use, prerequisites, or side effects. Violates pattern:tool-description baseline.