MCP server for Ghostly E2E testing platform, providing tools to run browser test flows, analyze components, manage projects, and submit test plans
Ghostly MCP server has 7 tools with mixed quality. Tool naming follows verb_noun convention (ghostly_run_flow, ghostly_get_project_map), which is good. However, descriptions vary significantly in quality and completeness. ghostly_run_flow has a detailed description (180+ chars) with comprehensive parameter documentation, but other tools like ghostly_list_ghostly_projects and ghostly_get_run have minimal descriptions. Parameter schemas are present for ghostly_run_flow but visibility into other tools' schemas is limited from the provided source. No output schemas are documented. Error handling guidance is absent across all tools. The server lacks tool annotations (readOnlyHint/destructiveHint) despite having clear READ_ONLY vs WRITE risk classifications.
Analyzes a component from the project to understand its structure and behavior
Retrieves the project map containing component structure and flow documentation
Retrieves details of a specific test run by ID
Lists all Ghostly projects available to the user
Reads flow documentation files to understand test scenarios and requirements
Runs a test flow in a browser (Playwright) from a base URL and steps.
Submits a test plan to the Ghostly API for execution
Six of seven tools lack visible input schemas in source code. Only ghostly_run_flow has documented parameter types and descriptions. Other tools' schemas cannot be verified.
Tool descriptions are minimal (under 50 chars) for 6 of 7 tools. LLMs cannot determine when to select these tools vs alternatives. Descriptions should be 50-200 chars explaining WHAT, WHEN, and WHY.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields. Each tool must document its return structure.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 32 | 2026-07-28+ | v2 |
No error handling guidance. Tools do not indicate what errors are retryable, user-fixable, or fatal. No recovery suggestions provided.
Tool annotations missing. Risk classifications (READ_ONLY, WRITE) are documented in metadata but not exposed as MCP tool annotations (readOnlyHint, destructiveHint).