Solana Forum Summarizer MCP Server
Server has 5 tools with basic schemas and descriptions, but significant gaps limit production readiness. All tools have input schemas (Zod-validated) and descriptions present, but descriptions are generic (10-80 chars, well below the 194-char baseline). Parameter descriptions are minimal or absent. No output schemas documented. Error handling is absent, tools return raw success/failure without recovery guidance. No tool annotations (readOnlyHint, idempotentHint). Tools are read-only and well-named (verb_noun pattern), but lack the depth expected for A/B grades.
Get the latest posts from the Solana forum
Get the posts from the Solana forum by specified category
Get the top posts from the Solana forum by activity (views and replies)
Search posts on the Solana forum by keyword
Summarize the content of a specified post from the Solana forum
No output schemas documented. Tools return {status, posts} but LLM cannot infer the structure of 'posts' array or its fields. This forces LLMs to guess at response shape and risks downstream tool chaining failures.
Descriptions are too short (10-80 chars vs 194-char baseline). 'Get the latest posts from the Solana forum' lacks context on when to use this vs GET_TOP_POSTS, what fields are returned, or prerequisites. LLMs cannot reliably select between similar tools.
No error handling or recovery guidance. Tools silently fail or return generic {status: 'success'} without documenting what errors are possible, whether they are retryable, or what the LLM should do next. Agents cannot self-correct.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 47 | 2026-07-28+ | v2 |
No tool annotations (readOnlyHint, idempotentHint). All tools are read-only and safe to retry, but this is not declared. LLMs cannot infer safety properties and may avoid retrying on transient failures.
GET_POSTS_BY_CATEGORY enum constraint is present but not described in parameter. LLM sees 'category' param with enum values but no description explaining what each category represents or when to use them.