Loading ToolBench

Reading the current corpus…

godig MCP server · F · ToolBench

godig

CLI and MCP server for the pkg.go.dev API: search packages, read docs, list versions, symbols, importers and vulnerabilities

<=2025-11-25STDIO18 tools

49/100

Definition Quality53

Protocol Readiness47

Supportability43

Spec posture

Inferred effective spec <=2025-11-25·current baseline 2026-07-28

Static source inference · medium confidence · detected: Logging

Deprecated protocol patterns detected

Summary

godig exposes 18 Go package discovery tools via STDIO. Tool names follow verb_noun convention (overview, search, imported-by, packages, versions, etc.), which is good. However, descriptions are uniformly terse (10-30 chars), well below the 50-200 char LLM-optimized baseline. Parameter descriptions exist but are minimal ('Package path', 'Limit number of results'). Input schemas are visible in tools.go and use proper JSON Schema with types (string, number), but lack constraints (enums, min/max, patterns). Output schemas are not documented, callers cannot predict response structure. Error handling is absent from tool definitions; the handler returns raw errors without recovery guidance. No tool annotations (readOnlyHint, destructiveHint, idempotentHint) despite all tools being read-only. Overall: functional but minimal quality.

Tools (18)

dependenciesread onlysource verified53/100

List dependencies of a module

imported-byread only50/100

List packages that import a given package

major-versionsread onlysource verified53/100

List major versions of a module

module-inforead onlysource verified53/100

Get metadata for a module

module-readmeread only50/100

Get README for a module

overviewread onlysource verified53/100

Get overview information for a package or module

package-docread only50/100

Get documentation for a package

package-examplesread onlysource verified53/100

Get examples for a package or symbol

Issues (5)

HIGHtool-description ↗

Descriptions uniformly under 30 characters (e.g., 'Get overview information for a package or module' is 50 chars but most are 10-25). LLM-optimized descriptions should be 50-200 chars with context on WHEN to use the tool and WHAT it returns.

overviewsearchimported-bypackagesversionsmajor-versionsdependenciessymbolsvulnspackage-infopackage-importspackage-docpackage-examplespackage-licensesmodule-infomodule-readmesymbol-docsymbol-examples

HIGHresponse-shaper ↗

Output schemas not documented. Callers cannot predict response structure (fields, types, pagination). Tools return JSON via mcp.NewToolResultText(string(b)) but no schema is declared.

overviewsearchimported-bypackagesversionsmajor-versionsdependenciessymbolsvulns

Recommendations

Expand tool descriptions to 80-150 chars. Example: 'overview' → 'Get overview information for a package or module, including description, imports, and key metadata. Use this to understand a package before diving into specific symbols or dependencies.'
Document output schemas for each tool. Add a comment block in tools.go or a separate schema file describing response fields (e.g., overview returns {name, description, imports: [], symbols: []}). This enables LLMs to plan downstream calls.
Add input constraints: mark 'limit' parameters with min=1, max=100; add enum constraint to 'format' in package-doc (md|html); add pattern to 'path' parameters (e.g., ^[a-z0-9./]+$).
Implement structured error responses. Instead of mcp.NewToolResultError(err.Error()), return a JSON object with {error, code, retryable, suggestion}. Example: {error: 'Package not found', code: 'NOT_FOUND', retryable: false, suggestion: 'Try search() with a partial name.'}
Add readOnlyHint to all tool definitions via mcp.WithReadOnly() or equivalent. This signals to agents that these tools are safe to call without side effects.

Spec posture evidence

Inferred effective spec: <=2025-11-25.

Relies on Logging (deprecated) - log to stderr or use OpenTelemetry

Score history

Overall score trend

First recorded score · v2 rubric

49/100

Scored	Grade	Overall	Spec posture	Rubric
2026-09-23	F	49	<=2025-11-25	v2