MCP server exposing an autonomous research agent pipeline that runs a full research workflow (Planner -> Researcher -> Synthesizer -> Critic/Reviser) to produce cited, self-critiqued reports
Single tool with clear purpose and good description (194 chars, within baseline 34-392 range). Input schema present with type and description. However, output schema is undocumented, LLMs cannot predict the markdown structure or plan downstream processing. No error handling guidance, no parameter constraints, and no indication of side effects (cost warnings, API rate limits, timeouts). Tool is well-intentioned but lacks production-grade robustness.
Run the full autonomous research pipeline on a question and return a cited, self-critiqued report as markdown. This runs Planner -> Researcher -> Synthesizer -> Critic/Reviser (up to 2 revision passes) end to end. It makes multiple LLM and web search API calls and typically takes well over a minute -- this is a genuine research task, not a quick lookup, and should be called accordingly.
Output schema undocumented. Tool returns markdown string with embedded structure (title, summary, body, gaps, sources) but LLMs cannot predict or parse this format. Requires structured output schema with typed fields (title: string, summary: string, body_markdown: string, citations: [{source_title, source_url}], known_gaps: [string], revision_count: int).
No error handling or recovery guidance. Tool description warns 'typically takes well over a minute' and makes 'multiple LLM and web search API calls' but provides no guidance on timeouts, rate limits, or failure modes. LLMs cannot distinguish retryable failures from fatal ones.
No input validation or constraints. Parameter 'question' accepts any string with no length limits, format guidance, or examples. LLMs may pass empty strings, extremely long queries, or malformed input without feedback.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 57 | 2026-07-28+ | v2 |
Cost and side-effect warnings buried in description. Tool description mentions 'COST WARNING!!!' in comments and warns about API calls, but this critical information is not surfaced in the tool description itself. LLMs may not recognize the financial and latency implications.
No idempotency or confirmation pattern. Tool performs irreversible API calls (web searches, LLM invocations) with no dry-run, confirmation, or rollback capability. Agents cannot safely retry on ambiguous failures.