QuantGPT — AI-driven quantitative strategy backtesting platform. MCP server for factor backtesting with agent-driven workflow supporting factor expression validation, backtesting, scoring, diagnosis, anti-overfit detection, and rolling validation.
QuantGPT provides 8 tools with complete input schemas and descriptions, but quality is inconsistent. Tool names follow verb_noun convention (list_, validate_, run_, score_, diagnose_). Descriptions are present but vary in clarity, some are terse (list_operators: 16 chars), others adequate (run_backtest: 47 chars). Critical gap: NO output schemas documented for any tool. Parameters have types and enums where appropriate (e.g., run_backtest universe enum), but descriptions lack actionable constraints (e.g., date format YYYY-MM-DD stated but no validation guidance). Error handling is absent, no recovery guidance, no categorization of retryable vs fatal errors. Tools are READ_ONLY, reducing risk, but composition is weak: tools like score_factor, diagnose_factor, run_anti_overfit, run_rolling_validation accept identical parameter sets, suggesting potential consolidation. No tool annotations (readOnlyHint, idempotentHint) present despite all being read-only.
Diagnose factor issues and suggest mutations to improve performance.
返回因子表达式支持的全部操作符及用法说明。Agent 据此生成因子表达式。
返回可用股票池列表及说明。
Run anti-overfit detection on factor to assess robustness.
执行因子回测,生成 QuantStats HTML 报告。
Run walk-forward rolling validation on factor.
Compute composite factor quality score based on backtest metrics.
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields without knowing response structure.
Terse descriptions for discovery tools (list_operators: 16 chars, list_universes: 12 chars) lack context for LLM selection. Descriptions should explain WHAT, WHEN, and WHY.
Four tools (score_factor, diagnose_factor, run_anti_overfit, run_rolling_validation) accept identical parameter sets. Composition is unclear, should these be variants of a single tool or separate concerns?
Inferred effective spec: 2026-07-28+.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 62 | 2026-07-28+ | v2 |
验证因子表达式语法是否正确。返回 OK 或错误信息。
No error handling guidance. Tools return success/failure but do not indicate whether errors are retryable, user-fixable, or fatal. No recovery suggestions.
Tool annotations missing. All tools are read-only but lack readOnlyHint annotation. Agents cannot infer safety without explicit hints.