A NeoForge Minecraft mod development starter project with AI-assisted tooling, featuring trust hardening agents, test coverage telemetry, and runtime behavior witnessing.
This server has critical definition gaps. Of 6 tools, only 3 have visible input schemas (migrate_v1_to_v2, validate_benchmark_suite, check_toolkit_hygiene). The other 3 (fetchJars, integrationTest, check_doc_index) show no input schema in the provided source. Descriptions exist but are inconsistent in quality: some are detailed (migrate_v1_to_v2: 'Create a reviewable Major Feature Contract v2 draft...'), others are vague (integrationTest: 'Runs the witness agent integration harness'). No tool has documented output schemas. No error handling guidance. No parameter validation rules. Tool names are reasonable (verb-noun style) but lack the precision needed for LLM disambiguation. This is a development/CI toolkit, not a user-facing agent tool, which explains the gaps, but MCP servers must still meet the rubric standard.
Verify that every NeoForge skill reference / example / playbook markdown file is linked from skills/neoforge/SKILL.md, and that every such link target exists. Also enforces playbook count cap (<= 5) when playbooks/ exists.
Check changed toolkit text and normative command-entry hygiene. Audits the Git changed set without requiring a clean worktree, skips ignored and binary files, never prints secret/path match values.
Downloads the pinned JaCoCo agent/CLI jars into lib/.
Runs the witness agent integration harness (fixture JVMs, loopback listener).
Create a reviewable Major Feature Contract v2 draft from a valid v1 contract. The source is never modified and every output is created exclusively. The migration preserves all v1 behavior declarations, promotes tests[*].covers into stable atomic criteria, and records every decision that still needs human/design review.
Validate and summarize repeatable flagship-mod AI benchmark runs. Validates suite configuration and run results against schema.
4 of 6 tools have no visible input schema. fetchJars, integrationTest, check_doc_index lack parameter definitions entirely.
No tool documents its output schema. LLMs cannot plan downstream calls or extract return values without knowing what fields to expect. Baseline: 100% of A+ tools have documented return types.
No error handling guidance. Tools provide no recovery hints (e.g., 'If validation fails, check schema at...').
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 37 | 2026-07-28+ | v2 |
Parameter descriptions are sparse or missing. check_toolkit_hygiene has 'root' param with minimal context ('Project root directory path'). No format constraints, no examples of valid input. Baseline: 100% of A+ tool params have descriptions; these lack depth.
Tool descriptions lack WHEN/WHY context. 'Runs the witness agent integration harness' does not explain when an LLM should call this vs. other tools, or what problem it solves. State WHAT the tool does, WHEN to use it, and any prerequisites.'