Third-party / vendor risk questionnaires with SBOM cross-reference
Single tool 'vendorvet_scan' has a basic description (67 chars) but critically lacks parameter descriptions. The input schema defines 'target' as a string with a description ('Target path or identifier to scan'), which is present but vague. No output schema is documented. The tool name uses a verb prefix (scan) but the description does not explain what 'target' means operationally, is it a file path, URL, package name, or SBOM identifier? No error handling guidance, no pagination, no structured output schema. The implementation returns JSON via to_json(scan(target)), but the response structure is not documented for the LLM. This forces the LLM to guess at output fields and error cases.
Third-party / vendor risk questionnaires with SBOM cross-ref. Returns JSON findings.
Parameter 'target' lacks actionable description. Does not explain whether it accepts file paths, URLs, package identifiers, or SBOM files. LLM cannot infer valid input format.
No output schema documented. The tool returns JSON findings but the response structure (fields, types, nesting) is not specified. LLM cannot plan downstream operations or extract specific risk data.
No error handling guidance. Tool description does not explain what happens if target is invalid, file not found, or SBOM parsing fails. LLM has no recovery path.
Tool description is generic and does not explain when to use vendorvet_scan vs other security tools. 'Third-party / vendor risk questionnaires with SBOM cross-ref' is domain-specific jargon that does not clarify the use case for an LLM.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 50 | 2026-07-28+ | v2 |
STDIO transport only. Server is not remotely accessible and cannot be used by hosted MCP clients. Limits deployment to local CLI environments.