Loading ToolBench
Provides shell formatting commands for .NET projects, enabling GitHub Copilot and agent-based tools to format entire projects, individual files, directories, or apply EditorConfig and analyzer rules via the dotnet format CLI.
Two tools with basic schemas and descriptions, but significant gaps in parameter documentation, output schema clarity, and error handling. ReFormatProject and ReFormatFile both have descriptions (60-80 chars, below the 194-char baseline), but parameter descriptions are minimal. Schemas are present but lack output documentation. No error handling guidance, no validation rules, no recovery paths. Tool names use verb_noun pattern (good), but descriptions don't explain WHEN to use each tool or what distinguishes them. No mention of prerequisites, side effects, or expected output format.
Provides shell command what reformats a specific file in the .NET project using the dotnet format CLI. Enables targeted formatting for Copilot and agent tools.
Provides shell command what reformats the entire .NET project using the dotnet format CLI.
Output schema not documented. Tools return JSON with Type, Command, Arguments fields, but LLMs cannot see this structure in tool definitions. No documentation of what fields to expect or how to parse the shell command response.
Descriptions lack WHEN/WHY guidance. Both tools describe WHAT they do but not when to choose ReFormatProject vs ReFormatFile, or what prerequisites exist (e.g., dotnet CLI must be installed, project must be valid).
No error handling or recovery guidance. If dotnet format fails (invalid project path, missing CLI, permission denied), tools return raw JSON with no indication of success/failure or what the LLM should do next.
Parameter descriptions are minimal (20-40 chars, below 72-char baseline). 'Absolute path to the .NET project file' lacks format constraints, validation rules, or examples of valid vs invalid paths.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 42 | <=2025-11-25 | v2 |
No idempotency or side-effect documentation. Descriptions don't clarify whether running ReFormatFile twice on the same file is safe, or whether formatting modifies the file in-place (destructive operation).