Local-first course material hub with source-grounded AI study tools. Private local-first study library server.
Critical gaps across all dimensions. Tool names lack action verbs (scan, verify, reindex, status are weak; handle_* prefix is generic). Most tools (20/25) have no visible input schemas in the provided code. Descriptions are present but generic (avg ~60 chars, well below 194-char baseline). No output schemas documented. Parameters lack type definitions and constraints. Error handling and recovery guidance absent. This server prioritizes HTTP transport but definition quality is far below production baseline.
Synchronize course materials with OpenAI vector store for AI-powered study assistance
Get context information for AI study assistance
Process AI study assistance requests with source-grounded responses from course materials
Retrieve a stored AI study conversation by ID
Modify AI study conversations (rename, duplicate, delete, clear)
Search and list stored AI study conversations
Retrieve list of courses in the study library
Generic handle_* prefix on 13 tools violates verb_noun naming convention. Names like 'handle_ask', 'handle_conversation_get' are vague and do not convey action. Should be 'ask_question', 'get_conversation', 'list_conversations'.
20 of 25 tools have no visible input schema in provided code. Cannot verify parameter types, constraints, or descriptions.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 37 | 2026-07-28+ | v2 |
Retrieve detailed information about a specific course material file
Generate a preview of a course material file (HTML, text, or image)
Retrieve course material files with optional filtering and pagination
Get server health status and configuration information
Retrieve teacher-provided questions from course materials
Trigger a scan of the study library for new and updated materials
Get session information including CSRF token
Retrieve server configuration settings
Update server configuration settings
Upload course material files to the study library
Generate AI study responses using locally indexed course materials without OpenAI
Reindex the study library for search functionality
Scan the study library for new and updated course materials
Scan the study library directory for course materials and extract metadata
Search the study library for course materials and questions
Get the current status of the study library and server
Synchronize course materials with OpenAI vector store for AI-powered retrieval
Verify the integrity of the study library database
No output schemas documented for any tool. LLMs cannot plan downstream calls or extract required fields. Baseline: 100% of A+ tools have documented return types.
Weak action verbs: 'scan', 'verify', 'reindex', 'status' do not clearly signal what happens. 'scan' could mean read, index, or validate. Should be 'scan_library', 'verify_database', 'reindex_search', 'get_status'.
No error handling guidance. Tools lack recovery hints (e.g., 'If sync fails, check OPENAI_API_KEY'). Baseline: error responses must tell LLM what to do next.