MCP server bridge for LiteLLM. Connects to a deployed LiteLLM instance and exposes its capabilities as MCP tools.
Server defines 9 tools with complete input schemas and basic descriptions. However, descriptions are generic and lack LLM-optimized guidance on WHEN to use each tool or what distinguishes them. Parameter descriptions are minimal (e.g., 'The model to use' without format/constraint details). No output schemas documented. Error handling is absent, makeLiteLLMRequest throws generic errors without recovery guidance. Tools lack idempotency hints, permission declarations, and composition guidance. Naming is clear (verb_noun pattern) but descriptions fall short of production baseline (194 chars avg; these average ~80 chars).
Generate chat completions using LiteLLM. Supports all models available in your LiteLLM instance.
Generate text completions (legacy endpoint) using LiteLLM.
Generate embeddings using LiteLLM
Generate images using LiteLLM (/images/generations)
Generate speech audio from text using LiteLLM (/audio/speech)
Check the health status of your LiteLLM instance
No output schemas documented. LLMs cannot plan downstream calls or extract required fields. chat_completion, completion, create_embedding, create_image, create_speech, rerank all lack return type documentation.
Error handling is generic and non-actionable. makeLiteLLMRequest throws 'Failed to connect to LiteLLM' or 'LiteLLM API error' without recovery guidance. LLMs cannot determine if errors are retryable, user-fixable, or fatal.
Descriptions are too generic and lack LLM-optimized guidance. 'Generate chat completions using LiteLLM' (80 chars) does not explain WHEN to use chat_completion vs completion, what models are available, or what the response contains. Baseline is 194 chars.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 54 | 2026-07-28+ | v2 |
List all available models from your LiteLLM instance
Get detailed information about a specific model
Rerank documents based on a query using LiteLLM (/rerank)
Parameter descriptions lack format/constraint details. 'The model to use' does not specify valid format, examples, or how to discover available models. 'Sampling temperature (0-2)' lacks guidance on typical values or impact. Descriptions should include constraints and discovery hints.
No tool annotations (readOnlyHint, destructiveHint, idempotentHint). All tools are marked READ_ONLY in metadata but lack formal annotations. LLMs cannot determine if tools are safe to retry or have side effects.