Loading ToolBench
MCP server for Southwest Airlines — search flights, manage bookings, check-in, boarding passes, and Rapid Rewards via browser automation
Server has 13 tools with complete schemas and descriptions. Naming follows verb_noun convention (search_flights, get_flight_details, check_in). Descriptions are substantive (100-200 chars typical), explaining WHAT and WHEN. However, critical gaps: (1) select_flight has empty required array and no documented parameters, schema is incomplete; (2) get_reservation has empty required array with no visible parameters; (3) checkout exposes credit card fields as parameters (cardNumber, cardCvv, cardZip), violates secret-injection pattern; (4) no output schemas documented for any tool; (5) error handling descriptions are absent; (6) no idempotency or confirmation patterns for destructive ops (cancel_flight, change_flight). Zod schema conversion to JSON Schema is present but incomplete, enums are captured, but descriptions are not always propagated. Average tool score: 62/100.
Add Early Bird Check-In to an existing reservation. Southwest automatically checks you in 36 hours before departure for a better boarding position (~$15-25 per person per flight).
Search for flights and book using Rapid Rewards points. Shows points pricing for all fare classes. Requires logged-in account.
Cancel a Southwest reservation. Wanna Get Away fares receive travel funds (valid 12 months). Anytime/Business Select fares are fully refundable.
Modify an existing Southwest booking. Southwest never charges change fees — you only pay/receive credit for fare differences.
Check in online for a Southwest flight. Check-in opens exactly 24 hours before departure. Returns boarding group (A/B/C) and position number.
Complete a flight booking by entering passenger information and payment details. Use after selecting a flight with select_flight.
Sensitive payment data (cardNumber, cardCvv, cardZip) exposed as tool parameters in checkout tool. Violates secret-injection pattern, credentials in params leak into agent logs and traces.
select_flight and get_reservation have empty required arrays and no visible parameter definitions. Schemas are incomplete, cannot determine what inputs these tools accept.
No output schemas documented for any of the 13 tools. LLMs cannot plan downstream calls or extract required fields (e.g., confirmation numbers, flight IDs) without knowing response structure.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 56 | 2026-07-28+ | v2 |
Retrieve boarding pass with boarding group and position (e.g. A32, B15). Optionally saves as PDF. Must be checked in first.
Compare all Southwest fare classes (Wanna Get Away, Wanna Get Away+, Anytime, Business Select) with prices and benefits for a route.
Get detailed information about a specific Southwest flight including status, stops, duration, gate, and aircraft type.
Check Rapid Rewards account balance, tier status (A-List, A-List Preferred), and Companion Pass progress.
Look up an existing Southwest reservation by confirmation number and passenger name. Returns flight details, fare type, and booking status.
Search for available Southwest Airlines flights between two airports. Returns flights with fare options (Wanna Get Away, Anytime, Business Select) and pricing.
Select a flight from search results with a specific fare type. Use after search_flights to proceed with booking.
Destructive operations (cancel_flight, change_flight) lack confirmation or dry-run patterns. No guidance on error recovery or what to do if cancellation fails. Agents may execute irreversible actions without safeguards.
No error handling guidance in tool descriptions. Tools do not explain what errors are retryable, user-fixable, or fatal. LLMs cannot determine recovery strategy on failure.