Loading ToolBench
OpenHawk - Global AI intelligence radar platform. Exposes 6-page intelligence capabilities through MCP: Paper Radar, Frontier Radar, AI Finance, AI Industry Reports, AI Policy & Safety, AI OSS & Dev Signals
OpenHawk exposes 25 tools with consistent naming (verb_noun pattern) and basic descriptions. However, most parameter descriptions are minimal (10-30 chars), many lack type constraints, and output schemas are undocumented. Error handling is absent, no recovery guidance, no actionable error messages. Tool composition is reasonable (single responsibility), but parameter validation rules are not stated in descriptions. No tool annotations (readOnlyHint/destructiveHint) despite clear risk levels in metadata.
Perform deep AI analysis on a paper using configurable template
Delete a paper subscription
Delete a subscription for a scope
Fetch fresh intelligence items for a scope from sources
Get global OpenHawk settings
Get detailed information about a specific paper
Get OpenHawk project overview including version, pages, and scopes
Output schemas undocumented. No tool returns a documented schema, LLMs cannot predict response structure or plan downstream calls. E.g., list_pages returns metadata but structure is invisible.
Parameter descriptions are minimal (10-30 chars) and lack validation rules. E.g., 'interval_minutes' says 'Interval in minutes (1-1440)' but no description of what happens if out of range or what the default is.
No error handling guidance. Tools lack recovery hints, if delete_scope_subscription fails, LLM has no guidance on whether to retry, ask user, or abort. No actionable error messages defined.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 51 | 2026-07-28+ | v2 |
Get current schedule settings (interval or cron expression)
Get settings for a specific scope
List all available intelligence pages with metadata
List all paper subscriptions
List papers from the Paper Radar with optional filtering
List intelligence items for a scope with optional filtering
List all sources for a given scope, grouped by region
List all subscriptions for a scope
List all available intelligence scopes
Manually trigger paper subscriptions
Manually trigger subscriptions for a scope
Save global OpenHawk settings
Save settings for a specific scope
Set action on a paper (star, archive, etc.)
Set schedule using cron expression
Set schedule interval in minutes
Create or update a paper subscription
Create or update a subscription for a scope
No tool annotations despite clear risk levels. Metadata marks delete_scope_subscription as DESTRUCTIVE and save_global_settings as WRITE, but no destructiveHint or readOnlyHint in schema. LLMs cannot infer safety constraints.
Enum constraints missing. notify_channel accepts 9 values (feishu, wework, wechat, etc.) but parameter description does not list them, LLM must guess or hallucinate valid values.