AI visibility tracker with Codex agent and Claude Code agent subscription measurements plus optional OpenAI, Anthropic, Gemini and Perplexity API measurements — self-hosted, zero dependencies, MCP built in.
Hearsay demonstrates solid tool definition quality with complete schemas, detailed descriptions, and clear parameter constraints. All 12 tools have explicit input schemas with proper JSON Schema types and enums. Descriptions are comprehensive (100-300 chars typical), explaining WHAT the tool does and WHEN to use it. Parameter naming follows verb_noun convention (hearsay_status, hearsay_summary). However, output schemas are not documented, LLMs cannot see what fields to expect from responses. Error handling guidance is absent; tools do not indicate what to do on failure. Tool composition is strong: tools chain naturally (suggest_prompts → setup_tracking → run_panel). No security issues detected (no secrets in params). Main gaps: missing output documentation and error recovery guidance.
List AI-visibility alerts: lost/gained recommendations, competitors overtaking share of AI voice, mention-rate drops — each with severity and the underlying numbers. open_only=true (default) shows unacknowledged alerts.
Fetch the raw stored AI answers (the receipts): full text with detected brand/competitor mentions, recommendation flags and cited URLs. Filter by provider (openai|anthropic|gemini|perplexity), entity_id, prompt_id, days. Paged; limit ≤ 50.
The action list: domains that AI answers cite in answers where the tracked brand is NOT mentioned — who gets cited instead of you, ranked by frequency. The shortlist of places to earn citations for GEO / AI SEO work.
Preview what one measurement panel run would cost before spending anything: total API calls and estimated USD per provider, from the live price table. Costs go to the user's own provider keys.
Phrasing-robust results per tracked intent (question), pooled across its paraphrases: mention rate with Wilson CI, rerun spread vs phrasing spread (variance decomposition). The most honest per-question number Hearsay has — prefer it over per-prompt results when both exist.
Output schemas not documented. LLMs cannot see what fields responses contain, forcing them to guess downstream field names and risk broken tool chains.
No error handling guidance. Tools do not indicate what to do on failure (retryable vs fatal), what invalid values look like, or how to recover. Agents cannot self-correct.
hearsay_answers_search parameter 'provider' enum (openai|anthropic|gemini|perplexity) does not match 'surface' enum values (openai-api|anthropic-api|gemini-api|perplexity-api). Inconsistent naming forces LLM to reason about field mappings.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 62 | 2026-07-28+ | v2 |
Per-prompt (single paraphrase) results, broken down per provider: brand mention rate, whether the brand is recommended, and which entity leads each prompt. Use for drill-down after hearsay_intent_results, or to inspect competitor prompt-space.
Start a measurement panel run (every active prompt × enabled provider × samples) using the user's own API keys. Above the cost threshold this returns a quote_required estimate instead of running — relay the estimate to the human and only retry with confirm:true after they explicitly approve the spend.
Set up or extend AI-visibility tracking in one transactional call: create the brand, competitors, and the intent/paraphrase prompt panel Hearsay measures across ChatGPT, Claude, Gemini and Perplexity. Existing names/prompts are skipped and reported, never duplicated. Only call with prompts the human has reviewed in this conversation.
Check whether the local Hearsay AI-visibility tracker is running and configured: enabled providers (ChatGPT, Claude, Gemini, Perplexity), tracked brand/competitor/prompt counts, last measurement run, schedule, 30-day API spend. Call this FIRST for any AI visibility / GEO / AI SEO / brand-monitoring question.
Preview an explicitly selected Codex agent or Claude Code agent measurement: prompts, samples, exact target count, first-use allowance consent, and included-plan/overage usage model. This never starts a CLI or model request.
Draft tracking intents and paraphrases for the configured brand — the answer to "I don't know which prompts to track". Returns a DRAFT ONLY; nothing is saved. Show the draft to the human for review, then persist the approved set with hearsay_setup_tracking. Works without provider keys (built-in starter pack).
Headline AI-visibility numbers for the tracked brand: share of AI voice vs competitors, brand mention rate with 95% confidence interval and n, recommendation rate, per-provider breakdown across ChatGPT, Claude, Gemini and Perplexity, open alert count, last run.
hearsay_run_panel lacks confirmation/dry-run pattern for a destructive operation (spends user's API budget). Should support cost preview before execution.
hearsay_suggest_prompts and hearsay_setup_tracking accept free-form string parameters (category_hint, keywords, name, aliases) without length limits or validation rules. LLMs may pass invalid values.