AI Visibility Audit

How to Run an Evidence-Traceable AI Visibility Audit

An evidence-traceable audit starts with confirmed brand facts, fixed questions, and a task matrix, then preserves raw answers, citations, failures, and quality judgments.

GrayRhino AI Methodology and ResearchUpdated 3 min read

Publisher: GrayRhino AI · Owner: Methodology and content owner · Review: Fact and methodology reviewer · Reviewed 2026-09-22

Confirm facts before generating questions

GrayRhino AI method

The audit first confirms brand identity, website, services, audience, scenarios, comparison scope, and measurement authorization. Questions can use only confirmed facts included in the brief. Record a parent brand, homonym, or separate content domain when relevant; an unknown fact stays unknown rather than being filled by a suggestion.

Review the four base question intents after confirming the brief: unbranded discovery, scenario recommendation, brand understanding, and facts or sources. Only a confirmed competitor and comparison scope justify the optional comparison question. Save the final text, order, and source plan before any run.

Preserve more than screenshots

External fact

Google does not guarantee crawling, indexing, or display. Baidu's API documentation exposes answer and reference structures. Both points require measurement to preserve actual responses rather than assume success.

GrayRhino AI method

Each task keeps the question, source, raw answer, citation URLs, failures, and missing state. Facts, analysis, and proposed actions remain separate. First check task completeness, then whether each completed answer addressed the question and correctly identified the brand and website, and only then aggregate metrics.

A proposed action needs a specific question and answer anchor. 'Clarify the service use case on the website' is actionable only when an answer omits or misstates that case and the team can inspect the underlying text. A generic recommendation inferred from a score is not enough.

From an audit task to a testable action

Synthetic example

Synthetic teaching example: an equipment-analysis service confirms its website and customer segment. Four questions across two sources create eight expected tasks. If five complete, two fail, and one is missing, show completion coverage of 5/8 and retain both failures. The five returned answers alone are not the complete run.

One completed scenario answer mentions the brand but cites an industry article rather than the confirmed website. Attach the question, answer excerpt, and citation URL to a proposed website clarification. On a same-condition retest, observe whether the citation changes without promising that the edit caused it. The brand and numbers here are instructional, not customer evidence.

How GrayRhino AI measures this issue

GrayRhino AI method

The confirmed question plan and measurement source plan create an expected task matrix. Failures remain in completion coverage, while quality analysis handles relevance, homonyms, website ownership, and source classification. Undecidable claims go to human confirmation rather than being treated as absence; delivery keeps the original evidence and review decision together.

What an audit can establish

Limitation

An audit can establish request-level evidence and observable change. It cannot represent every consumer experience or automatically attribute a later change to one content edit.

Sources

Related reading