Agent Readiness Audit

/digital-marketing-pro:agent-readiness-audit

Script location. If your host does not set ${CLAUDE_PLUGIN_ROOT}, the scripts are in this plugin's scripts/ folder, next to skills/.

Purpose

Answer one question with evidence: can AI agents and AI crawlers use this site? Concretely, the audit checks five things:

• AI crawlers are allowed to reach the content.
• The content is in the HTML the server sends, so it does not depend on JavaScript running.
• Structured data says what the page is.
• The product feed is complete enough for AI shopping surfaces.
• Optionally, the site exposes agent tools (WebMCP).

Every check is deterministic and runs in scripts/agent-readiness-audit.py. The skill adds interpretation and the brand's policy decisions on top of the script's output; it never replaces that output with judgment.

What the primary sources say (checked 2026-10-04)

From Google's AI optimization guide (last updated 2026-07-10):

• No special files. Under the heading "Mythbusting generative AI search", Google lists "LLMS.txt files and other 'special' markup". It says "You don't need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search (including its generative AI capabilities), as Google Search itself doesn't use them." This skill never recommends llms.txt for Google.
• Structured data: "Structured data isn't required for generative AI search, and there's no special schema.org markup you need to add." The audit checks JSON-LD because it powers rich results (merchant listings, organization info), not because AI features require it.
• JavaScript: "Google is able to process content within JavaScript as long as it isn't blocked." The no-JS check is a robustness test: content that is already in the server HTML can be read by every crawler and agent, whether or not it runs JavaScript.
• Agents: browser agents may analyze screenshots, inspect the DOM structure, and interpret the accessibility tree. Hence the accessibility-basics check. Google names the Universal Commerce Protocol (UCP) as an emerging protocol.

AI crawler tokens (each verified on the vendor's own page)

"Policy" means that blocking training crawlers is the brand's choice. The audit reports it as info unless the brand sets --training-policy allow|block, in which case a mismatch fails the check.

Inputs

All checks run offline on files the user exports. The script fetches over the network only with --fetch.

• robots.txt: --robots FILE, or --site URL --fetch. Add --path /products/ (repeatable) to test the paths that matter, beyond /.
• Server HTML: --html FILE (repeatable). Save it as the server sends it, for example with curl -L URL > page.html, not "Save as" from a browser, which saves the post-JavaScript DOM. Add --expect "Product name" (repeatable) for text that must be in that HTML, such as a product name or price.
• Merchant Center feed export: --feed FILE (TSV, CSV, or RSS/Atom XML with g: attributes).
• Agentic-commerce product feed (optional): --acp-feed FILE. Accepts the JSONL "OpenAI format" or the Google-compatible CSV/TSV (spec).
• WebMCP (optional, experimental): --webmcp.
• Brand policy: --training-policy either|allow|block. The default, either, reports training-crawler rules without judging them.

Process

1. Load brand context. Read ~/.claude-marketing/brands/_active-brand.json, then ~/.claude-marketing/brands/{slug}/profile.json.

   • From the profile, take the domain, whether the brand sells products (feed checks apply), and any stated AI-training policy (sets --training-policy).
   • If no brand exists, ask: "Set up a brand first (/digital-marketing-pro:brand-setup)?" or proceed with the inputs the user gives.

2. Collect inputs. Ask for exports first. If the user only has a URL, confirm they want a live fetch before using --fetch.

3. Run the audit.

   python "${CLAUDE_PLUGIN_ROOT}/scripts/agent-readiness-audit.py" \
       --robots robots.txt --path /products/ \
       --html home.html --html product.html --expect "Acme Anvil" \
       --feed products.tsv --acp-feed openai-feed.jsonl --webmcp \
       --training-policy either --format json > "${CLAUDE_PLUGIN_DATA}/{brand}/seo/agent-readiness/{date}/02-audit.json"

   Live variant, used only when the user agreed to network access:

   python "${CLAUDE_PLUGIN_ROOT}/scripts/agent-readiness-audit.py" --site https://example.com --fetch \
       --page https://example.com/products/anvil --format json

   Exit codes:

   • 0: no check failed (warnings allowed)
   • 1: at least one check failed
   • 2: bad input (nothing to audit, a missing or unparseable file, a bad flag)

   On 2, fix the input and re-run. Do not interpret a partial run.

4. Interpret each check. Report the script's status per check: pass, warn, fail, info or skipped.

   • robots_ai_crawlers: a blocked search, user-fetch or ads bot is a fail. Name the bot and quote what blocking it costs, from the table above.
   • structured_data:
     • an unparseable JSON-LD block is a fail
     • a Product without offers is a warn, because merchant-listing rich results require name, image and offers (Google)
     • no Organization markup anywhere is a warn
     • FAQPage is fine to keep, but Google shows FAQ rich results only for "well-known, authoritative government and health websites" (Google)
   • no_js_render: a fail when visible text is below the floor (--min-text, default 250 characters), when an app-shell root (#root, #__next, #app, ...) holds little text, or when an --expect phrase is missing from the server HTML.
   • accessibility_basics: warn only. Covers a missing <html lang>, images without alt, unlabelled inputs, and unnamed buttons.
   • merchant_feed:
     • Fail conditions:
       • any required attribute is missing: id, title, description, link, image_link, availability, price (product data spec)
       • an availability value is outside in_stock, out_of_stock, preorder, backorder
       • a native_commerce(checkout_eligibility) value is not TRUE/FALSE
     • native_commerce: report how many products opt into checkout on Google. Only listings with native_commerce(checkout_eligibility) = TRUE show the "Buy" button. The feature is for select merchants, with products eligible in the US, Canada and Australia (Merchant Center help; UCP guide). The account-level return policy and customer-support contact can't be checked from a feed, so list them as manual checks.
     • Conversational attributes (question_and_answer, document_link, related_product, item_group_title, variant_option, popularity_rank) are optional (help). Report their coverage; never fail on them.
   • acp_feed: optional. If supplied, missing required fields are a fail. Report the is_eligible_search / is_eligible_checkout counts.
   • webmcp: always info. WebMCP is a Chrome origin trial (from Chrome 149) and "under active discussion and subject to change" (Chrome docs). Report the declarative toolname / tooldescription forms and the inline registerTool calls found. Recommend nothing beyond "optional experiment".

5. Decide policy questions with the user, not for them. Two are the brand's call: whether to block training crawlers, and whether to opt products into checkout on Google. Present the trade-off and the source.

6. Prioritize fixes. Use the script's recommendations array as the backbone.

   • Order by impact: blocked answer engines → content missing from server HTML → broken JSON-LD → feed required attributes → everything else.
   • Route the work: rendering to /digital-marketing-pro:tech-seo-audit, markup to /digital-marketing-pro:entity-audit, and visibility follow-up to /digital-marketing-pro:aeo-geo.