Agent skill

Yao Chatgpt Crawler

by yaojingang in yaojingang/yao-geo-skills

A skill your agent uses when a user provides ChatGPT web AI-search keywords, repeat count, target entity, entity type, OpenCLI profile, and crawl interval preference, then needs repeated crawls…

MITAuto-check passedData & Analytics

Install Yao Chatgpt Crawler

skills CLI
$ npx skills add yaojingang/yao-geo-skills --skill yao-chatgpt-crawler -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install yaojingang/yao-geo-skills yao-chatgpt-crawler --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/yaojingang/yao-geo-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/yao-chatgpt-crawler .claude/skills/yao-chatgpt-crawler && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
yao-chatgpt-crawler
GitHub stars
871
Token cost
~456 tokens
SKILL.md length
173 words
Files
30 (incl. scripts, references)
Skills in repo
24
Repo updated
First seen
Licence
MIT

At a glance

A skill your agent uses when a user provides ChatGPT web AI-search keywords, repeat count, target entity, entity type, OpenCLI profile, and crawl interval preference, then needs repeated crawls…

  • Works in 5 steps: Read references/user-setup-and-usage.md,… → Run node scripts/preflight.mjs --profile… → Stage 1: run… → …
  • A user provides ChatGPT web AI-search keywords
  • SKILL.md covers Inputs, Workflow and Honest Boundaries
  • Calls node

What it does

Yao Chatgpt Crawler is an agent skill from yaojingang/yao-geo-skills. Use when a user provides ChatGPT web AI-search keywords, repeat count, target entity, entity type, OpenCLI profile, and crawl interval preference, then needs repeated crawls aggregated into JSON plus a Kami HTML GEO report. Not for generic crawling, ChatGPT API chat, SEO writing, or one-off answers.

Its SKILL.md is about 460 tokens, which your agent loads only when the skill is triggered. The skill folder holds 35 other files, including scripts and reference files (for example `README.md`, `agents/interface.yaml` and `evals/expected_artifacts.json`).

It sits in Data & Analytics, covering Web scraping. It works with OpenAI. The repository describes itself as: An open-source Skill collection for GEO content and workflows, continuously updated. The licence is MIT.

When your agent uses it

  • A user provides ChatGPT web AI-search keywords
  • OpenCLI profile
  • Crawl interval preference
  • Then needs repeated crawls aggregated into JSON plus a Kami HTML GEO report

Example prompts

  • “/yao-chatgpt-crawler”

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. Read references/user-setup-and-usage.md, references/chatgpt-crawl-workflow.md, and references/report-contract.md as needed.
  2. Run node scripts/preflight.mjs --profile before fresh crawling.
  3. Stage 1: run scripts/chatgpt_batch_crawl.mjs with questions, repeat, profile, target entity/type, interval preset, and output dir.
  4. Stage 2: run scripts/analyze_chatgpt_results.py. Follow the competitor-review rules in the workflow reference; a target-only alias file…
  5. Return crawl JSON, summary, structured Markdown/Excel, HTML report, optional semantic-review cache, and failed logs.

What it can do on your machine

Read from SKILL.md and the folder at commit d21bfc1. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships 1 file in scripts/, which the agent can run.

    Shell commands in SKILL.md call:

    • node

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Yao Chatgpt Crawler loads about 456 tokens when it runs, and up to ~9.6k if it reads all its reference files. Until then it costs about 80 tokens; SKILL.md has 173 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~80
When it runs · the whole SKILL.md, loaded when a task matches
~456
With references · SKILL.md plus every file in references/, read only if the agent opens them
~9.6k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from yaojingang/yao-geo-skills at commit d21bfc1, republished under its MIT licence (© yaojingang). 173 words, ~456 tokens.

Download SKILL.mdSave it as .claude/skills/yao-chatgpt-crawler/SKILL.md (or your agent's skills folder). This skill also uses 29 other files; get the full folder from GitHub.
name
yao-chatgpt-crawler
description
Use when a user provides ChatGPT web AI-search keywords, repeat count, target entity, entity type, OpenCLI profile, and crawl interval preference, then needs repeated crawls aggregated into JSON plus a Kami HTML GEO report. Not for generic crawling, ChatGPT API chat, SEO writing, or one-off answers.

Yao ChatGPT Crawler

Inputs

Questions, repeat count, target entity/type (person/company/product), browser profile, delay preset, optional output directory, and same-type competitors.

Use random 30s-1m by default; support 1-3m and 3-10m when requested.

Workflow

  1. Read references/user-setup-and-usage.md, references/chatgpt-crawl-workflow.md, and references/report-contract.md as needed.
  2. Run node scripts/preflight.mjs --profile <profile> before fresh crawling.
  3. Stage 1: run scripts/chatgpt_batch_crawl.mjs with questions, repeat, profile, target entity/type, interval preset, and output dir.
  4. Stage 2: run scripts/analyze_chatgpt_results.py. Follow the competitor-review rules in the workflow reference; a target-only alias file never disables inference.
  5. Return crawl JSON, summary, structured Markdown/Excel, HTML report, optional semantic-review cache, and failed logs.

Honest Boundaries

  • Reuses local ChatGPT web automation; does not bypass login, bot checks, or hidden data.
  • Visible ChatGPT citations bound source analysis; probability metrics are repeated-sample estimates.
  • Inferred competitors are heuristic. Review aliases before external use; use --semantic-review required when formal-report confidence demands it.
  • The entity table is an audit surface; only rows entering the competitor matrix affect metrics.
  • Preserve raw answers, reference titles, URLs, and logs so every conclusion can be audited.

© yaojingang, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 29 other files (scripts, references) in skills/yao-chatgpt-crawler of yaojingang/yao-geo-skills.

  • SKILL.md
  • README.md
  • agents/interface.yaml
  • evals/expected_artifacts.json
  • evals/rubric.md
  • evals/trigger_cases.json
  • examples/doubao-model-products-real/README.md
  • examples/doubao-model-products-real/brands-model-products.txt
  • examples/doubao-model-products-real/chatgpt-crawl.json
  • examples/doubao-model-products-real/questions.txt
  • examples/doubao-model-products-real/report/report.html
  • examples/doubao-model-products-real/report/structured-data.md
  • examples/doubao-model-products-real/report/summary.json
  • fixtures/sample-chatgpt-crawl.json
  • manifest.json
  • … and 15 more

Open the folder on GitHubat commit d21bfc1

Compare with similar skills

Yao Chatgpt Crawler next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Yao Chatgpt Crawler compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Yao Chatgpt Crawler this skillyaojingang/yao-geo-skills871—~456Automated safety check: PassMIT
Selenium Opinion Crawler123321kk/opinion-agent-ultimate107—~631Automated safety check: PassNone
Chatgpt SearchSeifBenayed/cloclo114—~1.7kAutomated safety check: NotesMIT
Geo Crawlerssickn33/agentic-awesome-skills47k1 repos~4.8kAutomated safety check: NotesMIT
LLM Crawler Access Checkdavepoon/buildwithclaude3.6k—~1.5kAutomated safety check: PassMIT
Chat Connectorsgarrytan/gbrain31k—~2.8kAutomated safety check: PassMIT

Similar skills

  • Selenium Opinion Crawler

    123321kk/opinion-agent-ultimate

    browser-based page capture and text extraction for public-opinion research.

    107 GitHub stars~631 tokensUpdated 6 mo ago
    Data & AnalyticsAuto-check passed
  • Chatgpt Search

    SeifBenayed/cloclo

    Search ChatGPT and extract the full response + hydration JSON that powers the UI.

    114 GitHub stars~1.7k tokensUpdated 6 mo ago
    Data & AnalyticsAuto-check: notes
  • Geo Crawlers

    sickn33/agentic-awesome-skills

    AI crawler access analysis.

    47k GitHub starsUsed in 1 repo~4.8k tokens
    Data & AnalyticsAuto-check: notes
  • LLM Crawler Access Check

    davepoon/buildwithclaude

    Check whether a website's robots.txt allows the AI crawlers that decide visibility in ChatGPT Search, Perplexity, Claude, Gemini, and Microsoft Copilot.

    3.6k GitHub stars~1.5k tokensUpdated 2 days ago
    Data & AnalyticsAuto-check passed
  • Chat Connectors

    garrytan/gbrain

    Connect a ChatGPT or Claude account and sync its conversation history into the brain automatically.

    31k GitHub stars~2.8k tokensUpdated yesterday
    Productivity & AutomationAuto-check passed
  • Nuxt Geo Best Practices

    vinayakkulkarni/nxui

    Nuxt GEO (Generative Engine Optimization) guidelines for getting cited by ChatGPT, Perplexity, Claude, Google AI Overviews, and Gemini.

    212 GitHub stars~1.9k tokensUpdated 2 days ago
    Marketing & SEOAuto-check passed

More from yaojingang/yao-geo-skills

All 24 skills in this repo
  • Yao Geo Knowledge Base Builder

    yaojingang/yao-geo-skills

    Build evidence-backed GEO brand knowledge bases from official sites, product pages, help centers, white papers, sales materials, media releases, certifications, and trusted third-party sources.

    871 GitHub stars~1.8k tokensUpdated 10 days ago
    Auto-check passed
  • Yao Geo Title Optimizer

    yaojingang/yao-geo-skills

    A skill your agent uses when Chinese content teams need GEO title candidates, scoring, compliance review, or title-to-article mapping for articles, pages, FAQs, comparisons, and topic hubs.

    871 GitHub stars~2k tokensUpdated 10 days ago
    Auto-check passed
  • Yao Geo Tracking

    yaojingang/yao-geo-skills

    Build a company-specific GEO backend tracking plan from a company name plus optional supporting information, using authoritative retrieval anchored on the official website, business-feature…

    871 GitHub stars~1.5k tokensUpdated 10 days ago
    Auto-check passed
  • Yao Deepseek Crawler

    yaojingang/yao-geo-skills

    A skill your agent uses when a user provides DeepSeek web AI-search keywords, repeat count, target entity, and entity type, then needs repeated fresh-window crawls aggregated into JSON plus a Kami…

    871 GitHub stars~624 tokensUpdated 10 days ago
    Auto-check passed
  • Yao Geo Execution Roadmap

    yaojingang/yao-geo-skills

    当用户需要把 GEO 全景诊断、机会地图、AI 平台采样结论或品牌事实底座转成 30/60/90 天综合实施方案时使用,输出页面技术、内容矩阵、标题体系、知识库、外部证据、监测闭环、角色分工、验收指标和四格式报告;覆盖 DeepSeek、豆包、千问、Kimi、元宝;不用于从零做全景采样诊断或只写单篇内容。

    871 GitHub stars~646 tokensUpdated 10 days ago
    Auto-check passed
  • Yao Geo Intent Miner

    yaojingang/yao-geo-skills

    A skill your agent uses when a user asks for GEO 意图拓词、AI 搜索意图挖掘、AI 搜索问题集、问题簇、追问链路、查询重写、内容选题库、FAQ 题库、监测 Prompt 库, or AI Intent Miner.

    871 GitHub stars~500 tokensUpdated 10 days ago
    Auto-check passed

Works with

Questions about Yao Chatgpt Crawler

What does Yao Chatgpt Crawler do?

A skill your agent uses when a user provides ChatGPT web AI-search keywords, repeat count, target entity, entity type, OpenCLI profile, and crawl interval preference, then needs repeated crawls…. Yao Chatgpt Crawler is an agent skill from yaojingang/yao-geo-skills. Use when a user provides ChatGPT web AI-search keywords, repeat count, target entity, entity type, OpenCLI profile, and crawl interval preference, then needs repeated crawls aggregated into JSON plus a Kami HTML GEO report.

When should I use Yao Chatgpt Crawler?

Yao Chatgpt Crawler fits situations like: A user provides ChatGPT web AI-search keywords; openCLI profile; crawl interval preference; then needs repeated crawls aggregated into JSON plus a Kami HTML GEO report.

How do I install Yao Chatgpt Crawler in Claude Code?

Run `npx skills add yaojingang/yao-geo-skills --skill yao-chatgpt-crawler -a claude-code`. Or copy the skill folder (skills/yao-chatgpt-crawler in yaojingang/yao-geo-skills) into .claude/skills/yao-chatgpt-crawler in your project. Claude Code loads it when a task matches its description.

How do I install Yao Chatgpt Crawler in Codex?

Run `npx skills add yaojingang/yao-geo-skills --skill yao-chatgpt-crawler -a codex`. Or copy the skill folder (skills/yao-chatgpt-crawler in yaojingang/yao-geo-skills) into .agents/skills/yao-chatgpt-crawler in your project. Codex loads it when a task matches its description.

Can I use Yao Chatgpt Crawler in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add yaojingang/yao-geo-skills --skill yao-chatgpt-crawler -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/yao-chatgpt-crawler, .gemini/skills/yao-chatgpt-crawler, .github/skills/yao-chatgpt-crawler and .opencode/skills/yao-chatgpt-crawler in your project.

What does Yao Chatgpt Crawler need to run?

Going by SKILL.md and its folder, Yao Chatgpt Crawler needs the command-line tools its instructions call (node).

Does Yao Chatgpt Crawler access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Yao Chatgpt Crawler safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does Yao Chatgpt Crawler use?

Yao Chatgpt Crawler is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Yao Chatgpt Crawler use?

About 456 tokens (SKILL.md is roughly 1.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 9.1k tokens, read only when the agent opens those files.

What are the alternatives to Yao Chatgpt Crawler?

Skills that share tags, products or a category with Yao Chatgpt Crawler: Selenium Opinion Crawler (123321kk/opinion-agent-ultimate, 107 stars), Chatgpt Search (SeifBenayed/cloclo, 114 stars), Geo Crawlers (sickn33/agentic-awesome-skills, 47k stars) and LLM Crawler Access Check (davepoon/buildwithclaude, 3.6k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Yao Chatgpt Crawler?

yaojingang (a GitHub user) maintains it in yaojingang/yao-geo-skills, which has 871 GitHub stars. The repository holds 24 skills in this directory. The repository was last updated on October 1, 2026.

Source: yaojingang/yao-geo-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.