Web To Markdown
rookie-ricardo/erduo-skills
Convert a web URL into cleaned Markdown with deterministic routing.
Converts web pages, articles and documentation links into clean Markdown through the read_url tool, which sends the full URL to the third-party Jina Reader service.
$ npx skills add HKUDS/Vibe-Trading --skill web-reader -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install HKUDS/Vibe-Trading web-reader --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/HKUDS/Vibe-Trading.git skills-src && mkdir -p .claude/skills && cp -r skills-src/agent/src/skills/web-reader .claude/skills/web-reader && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "web-reader" agent skill from https://github.com/HKUDS/Vibe-Trading/tree/main/agent/src/skills/web-reader into .claude/skills/web-reader/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "web-reader", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/HKUDS/Vibe-Trading/tree/main/agent/src/skills/web-readerType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add HKUDS/Vibe-Trading --skill web-reader -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install HKUDS/Vibe-Trading web-reader --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/HKUDS/Vibe-Trading.git skills-src && mkdir -p .agents/skills && cp -r skills-src/agent/src/skills/web-reader .agents/skills/web-reader && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "web-reader" agent skill from https://github.com/HKUDS/Vibe-Trading/tree/main/agent/src/skills/web-reader into .agents/skills/web-reader/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "web-reader", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add HKUDS/Vibe-Trading --skill web-reader -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install HKUDS/Vibe-Trading web-reader --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/HKUDS/Vibe-Trading.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/agent/src/skills/web-reader .cursor/skills/web-reader && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "web-reader" agent skill from https://github.com/HKUDS/Vibe-Trading/tree/main/agent/src/skills/web-reader into .cursor/skills/web-reader/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "web-reader", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/HKUDS/Vibe-Trading.git --path agent/src/skills/web-reader--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add HKUDS/Vibe-Trading --skill web-reader -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install HKUDS/Vibe-Trading web-reader --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/HKUDS/Vibe-Trading.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/agent/src/skills/web-reader .gemini/skills/web-reader && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "web-reader" agent skill from https://github.com/HKUDS/Vibe-Trading/tree/main/agent/src/skills/web-reader into .gemini/skills/web-reader/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "web-reader", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install HKUDS/Vibe-Trading web-readerInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add HKUDS/Vibe-Trading --skill web-reader -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/HKUDS/Vibe-Trading.git skills-src && mkdir -p .github/skills && cp -r skills-src/agent/src/skills/web-reader .github/skills/web-reader && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "web-reader" agent skill from https://github.com/HKUDS/Vibe-Trading/tree/main/agent/src/skills/web-reader into .github/skills/web-reader/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "web-reader", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add HKUDS/Vibe-Trading --skill web-reader -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install HKUDS/Vibe-Trading web-reader --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/HKUDS/Vibe-Trading.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/agent/src/skills/web-reader .opencode/skills/web-reader && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "web-reader" agent skill from https://github.com/HKUDS/Vibe-Trading/tree/main/agent/src/skills/web-reader into .opencode/skills/web-reader/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "web-reader", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
web-readerConverts web pages, articles and documentation links into clean Markdown through the read_url tool, which sends the full URL to the third-party Jina Reader service.
The agent calls `read_url` with a link and gets the page back as Markdown, with ads, navigation and styling stripped, together with a title and status in a JSON reply. Typical uses are API documentation pages, technical articles and blogs, research reports and announcements, and GitHub README or wiki pages. Chinese content is handled normally.
The limits are spelled out. Anything over 8000 characters is truncated with the total length noted, and dynamically rendered single-page apps may return only skeleton HTML. The tool forwards the full URL, query string included, to Jina Reader at `r.jina.ai`, so URLs with credentials, tokens or internal addresses must not be passed. Results can be cached snapshots flagged with `cached: true`, and `no_cache=true` forces a fresh fetch. A manual bash and requests fallback exists for blocked sites but bypasses the tool's URL safety guard.
Read from SKILL.md and the folder at commit 7f6908b. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
bashFrom the folder's file list and the shell code blocks in SKILL.md.
Hosts in commands or code, which the agent is likely to contact:
tushare.progithub.comFrom URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Web Page Reader loads about 627 tokens when it runs. Until then it costs about 51 tokens; SKILL.md has 250 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from HKUDS/Vibe-Trading at commit 7f6908b, republished under its MIT licence (© HKUDS). 250 words, ~627 tokens.
.claude/skills/web-reader/SKILL.md (or your agent's skills folder).Converts any URL into clean Markdown text, removing ads, navigation, styling, and other distractions. Suitable for:
tushare, OKX, yfinance, and similar)Call the read_url tool directly (do not use bash + requests, call the tool directly):
read_url(url="https://tushare.pro/document/2?doc_id=27")Returns JSON:
{
"status": "ok",
"title": "Page title",
"url": "Original URL",
"content": "Page content in Markdown format",
"length": 12345
}read_url forwards the full target URL
(including any query string) to the external Jina Reader service
(r.jina.ai). Do not pass URLs containing credentials, tokens, or
private/internal addresses — they would leave this host."cached": true; pass no_cache=true to
force a fresh fetch (slower). Use no_cache=true only when a prior result
explicitly reported "cached": true or the task genuinely requires newer
data. Do not use it merely because context compaction removed a prior
payload or because that payload was restored by replay; in that case consume
the restored evidence and continue the analysis.bash + requests fetch is possible, but it bypasses this
tool's URL safety guard and the Jina layer — use sparingly and never
for internal/authenticated URLs.read_url(url="https://tushare.pro/document/2?doc_id=27")read_url(url="https://blog.example.com/quantitative-trading-guide")read_url(url="https://github.com/PaddlePaddle/PaddleOCR")© HKUDS, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in agent/src/skills/web-reader of HKUDS/Vibe-Trading.
Open the folder on GitHubat commit 7f6908b
Web Page Reader next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Web Page Reader this skillHKUDS/Vibe-Trading | 35k | — | ~627 | Automated safety check: Pass | MIT | |
| Web To Markdownrookie-ricardo/erduo-skills | 935 | — | ~894 | Automated safety check: Pass | MIT | |
| Defuddlekepano/obsidian-skills | 49k | 11 repos | ~208 | Automated safety check: Pass | MIT | |
| URL to Markdown FetcherJimLiu/baoyu-skills | 26k | 1 repos | ~2.1k | Automated safety check: Pass | MIT | |
| Clean Content FetchLeoYeAI/openclaw-master-skills | 2.2k | — | ~574 | Automated safety check: Pass | MIT | |
| Baoyu URL To Markdownsdyckjq-lab/llm-wiki-skill | 2.5k | 2 repos | ~3.2k | Automated safety check: Pass | None |
rookie-ricardo/erduo-skills
Convert a web URL into cleaned Markdown with deterministic routing.
kepano/obsidian-skills
Uses the Defuddle CLI to pull clean, readable Markdown, JSON or metadata from web pages, stripping navigation, ads and clutter to save tokens.
JimLiu/baoyu-skills
Fetches a web page, X post, YouTube transcript or Hacker News thread through a Chrome-driven CLI and saves it as clean markdown.
LeoYeAI/openclaw-master-skills
获取干净、可读的网页正文内容,适合现代网页、博客、新闻、公告和微信公众号文章抓取;支持网页正文提取、内容清洗、去噪、Markdown 输出,适用于普通 fetch 效果不佳、页面噪音较多或动态渲染干扰的场景。Clean content fetch for modern web pages, article extraction, WeChat article capture, content…
sdyckjq-lab/llm-wiki-skill
Fetch any URL and convert to markdown using Chrome CDP. An agent skill from sdyckjq-lab/llm-wiki-skill.
JimLiu/baoyu-skills
Saves tweets, threads and X Articles as Markdown files with YAML front matter, using an unofficial API that asks for your consent first.
HKUDS/Vibe-Trading
Index of Eastmoney's free, no-token market data interfaces for China A-shares and Hong Kong stocks: fund flows, dragon-tiger lists, margin trading, reports and news.
HKUDS/Vibe-Trading
Retrieves public OKX cryptocurrency market data such as spot prices, candlesticks, funding rates and open interest through the OKX V5 REST API, with no authentication.
HKUDS/Vibe-Trading
Fetches U.S. SEC EDGAR data: resolves tickers to CIK numbers, lists recent 10-K, 10-Q and 8-K filings with document URLs, and pulls XBRL financial series.
HKUDS/Vibe-Trading
Predicts whether a mainland China A-share company risks an ST or *ST warning after its next annual report, using financial thresholds and Sina penalty records.
HKUDS/Vibe-Trading
Breaks a structural trend such as AI infrastructure into its physical supply chain and ranks lesser-known listed companies sitting on each bottleneck.
HKUDS/Vibe-Trading
Plans and drafts an eight-part, roughly 120k-word investigative series on one company, built around a strict fact-check pass rather than fast drafting.
Converts web pages, articles and documentation links into clean Markdown through the read_url tool, which sends the full URL to the third-party Jina Reader service. The agent calls `read_url` with a link and gets the page back as Markdown, with ads, navigation and styling stripped, together with a title and status in a JSON reply. Typical uses are API documentation pages, technical articles and blogs, research reports and announcements, and GitHub README or wiki pages.
Web Page Reader fits situations like: reading an API documentation page without the surrounding page clutter; pulling the text of a blog post or technical article into the conversation; retrieving a research report or announcement from a public URL; reading a GitHub project's README or wiki page.
Run `npx skills add HKUDS/Vibe-Trading --skill web-reader -a claude-code`. Or copy the skill folder (agent/src/skills/web-reader in HKUDS/Vibe-Trading) into .claude/skills/web-reader in your project. Claude Code loads it when a task matches its description.
Run `npx skills add HKUDS/Vibe-Trading --skill web-reader -a codex`. Or copy the skill folder (agent/src/skills/web-reader in HKUDS/Vibe-Trading) into .agents/skills/web-reader in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add HKUDS/Vibe-Trading --skill web-reader -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/web-reader, .gemini/skills/web-reader, .github/skills/web-reader and .opencode/skills/web-reader in your project.
Going by SKILL.md and its folder, Web Page Reader needs the command-line tools its instructions call (bash). Our summary lists: The `read_url` tool; Network access to the Jina Reader service at `r.jina.ai`.
SKILL.md names 2 domains. In commands or code: tushare.pro and github.com; the agent is likely to contact these when it follows the instructions. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Web Page Reader is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 627 tokens (SKILL.md is roughly 2.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Web Page Reader: Web To Markdown (rookie-ricardo/erduo-skills, 935 stars), Defuddle (kepano/obsidian-skills, 49k stars), URL to Markdown Fetcher (JimLiu/baoyu-skills, 26k stars) and Clean Content Fetch (LeoYeAI/openclaw-master-skills, 2.2k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
HKUDS (a GitHub organization) maintains it in HKUDS/Vibe-Trading, which has 34,884 GitHub stars. The repository holds 89 skills in this directory. The repository was last updated on October 6, 2026.
Source: HKUDS/Vibe-Trading on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.