Agent skill

Web Page Reader

by HKUDS in HKUDS/Vibe-Trading

Converts web pages, articles and documentation links into clean Markdown through the read_url tool, which sends the full URL to the third-party Jina Reader service.

MITAuto-check passedProductivity & Automation

Install Web Page Reader

skills CLI
$ npx skills add HKUDS/Vibe-Trading --skill web-reader -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install HKUDS/Vibe-Trading web-reader --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/HKUDS/Vibe-Trading.git skills-src && mkdir -p .claude/skills && cp -r skills-src/agent/src/skills/web-reader .claude/skills/web-reader && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
web-reader
GitHub stars
35k
Token cost
~627 tokens
SKILL.md length
250 words
Files
1
Skills in repo
89
Repo updated
First seen
Licence
MIT

At a glance

Converts web pages, articles and documentation links into clean Markdown through the read_url tool, which sends the full URL to the third-party Jina Reader service.

  • Reading an API documentation page without the surrounding page clutter
  • SKILL.md covers Purpose, Usage, Notes and Privacy & freshness, plus 1 more section
  • Calls bash; reaches tushare.pro and github.com
  • Pulling the text of a blog post or technical article into the conversation

What it does

The agent calls `read_url` with a link and gets the page back as Markdown, with ads, navigation and styling stripped, together with a title and status in a JSON reply. Typical uses are API documentation pages, technical articles and blogs, research reports and announcements, and GitHub README or wiki pages. Chinese content is handled normally.

The limits are spelled out. Anything over 8000 characters is truncated with the total length noted, and dynamically rendered single-page apps may return only skeleton HTML. The tool forwards the full URL, query string included, to Jina Reader at `r.jina.ai`, so URLs with credentials, tokens or internal addresses must not be passed. Results can be cached snapshots flagged with `cached: true`, and `no_cache=true` forces a fresh fetch. A manual bash and requests fallback exists for blocked sites but bypasses the tool's URL safety guard.

When your agent uses it

  • Reading an API documentation page without the surrounding page clutter
  • Pulling the text of a blog post or technical article into the conversation
  • Retrieving a research report or announcement from a public URL
  • Reading a GitHub project's README or wiki page

Example prompts

  • “Read https://tushare.pro/document/2?doc_id=27 and summarize the interface it describes.”
  • “Fetch the README at https://github.com/PaddlePaddle/PaddleOCR and list what the project does.”
  • “Re-read that page with a fresh fetch, since the last result was cached.”

Requirements

  • The `read_url` tool
  • Network access to the Jina Reader service at `r.jina.ai`

What it can do on your machine

Read from SKILL.md and the folder at commit 7f6908b. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • bash

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • tushare.pro
    • github.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Web Page Reader loads about 627 tokens when it runs. Until then it costs about 51 tokens; SKILL.md has 250 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~51
When it runs · the whole SKILL.md, loaded when a task matches
~627

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from HKUDS/Vibe-Trading at commit 7f6908b, republished under its MIT licence (© HKUDS). 250 words, ~627 tokens.

Download SKILL.mdSave it as .claude/skills/web-reader/SKILL.md (or your agent's skills folder).
name
web-reader
description
Read web pages, articles, and document links by converting URLs into Markdown text. Use the `read_url` tool directly, without bash. Sends the full URL to the third-party Jina Reader (r.jina.ai).
category
tool

Web Reading

Purpose

Converts any URL into clean Markdown text, removing ads, navigation, styling, and other distractions. Suitable for:

  • Reading API documentation (tushare, OKX, yfinance, and similar)
  • Reading technical articles and blogs
  • Retrieving research reports and announcements
  • Reading GitHub README / Wiki pages

Usage

Call the read_url tool directly (do not use bash + requests, call the tool directly):

read_url(url="https://tushare.pro/document/2?doc_id=27")

Returns JSON:

json
{
  "status": "ok",
  "title": "Page title",
  "url": "Original URL",
  "content": "Page content in Markdown format",
  "length": 12345
}

Notes

  • Content longer than 8000 characters will be truncated, with the total length noted at the end
  • Dynamically rendered SPA pages may return only skeleton HTML
  • Chinese content is supported normally

Privacy & freshness

  • Third-party dependency: read_url forwards the full target URL (including any query string) to the external Jina Reader service (r.jina.ai). Do not pass URLs containing credentials, tokens, or private/internal addresses — they would leave this host.
  • Caching/staleness: results may be a cached snapshot, not live data. When stale, the JSON includes "cached": true; pass no_cache=true to force a fresh fetch (slower). Use no_cache=true only when a prior result explicitly reported "cached": true or the task genuinely requires newer data. Do not use it merely because context compaction removed a prior payload or because that payload was restored by replay; in that case consume the restored evidence and continue the analysis.
  • Bash fallback caveat: if a site blocks the reader (e.g. HTTP 451) a manual bash + requests fetch is possible, but it bypasses this tool's URL safety guard and the Jina layer — use sparingly and never for internal/authenticated URLs.

Common Usage

Read API Documentation
read_url(url="https://tushare.pro/document/2?doc_id=27")
Read Technical Articles
read_url(url="https://blog.example.com/quantitative-trading-guide")
Retrieve GitHub Project Information
read_url(url="https://github.com/PaddlePaddle/PaddleOCR")

© HKUDS, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in agent/src/skills/web-reader of HKUDS/Vibe-Trading.

Open the folder on GitHubat commit 7f6908b

Compare with similar skills

Web Page Reader next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Web Page Reader compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Web Page Reader this skillHKUDS/Vibe-Trading35k—~627Automated safety check: PassMIT
Web To Markdownrookie-ricardo/erduo-skills935—~894Automated safety check: PassMIT
Defuddlekepano/obsidian-skills49k11 repos~208Automated safety check: PassMIT
URL to Markdown FetcherJimLiu/baoyu-skills26k1 repos~2.1kAutomated safety check: PassMIT
Clean Content FetchLeoYeAI/openclaw-master-skills2.2k—~574Automated safety check: PassMIT
Baoyu URL To Markdownsdyckjq-lab/llm-wiki-skill2.5k2 repos~3.2kAutomated safety check: PassNone

Similar skills

  • Web To Markdown

    rookie-ricardo/erduo-skills

    Convert a web URL into cleaned Markdown with deterministic routing.

    935 GitHub stars~894 tokensUpdated 2 mo ago
    Productivity & AutomationAuto-check passed
  • Defuddle

    kepano/obsidian-skills

    Uses the Defuddle CLI to pull clean, readable Markdown, JSON or metadata from web pages, stripping navigation, ads and clutter to save tokens.

    49k GitHub starsUsed in 11 repos~208 tokens
    Knowledge ManagementAuto-check passed
  • URL to Markdown Fetcher

    JimLiu/baoyu-skills

    Fetches a web page, X post, YouTube transcript or Hacker News thread through a Chrome-driven CLI and saves it as clean markdown.

    26k GitHub starsUsed in 1 repo~2.1k tokens
    Knowledge ManagementAuto-check passed
  • Clean Content Fetch

    LeoYeAI/openclaw-master-skills

    获取干净、可读的网页正文内容,适合现代网页、博客、新闻、公告和微信公众号文章抓取;支持网页正文提取、内容清洗、去噪、Markdown 输出,适用于普通 fetch 效果不佳、页面噪音较多或动态渲染干扰的场景。Clean content fetch for modern web pages, article extraction, WeChat article capture, content…

    2.2k GitHub stars~574 tokensUpdated 2 mo ago
    Documents & OfficeAuto-check passed
  • Baoyu URL To Markdown

    sdyckjq-lab/llm-wiki-skill

    Fetch any URL and convert to markdown using Chrome CDP. An agent skill from sdyckjq-lab/llm-wiki-skill.

    2.5k GitHub starsUsed in 2 repos~3.2k tokens
    Knowledge ManagementAuto-check passed
  • X to Markdown Converter

    JimLiu/baoyu-skills

    Saves tweets, threads and X Articles as Markdown files with YAML front matter, using an unofficial API that asks for your consent first.

    26k GitHub starsUsed in 4 repos~1.8k tokens
    Knowledge ManagementAuto-check: warnings

More from HKUDS/Vibe-Trading

All 89 skills in this repo
  • Eastmoney Market Data

    HKUDS/Vibe-Trading

    Index of Eastmoney's free, no-token market data interfaces for China A-shares and Hong Kong stocks: fund flows, dragon-tiger lists, margin trading, reports and news.

    35k GitHub stars~1k tokensUpdated yesterday
    Auto-check passed
  • OKX Market Data

    HKUDS/Vibe-Trading

    Retrieves public OKX cryptocurrency market data such as spot prices, candlesticks, funding rates and open interest through the OKX V5 REST API, with no authentication.

    35k GitHub stars~1.3k tokensUpdated yesterday
    Auto-check passed
  • SEC EDGAR Filings Fetcher

    HKUDS/Vibe-Trading

    Fetches U.S. SEC EDGAR data: resolves tickers to CIK numbers, lists recent 10-K, 10-Q and 8-K filings with document URLs, and pulls XBRL financial series.

    35k GitHub stars~1.4k tokensUpdated yesterday
    Auto-check passed
  • A-Share ST Risk Screener

    HKUDS/Vibe-Trading

    Predicts whether a mainland China A-share company risks an ST or *ST warning after its next annual report, using financial thresholds and Sina penalty records.

    35k GitHub stars~4.9k tokensUpdated yesterday
    Auto-check passed
  • Breaks a structural trend such as AI infrastructure into its physical supply chain and ranks lesser-known listed companies sitting on each bottleneck.

    35k GitHub stars~2.7k tokensUpdated yesterday
    Auto-check passed
  • Plans and drafts an eight-part, roughly 120k-word investigative series on one company, built around a strict fact-check pass rather than fast drafting.

    35k GitHub stars~2.4k tokensUpdated yesterday
    Auto-check passed

Questions about Web Page Reader

What does Web Page Reader do?

Converts web pages, articles and documentation links into clean Markdown through the read_url tool, which sends the full URL to the third-party Jina Reader service. The agent calls `read_url` with a link and gets the page back as Markdown, with ads, navigation and styling stripped, together with a title and status in a JSON reply. Typical uses are API documentation pages, technical articles and blogs, research reports and announcements, and GitHub README or wiki pages.

When should I use Web Page Reader?

Web Page Reader fits situations like: reading an API documentation page without the surrounding page clutter; pulling the text of a blog post or technical article into the conversation; retrieving a research report or announcement from a public URL; reading a GitHub project's README or wiki page.

How do I install Web Page Reader in Claude Code?

Run `npx skills add HKUDS/Vibe-Trading --skill web-reader -a claude-code`. Or copy the skill folder (agent/src/skills/web-reader in HKUDS/Vibe-Trading) into .claude/skills/web-reader in your project. Claude Code loads it when a task matches its description.

How do I install Web Page Reader in Codex?

Run `npx skills add HKUDS/Vibe-Trading --skill web-reader -a codex`. Or copy the skill folder (agent/src/skills/web-reader in HKUDS/Vibe-Trading) into .agents/skills/web-reader in your project. Codex loads it when a task matches its description.

Can I use Web Page Reader in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add HKUDS/Vibe-Trading --skill web-reader -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/web-reader, .gemini/skills/web-reader, .github/skills/web-reader and .opencode/skills/web-reader in your project.

What does Web Page Reader need to run?

Going by SKILL.md and its folder, Web Page Reader needs the command-line tools its instructions call (bash). Our summary lists: The `read_url` tool; Network access to the Jina Reader service at `r.jina.ai`.

Does Web Page Reader access the network?

SKILL.md names 2 domains. In commands or code: tushare.pro and github.com; the agent is likely to contact these when it follows the instructions. This is read from the text; nothing was executed.

Is Web Page Reader safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Web Page Reader use?

Web Page Reader is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Web Page Reader use?

About 627 tokens (SKILL.md is roughly 2.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Web Page Reader?

Skills that share tags, products or a category with Web Page Reader: Web To Markdown (rookie-ricardo/erduo-skills, 935 stars), Defuddle (kepano/obsidian-skills, 49k stars), URL to Markdown Fetcher (JimLiu/baoyu-skills, 26k stars) and Clean Content Fetch (LeoYeAI/openclaw-master-skills, 2.2k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Web Page Reader?

HKUDS (a GitHub organization) maintains it in HKUDS/Vibe-Trading, which has 34,884 GitHub stars. The repository holds 89 skills in this directory. The repository was last updated on October 6, 2026.

Source: HKUDS/Vibe-Trading on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.