Crawl4AI Web Scraping
smallnest/goclaw
Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.
Advanced filesystem operations for listing files, searching content, batch processing, and directory analysis.
$ npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install LeoYeAI/openclaw-master-skills filesystem --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/LeoYeAI/openclaw-master-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/filesystem .claude/skills/filesystem && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "filesystem" agent skill from https://github.com/LeoYeAI/openclaw-master-skills/tree/main/skills/filesystem into .claude/skills/filesystem/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "filesystem", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/LeoYeAI/openclaw-master-skills/tree/main/skills/filesystemType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install LeoYeAI/openclaw-master-skills filesystem --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/LeoYeAI/openclaw-master-skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/filesystem .agents/skills/filesystem && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "filesystem" agent skill from https://github.com/LeoYeAI/openclaw-master-skills/tree/main/skills/filesystem into .agents/skills/filesystem/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "filesystem", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install LeoYeAI/openclaw-master-skills filesystem --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/LeoYeAI/openclaw-master-skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/filesystem .cursor/skills/filesystem && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "filesystem" agent skill from https://github.com/LeoYeAI/openclaw-master-skills/tree/main/skills/filesystem into .cursor/skills/filesystem/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "filesystem", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/LeoYeAI/openclaw-master-skills.git --path skills/filesystem--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install LeoYeAI/openclaw-master-skills filesystem --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/LeoYeAI/openclaw-master-skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/filesystem .gemini/skills/filesystem && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "filesystem" agent skill from https://github.com/LeoYeAI/openclaw-master-skills/tree/main/skills/filesystem into .gemini/skills/filesystem/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "filesystem", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install LeoYeAI/openclaw-master-skills filesystemInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/LeoYeAI/openclaw-master-skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/filesystem .github/skills/filesystem && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "filesystem" agent skill from https://github.com/LeoYeAI/openclaw-master-skills/tree/main/skills/filesystem into .github/skills/filesystem/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "filesystem", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install LeoYeAI/openclaw-master-skills filesystem --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/LeoYeAI/openclaw-master-skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/filesystem .opencode/skills/filesystem && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "filesystem" agent skill from https://github.com/LeoYeAI/openclaw-master-skills/tree/main/skills/filesystem into .opencode/skills/filesystem/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "filesystem", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
filesystemAdvanced filesystem operations for listing files, searching content, batch processing, and directory analysis.
Filesystem is an agent skill from LeoYeAI/openclaw-master-skills. Advanced filesystem operations for listing files, searching content, batch processing, and directory analysis. Supports recursive search, file type filtering, size analysis, and batch operations like copy/move/delete. Use when you need to: list directory contents, search for files by name or content, analyze directory structures, perform batch file operations, or analyze file sizes and distribution.
Its SKILL.md is about 1.1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Data & Analytics, covering Data pipelines and ETL. The repository describes itself as: 🧠 Curated collection of 1209+ best OpenClaw skills — weekly updated by MyClaw.ai. The licence is MIT.
8 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit e5199b5. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
rgbrewFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Filesystem loads about 1.1k tokens when it runs. Until then it costs about 103 tokens; SKILL.md has 94 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from LeoYeAI/openclaw-master-skills at commit e5199b5, republished under its MIT licence (© LeoYeAI). 94 words, ~1,096 tokens.
.claude/skills/filesystem/SKILL.md (or your agent's skills folder).文件系统操作工具,提供目录列表、内容搜索、批量处理和目录分析功能。
# 列出当前目录
ls -la
# 递归列出目录树
find . -type f -name "*.md" | head -20
# 按类型过滤
find . -type f \( -name "*.md" -o -name "*.txt" \)# 按名称搜索
find . -name "*keyword*"
# 按内容搜索
grep -r "keyword" . --include="*.md"
# 不区分大小写搜索
grep -ri "keyword" . --include="*.md"# 统计文件类型
find . -type f -name "*.md" | wc -l
# 查看目录大小
du -sh .
# 找出最大文件
find . -type f -exec ls -lh {} \; | sort -k5 -h | head -10基础列表:
ls -la # 详细列表
ls -lh # 人类可读大小
ls -lt # 按修改时间排序
ls -R # 递归列表高级列表:
# 列出特定类型
find . -type f -name "*.md"
# 按深度列出
find . -maxdepth 2 -type f
# 排除特定目录
find . -type f -not -path "*/node_modules/*"按名称搜索:
# 精确匹配
find . -name "filename.md"
# 模式匹配
find . -name "*pattern*"
# 大小写不敏感
find . -iname "*pattern*"按内容搜索:
# 基础搜索
grep -r "keyword" .
# 包含行号
grep -rn "keyword" .
# 只搜索特定文件
grep -r "keyword" . --include="*.md"
# 排除目录
grep -r "keyword" . --exclude-dir=node_modules正则表达式搜索:
# 使用正则
grep -r "^## " . --include="*.md"
# 多个关键词
grep -r "key1\|key2" .
# 行首/行尾
grep -r "^关键词" .
grep -r "关键词$" .批量复制:
# 复制特定类型
find . -name "*.md" -exec cp {} backup/ \;
# 复制到多个位置
for file in *.md; do cp "$file" dir1/ && cp "$file" dir2/; done批量移动:
# 移动特定文件
find . -name "*.log" -exec mv {} logs/ \;
# 按条件移动
find . -type f -size +1M -exec mv {} large/ \;批量删除:
# 删除特定类型
find . -name "*.tmp" -delete
# 删除空目录
find . -type d -empty -delete
# 删除旧文件
find . -type f -mtime +30 -delete批量重命名:
# 使用 rename 命令
rename 's/old/new/' *.md
# 添加前缀
for file in *.md; do mv "$file" "prefix_$file"; done大小分析:
# 总大小
du -sh .
# 各目录大小
du -h --max-depth=1 . | sort -hr
# 最大的文件
find . -type f -exec ls -lh {} \; | sort -k5 -hr | head -10文件类型统计:
# 按扩展名统计
find . -type f -name "*.md" | wc -l
# 各类型统计
find . -type f -name "*.*" | sed 's/.*\.//' | sort | uniq -c目录结构分析:
# 目录树
tree -L 2
# 递归深度
find . -type d | wc -l
# 文件分布
find . -type f | cut -d/ -f1-2 | sort | uniq -c文件详情:
# 完整信息
stat filename
# 只看大小
ls -lh filename
# 只看时间
ls -lt filename文件内容预览:
# 头部
head -20 filename
# 尾部
tail -20 filename
# 随机行
shuf -n 10 filename
# 字符数
wc -c filename
# 行数
wc -l filename# 安装
brew install tree
# 使用
tree -L 2 -I 'node_modules|__pycache__'# 安装
brew install fd
# 使用
fd "pattern" /path
fd -e md . # 只找 md 文件
fd -t f . # 只找文件# 安装
brew install ripgrep
# 使用
rg "keyword" .
rg -t md "keyword" .
rg -i "keyword" . # 不区分大小写
rg --type md "pattern" .fd 或 ripgrep 替代 find 和 grep(更快)--dry-run 查看会发生什么-max-depth 限制递归深度-size 过滤大文件-mtime 按时间筛选# 查找所有 md 文件
find . -name "*.md" -type f
# 统计 md 文件数量
find . -name "*.md" | wc -l
# 列出最大的 md 文件
find . -name "*.md" -exec ls -lh {} \; | sort -k5 -hr | head -5# 搜索所有匹配项
grep -rn "old_text" . --include="*.md"
# 替换(使用 sed)
find . -name "*.md" -exec sed -i '' 's/old_text/new_text/g' {} \;# 删除 .tmp 文件
find . -name "*.tmp" -delete
# 删除空目录
find . -type d -empty -delete
# 删除 30 天前的日志
find . -name "*.log" -mtime +30 -delete⚠️ 批量操作前先确认:
⚠️ 删除操作不可逆:
rm 删除后无法恢复rm -i 交互式删除⚠️ 权限注意:
© LeoYeAI, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in skills/filesystem of LeoYeAI/openclaw-master-skills.
Open the folder on GitHubat commit e5199b5
Filesystem next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Filesystem this skillLeoYeAI/openclaw-master-skills | 2.2k | — | ~1.1k | Automated safety check: Pass | MIT | |
| Crawl4AI Web Scrapingsmallnest/goclaw | 598 | 1 repos | ~2.5k | Automated safety check: Pass | MIT | |
| Glue 09 10 Migrationaws-samples/aws-glue-samples | 1.5k | — | ~2.4k | Automated safety check: Pass | MIT-0 | |
| Migrate Glue Devendpoint To Interactive Sessionsaws-samples/aws-glue-samples | 1.5k | — | ~3.6k | Automated safety check: Pass | MIT-0 | |
| Dbt Databricks PR Readydatabricks/dbt-databricks | 379 | — | ~2.8k | Automated safety check: Pass | Apache-2.0 | |
| Mz Dbt ReleaseMaterializeInc/materialize | 6.4k | — | ~1.2k | Automated safety check: Pass | Custom licence |
smallnest/goclaw
Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.
aws-samples/aws-glue-samples
Upgrade an AWS Glue ETL job from Glue version 0.9 or 1.0 to Glue 4.0.
aws-samples/aws-glue-samples
Migrate a legacy AWS Glue development endpoint to a Glue interactive session, following the official AWS migration checklist.
databricks/dbt-databricks
A skill your agent uses for an open dbt-databricks pull request, including your own PR or a fork PR, to assess merge readiness and optionally repair selected gaps on the PR head branch.
MaterializeInc/materialize
Cut a dbt-materialize PyPI release: bump the version in version.py and setup.py, date the Unreleased CHANGELOG entry, and open the release PR with a Ship: <url body.
liam-machine/erd-studio
Friendly, step-by-step setup for ERD Studio in an existing dbt project, for people who may be new to dbt or data modelling.
LeoYeAI/openclaw-master-skills
Manages pipelines on a DevOps quality and efficiency platform through its OpenAPI: list workspaces and templates, create, update, run and cancel pipelines, and read run records.
LeoYeAI/openclaw-master-skills
Patches OpenClaw's Feishu extension so an edited document triggers an isolated agent session that reads the doc and replies inline, turning it into a live chat space.
LeoYeAI/openclaw-master-skills
Multi-context memory management system for OpenClaw agents with group-isolated storage, global shared memory, workspace organization, and group-specific skills isolation.
LeoYeAI/openclaw-master-skills
Runs a brand's AI-search visibility work end to end: diagnosing how AI platforms represent it, repositioning it, producing AI-optimized content and monitoring ongoing mentions.
LeoYeAI/openclaw-master-skills
Installs and authenticates the gws CLI, then automates Gmail, Drive, Sheets, Calendar, Docs, Chat and Tasks with ready-made recipes, persona bundles and security audits.
LeoYeAI/openclaw-master-skills
Runs four advisor roles, a fitness coach, nutritionist, data analyst and TCM practitioner, to build a health profile and track workouts, diet and wellness over time.
Categories
Advanced filesystem operations for listing files, searching content, batch processing, and directory analysis. Filesystem is an agent skill from LeoYeAI/openclaw-master-skills. Advanced filesystem operations for listing files, searching content, batch processing, and directory analysis.
Filesystem fits situations like: you need to: list directory contents; search for files by name; analyze directory structures; perform batch file operations.
Run `npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a claude-code`. Or copy the skill folder (skills/filesystem in LeoYeAI/openclaw-master-skills) into .claude/skills/filesystem in your project. Claude Code loads it when a task matches its description.
Run `npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a codex`. Or copy the skill folder (skills/filesystem in LeoYeAI/openclaw-master-skills) into .agents/skills/filesystem in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add LeoYeAI/openclaw-master-skills --skill filesystem -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/filesystem, .gemini/skills/filesystem, .github/skills/filesystem and .opencode/skills/filesystem in your project.
Going by SKILL.md and its folder, Filesystem needs the command-line tools its instructions call (rg and brew).
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Filesystem is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.1k tokens (SKILL.md is roughly 4.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Filesystem: Crawl4AI Web Scraping (smallnest/goclaw, 598 stars), Glue 09 10 Migration (aws-samples/aws-glue-samples, 1.5k stars), Migrate Glue Devendpoint To Interactive Sessions (aws-samples/aws-glue-samples, 1.5k stars) and Dbt Databricks PR Ready (databricks/dbt-databricks, 379 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
LeoYeAI (a GitHub user) maintains it in LeoYeAI/openclaw-master-skills, which has 2,158 GitHub stars. The repository holds 1,215 skills in this directory. The repository was last updated on July 20, 2026.
Source: LeoYeAI/openclaw-master-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.