Agent skill

Rsibench Data Factory

by evolvent-ai in evolvent-ai/RSIBench-Data

Use inside RSIBench-Data when testing whether an automation agent can improve a target model on a configured benchmark through synthetic Tinker SFT data, Tinker sampling, and E2B-based Harbor…

No licenceAuto-check: notesTesting & QA

Install Rsibench Data Factory

skills CLI
$ npx skills add evolvent-ai/RSIBench-Data --skill rsibench-data-factory -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install evolvent-ai/RSIBench-Data rsibench-data-factory --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/evolvent-ai/RSIBench-Data.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/rsibench-data-factory .claude/skills/rsibench-data-factory && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
rsibench-data-factory
GitHub stars
171
Token cost
~640 tokens
SKILL.md length
249 words
Files
1
Skills in repo
1
Repo updated
First seen
Licence
None found

At a glance

Use inside RSIBench-Data when testing whether an automation agent can improve a target model on a configured benchmark through synthetic Tinker SFT data, Tinker sampling, and E2B-based Harbor…

  • Works in 6 steps: README.md → docs/tinker_train_eval.md → docs/tinker_cookbook.md → …
  • Tasks that involve Test data and fixtures
  • Calls bash and python

What it does

Rsibench Data Factory is an agent skill from evolvent-ai/RSIBench-Data. Use inside RSIBench-Data when testing whether an automation agent can improve a target model on a configured benchmark through synthetic Tinker SFT data, Tinker sampling, and E2B-based Harbor evaluation.

Its SKILL.md is about 640 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Testing & QA, covering Test data and fixtures. The repository describes itself as: Synthetic data generation, post-training, and E2B benchmark evaluation infrastructure.

When your agent uses it

  • Tasks that involve Test data and fixtures

Example prompts

  • “/rsibench-data-factory”

Requirements

  • Python 3
  • Docker

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

  1. README.md
  2. docs/tinker_train_eval.md
  3. docs/tinker_cookbook.md
  4. backend/e2b_eval/README.md
  5. RUN_CONTRACT.md in the generated agent workspace
  6. The current benchmark context copied under benchmarks/

What it can do on your machine

Read from SKILL.md and the folder at commit 4c80761. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • bash
    • python

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Rsibench Data Factory loads about 640 tokens when it runs. Until then it costs about 56 tokens; SKILL.md has 249 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~56
When it runs · the whole SKILL.md, loaded when a task matches
~640

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: notes

The automated check noted patterns worth knowing about, such as sudo or a known installer.

  • NoteMentions a .env fileSKILL.md:64
    MODEL` defaults to `LITELLM_MODEL` from `.env`; override it only

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 249 words (~640 tokens).

name
rsibench-data-factory

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skills/rsibench-data-factory of evolvent-ai/RSIBench-Data.

Open the folder on GitHubat commit 4c80761

Compare with similar skills

Rsibench Data Factory next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Rsibench Data Factory compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Rsibench Data Factory this skillevolvent-ai/RSIBench-Data171—~640Automated safety check: NotesNone
Fs Fixtureprivatenumber/fs-fixture100—~1.2kAutomated safety check: PassMIT
Dev Tenant APInightscout/nocturne139—~1.4kAutomated safety check: PassNone
Setup GuideRed-Hat-AI-Innovation-Team/sdg_hub164—~1.1kAutomated safety check: PassApache-2.0
Eval Designagentscope-ai/OpenJudge871—~2.8kAutomated safety check: WarnApache-2.0
Data GenerationRed-Hat-AI-Innovation-Team/sdg_hub164—~381Automated safety check: PassApache-2.0

Similar skills

  • Fs Fixture

    privatenumber/fs-fixture

    Create disposable file system test fixtures from objects, templates, or empty directories with automatic cleanup.

    100 GitHub stars~1.2k tokensUpdated 1 mo ago
    Testing & QAAuto-check passed
  • Dev Tenant API

    nightscout/nocturne

    Interact with Nocturne's local dev-only API: seed a loginable tenant preloaded with realistic sample data, obtain a browser session (loginLink) or bearer token headlessly, export/re-seed the dev…

    139 GitHub stars~1.4k tokensUpdated today
    Testing & QAAuto-check passed
  • Setup Guide

    Red-Hat-AI-Innovation-Team/sdg_hub

    A skill your agent uses when the user wants to set up synthetic data generation for the first time, or when sdghub is not yet installed/configured in the current environment.

    164 GitHub stars~1.1k tokensUpdated yesterday
    Testing & QAAuto-check passed
  • Eval Design

    agentscope-ai/OpenJudge

    A skill your agent uses when the user needs to design evaluation datasets, create test cases, stratify samples, generate adversarial examples, extract eval dimensions from traces/specs, or build a…

    871 GitHub stars~2.8k tokensUpdated 29 days ago
    Testing & QAAuto-check: warnings
  • Data Generation

    Red-Hat-AI-Innovation-Team/sdg_hub

    A skill your agent uses when the user wants to run synthetic data generation via scripts — detect environment, execute a flow, and present results.

    164 GitHub stars~381 tokensUpdated yesterday
    Testing & QAAuto-check passed
  • Seed Test Data

    langfuse/langfuse

    Seed reproducible local Langfuse data in ClickHouse and Postgres.

    36k GitHub stars~5.8k tokensUpdated today
    Testing & QAAuto-check passed

Questions about Rsibench Data Factory

What does Rsibench Data Factory do?

Use inside RSIBench-Data when testing whether an automation agent can improve a target model on a configured benchmark through synthetic Tinker SFT data, Tinker sampling, and E2B-based Harbor…. Rsibench Data Factory is an agent skill from evolvent-ai/RSIBench-Data. Use inside RSIBench-Data when testing whether an automation agent can improve a target model on a configured benchmark through synthetic Tinker SFT data, Tinker sampling, and E2B-based Harbor evaluation.

When should I use Rsibench Data Factory?

Rsibench Data Factory fits situations like: tasks that involve Test data and fixtures.

How do I install Rsibench Data Factory in Claude Code?

Run `npx skills add evolvent-ai/RSIBench-Data --skill rsibench-data-factory -a claude-code`. Or copy the skill folder (skills/rsibench-data-factory in evolvent-ai/RSIBench-Data) into .claude/skills/rsibench-data-factory in your project. Claude Code loads it when a task matches its description.

How do I install Rsibench Data Factory in Codex?

Run `npx skills add evolvent-ai/RSIBench-Data --skill rsibench-data-factory -a codex`. Or copy the skill folder (skills/rsibench-data-factory in evolvent-ai/RSIBench-Data) into .agents/skills/rsibench-data-factory in your project. Codex loads it when a task matches its description.

Can I use Rsibench Data Factory in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add evolvent-ai/RSIBench-Data --skill rsibench-data-factory -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/rsibench-data-factory, .gemini/skills/rsibench-data-factory, .github/skills/rsibench-data-factory and .opencode/skills/rsibench-data-factory in your project.

What does Rsibench Data Factory need to run?

Going by SKILL.md and its folder, Rsibench Data Factory needs the command-line tools its instructions call (bash and python). Our summary lists: Python 3; Docker.

Does Rsibench Data Factory access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Rsibench Data Factory safe to install?

Our automated static check of SKILL.md found notes only (mentions a .env file), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.

What licence does Rsibench Data Factory use?

No licence was found for Rsibench Data Factory or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Rsibench Data Factory use?

About 640 tokens (SKILL.md is roughly 2.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Rsibench Data Factory?

Skills that share tags, products or a category with Rsibench Data Factory: Fs Fixture (privatenumber/fs-fixture, 100 stars), Dev Tenant API (nightscout/nocturne, 139 stars), Setup Guide (Red-Hat-AI-Innovation-Team/sdg_hub, 164 stars) and Eval Design (agentscope-ai/OpenJudge, 871 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Rsibench Data Factory?

evolvent-ai (a GitHub organization) maintains it in evolvent-ai/RSIBench-Data, which has 171 GitHub stars. The repository was last updated on August 25, 2026.

Source: evolvent-ai/RSIBench-Data on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.