Agent skill

Create Task

Create a new Harbor task for evaluating agents. An agent skill from Arize-ai/phoenix.

Custom licenceAuto-check: warningsTesting & QA

Install Create Task

The automated check flagged lines worth reading first. See the safety section below.

skills CLI

$ npx skills add Arize-ai/phoenix --skill create-task -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI

$ gh skill install Arize-ai/phoenix create-task --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy

$ git clone --depth 1 https://github.com/Arize-ai/phoenix.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/create-task .claude/skills/create-task && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Paste into Claude Code

Install the "create-task" agent skill from https://github.com/Arize-ai/phoenix/tree/main/.agents/skills/create-task into .claude/skills/create-task/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-task", then confirm the skill loads.

Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

$skill-installer

$skill-installer install https://github.com/Arize-ai/phoenix/tree/main/.agents/skills/create-task

Type this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.

skills CLI

$ npx skills add Arize-ai/phoenix --skill create-task -a codex

Project install goes to .agents/skills/; add -g for ~/.codex/skills/.

GitHub CLI

$ gh skill install Arize-ai/phoenix create-task --agent codex

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/Arize-ai/phoenix.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/create-task .agents/skills/create-task && rm -rf skills-src

Use ~/.agents/skills/ instead of .agents/skills for a personal install.

Codex skills documentation · loads skills from .agents/skills/

Paste into Codex

Install the "create-task" agent skill from https://github.com/Arize-ai/phoenix/tree/main/.agents/skills/create-task into .agents/skills/create-task/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-task", then confirm the skill loads.

Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add Arize-ai/phoenix --skill create-task -a cursor

Project install goes to .agents/skills/; add -g for ~/.cursor/skills/.

GitHub CLI

$ gh skill install Arize-ai/phoenix create-task --agent cursor

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/Arize-ai/phoenix.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/create-task .cursor/skills/create-task && rm -rf skills-src

Use ~/.cursor/skills/ instead of .cursor/skills for a personal install.

Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/

Paste into Cursor

Install the "create-task" agent skill from https://github.com/Arize-ai/phoenix/tree/main/.agents/skills/create-task into .cursor/skills/create-task/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-task", then confirm the skill loads.

Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

gemini skills install

$ gemini skills install https://github.com/Arize-ai/phoenix.git --path .agents/skills/create-task

--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.

skills CLI

$ npx skills add Arize-ai/phoenix --skill create-task -a gemini-cli

Project install goes to .agents/skills/; add -g for ~/.gemini/skills/.

GitHub CLI

$ gh skill install Arize-ai/phoenix create-task --agent gemini-cli

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/Arize-ai/phoenix.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/create-task .gemini/skills/create-task && rm -rf skills-src

Use ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.

Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/

Paste into Gemini CLI

Install the "create-task" agent skill from https://github.com/Arize-ai/phoenix/tree/main/.agents/skills/create-task into .gemini/skills/create-task/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-task", then confirm the skill loads.

Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

GitHub CLI

$ gh skill install Arize-ai/phoenix create-task

Installs for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).

skills CLI

$ npx skills add Arize-ai/phoenix --skill create-task -a github-copilot

Project install goes to .agents/skills/; add -g for ~/.copilot/skills/.

Manual copy

$ git clone --depth 1 https://github.com/Arize-ai/phoenix.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/create-task .github/skills/create-task && rm -rf skills-src

Use ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.

GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/

Paste into GitHub Copilot

Install the "create-task" agent skill from https://github.com/Arize-ai/phoenix/tree/main/.agents/skills/create-task into .github/skills/create-task/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-task", then confirm the skill loads.

GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add Arize-ai/phoenix --skill create-task -a opencode

OpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.

GitHub CLI

$ gh skill install Arize-ai/phoenix create-task --agent opencode

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/Arize-ai/phoenix.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/create-task .opencode/skills/create-task && rm -rf skills-src

Use ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.

OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/

Paste into OpenCode

Install the "create-task" agent skill from https://github.com/Arize-ai/phoenix/tree/main/.agents/skills/create-task into .opencode/skills/create-task/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-task", then confirm the skill loads.

OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

Facts

Skill name: create-task
GitHub stars: 12k
Token cost: ~4.4k tokens
SKILL.md length: 1,607 words
Files: 1
Skills in repo: 39
Repo updated: Oct 7, 2026
First seen: Oct 7, 2026
Licence: Custom licence

At a glance

Create a new Harbor task for evaluating agents. An agent skill from Arize-ai/phoenix.

Works in 9 steps: Scaffold the task → Write instruction.md → Build the environment → …
The user wants to scaffold
SKILL.md covers Step 1: Scaffold the task, Step 2: Write instruction.md, Step 3: Build the environment and Step 4: Decide how to verify, plus 8 more sections
Calls uvx, apt-get and curl; reaches astral.sh; needs ANTHROPIC_API_KEY

What it does

Create Task is an agent skill from Arize-ai/phoenix. Create a new Harbor task for evaluating agents. Use when the user wants to scaffold, build, or design a new task, benchmark problem, or eval. Guides through instruction writing, environment setup, verifier design (pytest vs Reward Kit vs custom), and solution scripting.

Its SKILL.md is about 4.4k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Testing & QA, covering Unit testing. It works with pytest and Docker. The repository describes itself as: AI Observability & Evaluation.

When your agent uses it

The user wants to scaffold
Design a new task
Benchmark problem

Example prompts

“/create-task”

Requirements

Python 3
Docker
A credential in ANTHROPIC_API_KEY

Workflow steps

9 steps, taken from the step headings in SKILL.md.

Scaffold the task
Write instruction.md
Build the environment
Decide how to verify
Write the solution
Configure task.toml
Verify with the Oracle agent
Test with a real agent (optional)
Update README.md (always the final step)

What it can do on your machine

Read from SKILL.md and the folder at commit 3383f07. It shows what the files ask for, not the result of running them.

Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
- uvx
- apt-get
- curl
- sh
From the folder's file list and the shell code blocks in SKILL.md.
Network
Hosts in commands or code, which the agent is likely to contact:
- astral.sh
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names these keys or tokens, usually read from environment variables:
- ANTHROPIC_API_KEY
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Create Task loads about 4.4k tokens when it runs. Until then it costs about 71 tokens; SKILL.md has 1,607 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it: ~71
When it runs · the whole SKILL.md, loaded when a task matches: ~4.4k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: warnings

The automated check found patterns that need a careful read before installing.

WarningMentions a credentials file (SSH keys, cloud or package-manager tokens)SKILL.md:54
```
Generate an SSH key pair in the files `~/.ssh/id_rsa` and `~/.ssh/id_rsa.pub`.
```
NotePipes a well-known installer script into a shellSKILL.md:142
```
curl -LsSf https://astral.sh/uv/0.9.7/install.sh | sh
```
WarningMentions a credentials file (SSH keys, cloud or package-manager tokens)SKILL.md:159
```
assert (Path.home() / ".ssh" / "id_rsa").exists()
```
WarningMentions a credentials file (SSH keys, cloud or package-manager tokens)SKILL.md:188
```
ssh-keygen -t rsa -f ~/.ssh/id_rsa -N ""
```

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 1,607 words (~4,370 tokens).

“Guide the user through creating a new Harbor task end-to-end. Don't just dump commands — walk them through each decision, especially around the verifier (which is usually the hardest part).”

— opening of SKILL.md by Arize-ai, Custom licence

name: create-task

Outline of SKILL.md

Step 1: Scaffold the task
Step 2: Write instruction.md
Step 3: Build the environment
Step 4: Decide how to verify
Option A: Reward Kit (recommended for most cases)
Option B: pytest (good for deterministic unit-style checks)
Option C: Custom shell
Reward file format (all options)
Step 5: Write the solution
Step 6: Configure task.toml
Network policy
Step 7: Verify with the Oracle agent
Step 8: Test with a real agent (optional)
Step 9: Update README.md (always the final step)
Multi-step tasks
Directory layout
task.toml
Choosing a reward strategy
Artifacts
Oracle verification
Full reference + worked example
Special features (mention if relevant)
Common pitfalls

Read the full SKILL.md on GitHub

Files

Just SKILL.md in .agents/skills/create-task of Arize-ai/phoenix.

Open the folder on GitHubat commit 3383f07

Compare with similar skills

Create Task next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Create Task compared with similar skills
Skill	Stars	Used in	Tokens	Auto-check	Licence	Repo updated
Create Task this skillArize-ai/phoenix	12k	—	~4.4k	Automated safety check: Warn	Custom licence	today
Slow TestsUKGovernmentBEIS/inspect_ai	2.9k	—	~1.4k	Automated safety check: Pass	MIT	today
Issue WriterNVIDIA/container-canary	309	—	~1.1k	Automated safety check: Pass	Apache-2.0	1 mo ago
NIC Testing Patternsnginx/kubernetes-ingress	5.1k	—	~2.8k	Automated safety check: Pass	Apache-2.0	today
Run Testsartcc/freelingo	158	—	~976	Automated safety check: Pass	AGPL-3.0	today
Flowfile Testing And ValidationEdwardvaneechoud/Flowfile	370	—	~8.3k	Automated safety check: Notes	MIT	yesterday

Similar skills

Slow Tests
UKGovernmentBEIS/inspect_ai
Run the gated test classes that plain pytest skips (slow Docker/sandbox tests, live model-provider API tests, flaky tests, trio variants).
2.9k GitHub stars~1.4k tokensUpdated today
Testing & QAAuto-check passed
Issue Writer
NVIDIA/container-canary
Official
Draft and revise concise, human-focused GitHub issues for pytest-kind-ng.
309 GitHub stars~1.1k tokensUpdated 1 mo ago
Testing & QAAuto-check passed
NIC Testing Patterns
nginx/kubernetes-ingress
Testing conventions for the NGINX Ingress Controller repo: Go table-driven tests, mandatory snapshot regeneration, Helm tests and Python pytest integration tests.
5.1k GitHub stars~2.8k tokensUpdated today
Testing & QAAuto-check passed
Run Tests
artcc/freelingo
A skill your agent uses when the user asks to run tests, ejecutar tests, lanzar tests, pytest, vitest, check types, typecheck, lint, or verify the codebase.
158 GitHub stars~976 tokensUpdated today
Testing & QAAuto-check passed
Flowfile Testing And Validation
Edwardvaneechoud/Flowfile
Exact per-package pytest/vitest/playwright commands, the registered pytest markers and which need Docker, the testutils Docker fixture matrix, the shared-test-DB isolation model and its failure…
370 GitHub stars~8.3k tokensUpdated yesterday
Testing & QAAuto-check: notes
Pre Push
artcc/freelingo
A skill your agent uses when the user asks to check before pushing, pre-push, verificar antes de pushear, run all checks, or quiere validar que todo pasa antes de hacer push.
158 GitHub stars~732 tokensUpdated today
EducationAuto-check passed

Questions about Create Task

What does Create Task do?

Create a new Harbor task for evaluating agents. An agent skill from Arize-ai/phoenix. Create Task is an agent skill from Arize-ai/phoenix. Create a new Harbor task for evaluating agents.

When should I use Create Task?

Create Task fits situations like: the user wants to scaffold; design a new task; benchmark problem.

How do I install Create Task in Claude Code?

Run `npx skills add Arize-ai/phoenix --skill create-task -a claude-code`. Or copy the skill folder (.agents/skills/create-task in Arize-ai/phoenix) into .claude/skills/create-task in your project. Claude Code loads it when a task matches its description.

How do I install Create Task in Codex?

Run `npx skills add Arize-ai/phoenix --skill create-task -a codex`. Or copy the skill folder (.agents/skills/create-task in Arize-ai/phoenix) into .agents/skills/create-task in your project. Codex loads it when a task matches its description.

Can I use Create Task in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add Arize-ai/phoenix --skill create-task -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/create-task, .gemini/skills/create-task, .github/skills/create-task and .opencode/skills/create-task in your project.

What does Create Task need to run?

Going by SKILL.md and its folder, Create Task needs the command-line tools its instructions call (uvx, apt-get, curl and sh) and credentials named ANTHROPIC_API_KEY. Our summary lists: Python 3; Docker; A credential in ANTHROPIC_API_KEY.

Does Create Task access the network?

SKILL.md names 1 domain. In commands or code: astral.sh; the agent is likely to contact it when it follows the instructions. This is read from the text; nothing was executed.

Is Create Task safe to install?

Our automated static check of SKILL.md flagged 3 warning(s): mentions a credentials file (ssh keys, cloud or package-manager tokens). Read the flagged lines before installing; the check is not a guarantee either way.

What licence does Create Task use?

Create Task has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Create Task use?

About 4.4k tokens (SKILL.md is roughly 17k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Create Task?

Skills that share tags, products or a category with Create Task: Slow Tests (UKGovernmentBEIS/inspect_ai, 2.9k stars), Issue Writer (NVIDIA/container-canary, 309 stars), NIC Testing Patterns (nginx/kubernetes-ingress, 5.1k stars) and Run Tests (artcc/freelingo, 158 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Create Task?

Arize-ai (a GitHub organization) maintains it in Arize-ai/phoenix, which has 11,738 GitHub stars. The repository holds 39 skills in this directory. The repository was last updated on October 7, 2026.

Source: Arize-ai/phoenix on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.

Create Task

Install Create Task

Facts

At a glance

What it does

When your agent uses it

Example prompts

Requirements

Workflow steps

What it can do on your machine

Tool permissions

Runs code

Network

Credentials

Context cost

Safety

SKILL.md

Files

Compare with similar skills

Similar skills

Slow Tests

Issue Writer

NIC Testing Patterns

Run Tests

Flowfile Testing And Validation

Pre Push

More from Arize-ai/phoenix

Harbor Exec

Mintlify

Phoenix Frontend

Phoenix Graphql

Phoenix Server

Phoenix Storybook

Questions about Create Task

Install Create Task

Facts

At a glance

What it does

When your agent uses it

Example prompts

Requirements

Workflow steps

What it can do on your machine

Tool permissions

Runs code

Network

Credentials

Context cost

Safety

SKILL.md

Files

Compare with similar skills

Similar skills

More from Arize-ai/phoenix

Related

Questions about Create Task