Official agent skill

Aqua Evaluation

by oracle in oracle/accelerated-data-science

Evaluate LLM model quality using BERTScore, ROUGE, Perplexity, and Text Readability metrics on OCI AI Quick Actions (AQUA).

OfficialUPL-1.0Auto-check passedWriting & Content

Install Aqua Evaluation

skills CLI
$ npx skills add oracle/accelerated-data-science --skill aqua-evaluation -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install oracle/accelerated-data-science aqua-evaluation --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/oracle/accelerated-data-science.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/aqua-evaluation .claude/skills/aqua-evaluation && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
aqua-evaluation
GitHub stars
125
Token cost
~1.6k tokens
SKILL.md length
295 words
Files
3
Skills in repo
8
Repo updated
First seen
Licence
UPL-1.0

At a glance

Evaluate LLM model quality using BERTScore, ROUGE, Perplexity, and Text Readability metrics on OCI AI Quick Actions (AQUA).

  • Wants to evaluate
  • SKILL.md covers Supported Metrics, Dataset Format, Python SDK Usage and CLI Usage, plus 2 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Benchmark a model

What it does

Aqua Evaluation is an agent skill from oracle/accelerated-data-science, published by the product's own GitHub organization. Evaluate LLM model quality using BERTScore, ROUGE, Perplexity, and Text Readability metrics on OCI AI Quick Actions (AQUA). Covers dataset preparation, evaluation job creation, and report interpretation. Triggered when user wants to evaluate or benchmark a model.

Its SKILL.md is about 1.6k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files.

It sits in Writing & Content, covering Plain language and style rules and Web search. It works with Perplexity and Python. The repository describes itself as: ADS is the Oracle Data Science Cloud Service's python SDK supporting, model ops (train/eval/deploy), along with running workloads on Jobs and Pipeline resources.

When your agent uses it

  • Wants to evaluate
  • Benchmark a model

Example prompts

  • “/aqua-evaluation”

Requirements

  • Python 3

What it can do on your machine

Read from SKILL.md and the folder at commit 0418ab4. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are python, bash and jsonl).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Aqua Evaluation loads about 1.6k tokens when it runs. Until then it costs about 70 tokens; SKILL.md has 295 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~70
When it runs · the whole SKILL.md, loaded when a task matches
~1.6k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (UPL-1.0) doesn't allow us to republish the file, so here is its outline and opening line. It has 295 words (~1,641 tokens).

“Use this skill when the user wants to evaluate LLM models on OCI Data Science using AI Quick Actions.”

— opening of SKILL.md by oracle, UPL-1.0
name
aqua-evaluation
user-invocable
true
disable-model-invocation
false

Read the full SKILL.md on GitHub

Files

SKILL.md and 2 other files in skills/aqua-evaluation of oracle/accelerated-data-science.

  • SKILL.md
  • examples/evaluation-sample-no-sys-message.jsonl
  • examples/evaluation-sample-with-sys-message.jsonl

Open the folder on GitHubat commit 0418ab4

Compare with similar skills

Aqua Evaluation next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Aqua Evaluation compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Aqua Evaluation this skilloracle/accelerated-data-science125—~1.6kAutomated safety check: PassUPL-1.0
Perplexity SearchescapeWu/perplexity-ai169—~1.8kAutomated safety check: PassMIT
SEO Auditshadcn-labs/agentcn486—~598Automated safety check: PassMIT
Literature Searchgaasher/Agent-Loop-Skills1741 repos~1.5kAutomated safety check: PassMIT
Content Researchnicepkg/ai-workflow285—~3.7kAutomated safety check: PassMIT
Python Style Guideaiskillstore/marketplace430—~2.8kAutomated safety check: PassCustom licence

Similar skills

  • Perplexity Search

    escapeWu/perplexity-ai

    Searches the live web with citations through perplexity-mcp v2 tools or a bundled Python REST client, with focused ask, deep research and detached tasks.

    169 GitHub stars~1.8k tokensUpdated 11 days ago
    Productivity & AutomationAuto-check passed
  • SEO Audit

    shadcn-labs/agentcn

    How to present the deterministic AI-SEO audit returned by auditpage.

    486 GitHub stars~598 tokensUpdated yesterday
    Marketing & SEOAuto-check passed
  • Literature Search

    gaasher/Agent-Loop-Skills

    A skill your agent uses when a loop needs scholarly literature — paper discovery, novelty checks, full-text snippet search, citation-graph traversal, single-paper reads, or experimental-result…

    174 GitHub starsUsed in 1 repo~1.5k tokens
    Research & ScienceAuto-check passed
  • Content Research

    nicepkg/ai-workflow

    Research-first content creation optimized for both human readers and AI search engines (Claude, ChatGPT, Perplexity, Gemini).

    285 GitHub stars~3.7k tokensUpdated 8 mo ago
    Writing & ContentAuto-check passed
  • Python Style Guide

    aiskillstore/marketplace

    Comprehensive Python programming guidelines based on Google's Python Style Guide.

    430 GitHub stars~2.8k tokensUpdated yesterday
    Writing & ContentAuto-check passed
  • Verified Research

    sweetcornna/free-search-mcp

    Use with the free-search MCP tools whenever a web lookup must yield facts someone will rely on: dates, deadlines, prices, prizes, fees, rules, eligibility, schedules, versions, statistics, news, or…

    116 GitHub stars~1.8k tokensUpdated 4 days ago
    Agent WorkflowsAuto-check passed

More from oracle/accelerated-data-science

All 8 skills in this repo
  • Aqua CLI

    oracle/accelerated-data-science

    Official

    Complete CLI reference for the ADS AQUA command-line interface (ads aqua).

    125 GitHub stars~2.1k tokensUpdated 1 mo ago
    Auto-check passed
  • Aqua Deployment

    oracle/accelerated-data-science

    Official

    Deploy LLM models on OCI using AI Quick Actions (AQUA) - single model, multi-model, stacked (LoRA), with GPU shape selection, vLLM configuration, streaming, and tool calling.

    125 GitHub stars~2.4k tokensUpdated 1 mo ago
    Auto-check passed
  • Aqua Model Lifecycle

    oracle/accelerated-data-science

    Official

    Register, list, get, and manage LLM models in OCI AI Quick Actions (AQUA) using the ADS SDK.

    125 GitHub stars~1.4k tokensUpdated 1 mo ago
    Auto-check passed
  • Aqua Finetuning

    oracle/accelerated-data-science

    Official

    Fine-tune LLM models using LoRA on OCI AI Quick Actions (AQUA).

    125 GitHub stars~1.7k tokensUpdated 1 mo ago
    Auto-check passed
  • Aqua Metrics

    oracle/accelerated-data-science

    Official

    Set up Prometheus and Grafana monitoring for AQUA vLLM model deployments on OCI.

    125 GitHub stars~1.5k tokensUpdated 1 mo ago
    Auto-check passed
  • Aqua Troubleshooting

    oracle/accelerated-data-science

    Official

    Diagnose and fix OCI AI Quick Actions (AQUA) issues including deployment failures, OOM errors, authorization problems, capacity issues, container errors, and policy misconfigurations.

    125 GitHub stars~1.8k tokensUpdated 1 mo ago
    Auto-check passed

Questions about Aqua Evaluation

What does Aqua Evaluation do?

Evaluate LLM model quality using BERTScore, ROUGE, Perplexity, and Text Readability metrics on OCI AI Quick Actions (AQUA). Aqua Evaluation is an agent skill from oracle/accelerated-data-science, published by the product's own GitHub organization. Evaluate LLM model quality using BERTScore, ROUGE, Perplexity, and Text Readability metrics on OCI AI Quick Actions (AQUA).

When should I use Aqua Evaluation?

Aqua Evaluation fits situations like: wants to evaluate; benchmark a model.

How do I install Aqua Evaluation in Claude Code?

Run `npx skills add oracle/accelerated-data-science --skill aqua-evaluation -a claude-code`. Or copy the skill folder (skills/aqua-evaluation in oracle/accelerated-data-science) into .claude/skills/aqua-evaluation in your project. Claude Code loads it when a task matches its description.

How do I install Aqua Evaluation in Codex?

Run `npx skills add oracle/accelerated-data-science --skill aqua-evaluation -a codex`. Or copy the skill folder (skills/aqua-evaluation in oracle/accelerated-data-science) into .agents/skills/aqua-evaluation in your project. Codex loads it when a task matches its description.

Can I use Aqua Evaluation in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add oracle/accelerated-data-science --skill aqua-evaluation -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/aqua-evaluation, .gemini/skills/aqua-evaluation, .github/skills/aqua-evaluation and .opencode/skills/aqua-evaluation in your project.

What does Aqua Evaluation need to run?

SKILL.md names no scripts, command-line tools or credentials: Aqua Evaluation is instructions for the agent only. Our summary lists: Python 3.

Does Aqua Evaluation access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Aqua Evaluation safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Aqua Evaluation use?

Aqua Evaluation is published under the UPL-1.0 licence (the repository's licence).

How many tokens does Aqua Evaluation use?

About 1.6k tokens (SKILL.md is roughly 6.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Aqua Evaluation?

Skills that share tags, products or a category with Aqua Evaluation: Perplexity Search (escapeWu/perplexity-ai, 169 stars), SEO Audit (shadcn-labs/agentcn, 486 stars), Literature Search (gaasher/Agent-Loop-Skills, 174 stars) and Content Research (nicepkg/ai-workflow, 285 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Aqua Evaluation?

oracle (a GitHub organization, an official publisher) maintains it in oracle/accelerated-data-science, which has 125 GitHub stars. The repository holds 8 skills in this directory. The repository was last updated on September 3, 2026.

Source: oracle/accelerated-data-science on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.