Agent skill

Coreweave Data Handling

by jeremylongshore in jeremylongshore/tons-of-skills-marketplace

Handle training data and model artifacts on CoreWeave persistent storage.

MITAuto-check passedData & Analytics

Install Coreweave Data Handling

skills CLI
$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill coreweave-data-handling -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install jeremylongshore/tons-of-skills-marketplace coreweave-data-handling --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/.curated/coreweave-data-handling .claude/skills/coreweave-data-handling && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
coreweave-data-handling
GitHub stars
2.8k
Token cost
~1.8k tokens
SKILL.md length
514 words
Files
1
Skills in repo
3,342
Repo updated
First seen
Licence
MIT

At a glance

Handle training data and model artifacts on CoreWeave persistent storage.

  • Works in 4 steps: Create or select an encrypted PVC in the… → Import artifacts using a short-lived… → Export only to a reviewed destination,… → …
  • Managing large datasets
  • SKILL.md covers Overview, Prerequisites, Instructions and Data Classification, plus 9 more sections
  • Calls kubectl

What it does

Coreweave Data Handling is an agent skill from jeremylongshore/tons-of-skills-marketplace. Handle training data and model artifacts on CoreWeave persistent storage. Use when managing large datasets, configuring storage classes, or implementing data pipelines for GPU workloads. Trigger with phrases like "coreweave data", "coreweave storage", "coreweave pvc", "coreweave dataset management".

Its SKILL.md is about 1.8k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts. Compatibility notes: Designed for Claude Code

It sits in Data & Analytics, covering Data pipelines and ETL. The repository describes itself as: Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com. The licence is MIT.

When your agent uses it

  • Managing large datasets
  • Configuring storage classes
  • Implementing data pipelines for GPU workloads
  • With phrases like coreweave data

Example prompts

  • “coreweave data”
  • “coreweave storage”
  • “coreweave pvc”
  • “/coreweave-data-handling”

Requirements

  • Compatibility (from SKILL.md): Designed for Claude Code
  • Pre-approved tools (allowed-tools): Read, Write, Edit, Bash(kubectl:*), Grep

Workflow steps

4 steps, taken from the first numbered list in SKILL.md.

  1. Create or select an encrypted PVC in the approved region and grant its mount only
  2. Import artifacts using a short-lived job; verify the expected SHA-256 before any
  3. Export only to a reviewed destination, preserve the checksum and data-owner
  4. Record storage provisioning, access changes, deletion, and external egress in the

What it can do on your machine

Read from SKILL.md and the folder at commit cfae287. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Write
    • Edit
    • Bash(kubectl:*)
    • Grep

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • kubectl

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • kubernetes.io

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

  • Compatibility

    Designed for Claude Code

    From compatibility in the SKILL.md frontmatter.

Context cost

Coreweave Data Handling loads about 1.8k tokens when it runs. Until then it costs about 81 tokens; SKILL.md has 514 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~81
When it runs · the whole SKILL.md, loaded when a task matches
~1.8k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit cfae287, republished under its MIT licence (© jeremylongshore). 514 words, ~1,799 tokens.

Download SKILL.mdSave it as .claude/skills/coreweave-data-handling/SKILL.md (or your agent's skills folder).
name
coreweave-data-handling
description
Handle training data and model artifacts on CoreWeave persistent storage. Use when managing large datasets, configuring storage classes, or implementing data pipelines for GPU workloads. Trigger with phrases like "coreweave data", "coreweave storage", "coreweave pvc", "coreweave dataset management".
allowed-tools
Read, Write, Edit, Bash(kubectl:*), Grep
compatibility
Designed for Claude Code
version
1.11.0
license
MIT
author
Jeremy Longshore <jeremy@intentsolutions.io>
tags
saas, gpu-cloud, kubernetes, inference, coreweave

CoreWeave Data Handling

Community-contributed. Not affiliated with, endorsed by, or sponsored by CoreWeave, Inc. CoreWeave is a registered trademark of CoreWeave, Inc.

Overview

CoreWeave GPU cloud workloads involve large-scale data artifacts: model weights (multi-GB safetensors/GGUF), training datasets (parquet, TFRecord, WebDataset), checkpoint snapshots, and inference cache volumes. Data flows through Kubernetes PersistentVolumeClaims backed by region-specific storage classes. Compliance requires encryption at rest via the storage driver, namespace-scoped RBAC for volume access, and audit logging for any data egress from GPU nodes.

Prerequisites

  • Approved data classification, retention schedule, and region for the artifact.
  • A namespace-scoped service account, encrypted storage class, and approved destination.
  • Expected artifact size and SHA-256 from a trusted source before import.

Instructions

  1. Create or select an encrypted PVC in the approved region and grant its mount only to the intended namespace service account.
  2. Import artifacts using a short-lived job; verify the expected SHA-256 before any training or serving workload consumes them.
  3. Export only to a reviewed destination, preserve the checksum and data-owner approval, and enforce the retention policy for checkpoints and datasets.
  4. Record storage provisioning, access changes, deletion, and external egress in the audit system without copying sensitive artifact contents into logs.

Data Classification

Data TypeSensitivityRetentionEncryption
Model weightsMediumUntil deprecatedAES-256 at rest
Training datasetsHigh (may contain PII)Per data licenseAES-256 + TLS in transit
Checkpoint snapshotsMedium30 days post-trainingAES-256 at rest
Inference cacheLowSession/TTLVolume-level encryption
HuggingFace tokensCriticalRotate quarterlyK8s Secret + KMS

Data Import

typescript
import { KubeConfig, BatchV1Api } from '@kubernetes/client-node';

async function importDataset(pvcName: string, sourceUrl: string, namespace: string) {
  const kc = new KubeConfig();
  kc.loadFromDefault();
  const batch = kc.makeApiClient(BatchV1Api);
  const job = {
    metadata: { name: `import-${Date.now()}`, namespace },
    spec: { template: { spec: {
      restartPolicy: 'Never',
      containers: [{ name: 'loader', image: 'python:3.11-slim',
        command: ['python3', '-c', `
import urllib.request, hashlib
dest = '/data/dataset.tar.gz'
urllib.request.urlretrieve('${sourceUrl}', dest)
print(f"SHA256: {hashlib.sha256(open(dest,'rb').read()).hexdigest()}")`],
        volumeMounts: [{ name: 'storage', mountPath: '/data' }],
      }],
      volumes: [{ name: 'storage', persistentVolumeClaim: { claimName: pvcName } }],
    }}}
  };
  await batch.createNamespacedJob(namespace, { body: job });
}

Data Export

typescript
async function exportCheckpoint(pvcName: string, destBucket: string, ns: string) {
  // Validate export destination is in approved region list
  const APPROVED_REGIONS = ['us-east-1', 'us-central-1', 'eu-west-1'];
  const region = destBucket.split('-').slice(0, 3).join('-');
  if (!APPROVED_REGIONS.some(r => destBucket.includes(r))) {
    throw new Error(`Export blocked: ${region} not in approved regions`);
  }
  // Stream from PVC → object storage with integrity check
  const exportCmd = `tar czf - /models | gsutil cp - gs://${destBucket}/export.tar.gz`;
  console.log(`Exporting from PVC ${pvcName} to ${destBucket}`);
  return exportCmd;
}

Data Validation

typescript
interface ModelArtifact {
  name: string; format: 'safetensors' | 'gguf' | 'bin' | 'pt';
  sizeBytes: number; sha256: string;
}

function validateArtifact(artifact: ModelArtifact): string[] {
  const errors: string[] = [];
  if (!artifact.name || artifact.name.length > 255) errors.push('Invalid artifact name');
  if (artifact.sizeBytes <= 0) errors.push('Size must be positive');
  if (!/^[a-f0-9]{64}$/.test(artifact.sha256)) errors.push('Invalid SHA-256 hash');
  if (!['safetensors', 'gguf', 'bin', 'pt'].includes(artifact.format)) errors.push(`Unsupported format`);
  return errors;
}

Compliance

  • All PVCs use encrypted storage classes (AES-256 at rest)
  • HuggingFace and API tokens stored in Kubernetes Secrets with KMS encryption
  • Namespace-scoped RBAC restricts volume mount access to authorized workloads
  • Data egress from GPU nodes logged via network policy audit
  • Training datasets with PII processed only in approved regions (data residency)
  • Checkpoint retention enforced via CronJob garbage collection (30-day default)
  • SOC 2 Type II audit trail for all storage provisioning and deletion events
Show full SKILL.md (187 more words)Show less

Error Handling

IssueCauseFix
PVC pending indefinitelyStorage class unavailable in regionCheck kubectl get sc and switch to available class
Download job OOMKilledDataset exceeds container memory limitIncrease resource limits or use streaming download
Permission denied on volumeRBAC misconfigured for namespaceVerify ServiceAccount has PVC access via RoleBinding
Checksum mismatch after importPartial transfer or corruptionRe-run import job; enable retry with backoff
Secret not foundKMS key rotation or namespace mismatchVerify secret exists in target namespace with kubectl get secret

Output

  • An encrypted, namespace-scoped storage path with validated artifact integrity.
  • A redacted import/export receipt containing source/destination approval, checksum, retention, and data-owner information.
  • A reversible failure path that prevents corrupted or unauthorized data from being mounted.

Examples

Import only a manifest-approved artifact and verify its checksum inside the isolated job before promoting it to a serving or training workload:

bash
kubectl -n research apply -f dataset-import-job.yaml
kubectl -n research wait --for=condition=complete job/dataset-import --timeout=30m
kubectl -n research logs job/dataset-import | grep SHA256

If the checksum differs, quarantine the PVC content, retain the redacted job receipt, and reacquire the artifact from the approved source. Do not retry into a production volume or disable integrity verification.

Resources

Next Steps

See coreweave-security-basics.

© jeremylongshore, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/.curated/coreweave-data-handling of jeremylongshore/tons-of-skills-marketplace.

Open the folder on GitHubat commit cfae287

Compare with similar skills

Coreweave Data Handling next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Coreweave Data Handling compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Coreweave Data Handling this skilljeremylongshore/tons-of-skills-marketplace2.8k—~1.8kAutomated safety check: PassMIT
Crawl4AI Web Scrapingsmallnest/goclaw5991 repos~2.5kAutomated safety check: PassMIT
Glue 09 10 Migrationaws-samples/aws-glue-samples1.5k—~2.4kAutomated safety check: PassMIT-0
Migrate Glue Devendpoint To Interactive Sessionsaws-samples/aws-glue-samples1.5k—~3.6kAutomated safety check: PassMIT-0
Dbt Databricks PR Readydatabricks/dbt-databricks380—~2.8kAutomated safety check: PassApache-2.0
Apache Spark EngineerJeffallan/claude-skills12k1 repos~1.7kAutomated safety check: PassMIT

Similar skills

  • Crawl4AI Web Scraping

    smallnest/goclaw

    Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.

    599 GitHub starsUsed in 1 repo~2.5k tokens
    Data & AnalyticsAuto-check passed
  • Glue 09 10 Migration

    aws-samples/aws-glue-samples

    Official

    Upgrade an AWS Glue ETL job from Glue version 0.9 or 1.0 to Glue 4.0.

    1.5k GitHub stars~2.4k tokensUpdated 1 mo ago
    Data & AnalyticsAuto-check passed
  • Official

    Migrate a legacy AWS Glue development endpoint to a Glue interactive session, following the official AWS migration checklist.

    1.5k GitHub stars~3.6k tokensUpdated 1 mo ago
    Data & AnalyticsAuto-check passed
  • Dbt Databricks PR Ready

    databricks/dbt-databricks

    Official

    A skill your agent uses for an open dbt-databricks pull request, including your own PR or a fork PR, to assess merge readiness and optionally repair selected gaps on the PR head branch.

    380 GitHub stars~2.8k tokensUpdated today
    Data & AnalyticsAuto-check passed
  • Apache Spark Engineer

    Jeffallan/claude-skills

    Guides writing and tuning Apache Spark jobs: DataFrame and RDD code, Spark SQL, partitioning, caching, shuffle tuning and structured streaming.

    12k GitHub starsUsed in 1 repo~1.7k tokens
    Data & AnalyticsAuto-check passed
  • Mz Dbt Release

    MaterializeInc/materialize

    Cut a dbt-materialize PyPI release: bump the version in version.py and setup.py, date the Unreleased CHANGELOG entry, and open the release PR with a Ship: <url body.

    6.4k GitHub stars~1.2k tokensUpdated today
    Data & AnalyticsAuto-check passed

More from jeremylongshore/tons-of-skills-marketplace

All 3,342 skills in this repo
  • Performing Security Code Review

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to conduct a security-focused code review using the security-agent plugin.

    2.8k GitHub starsUsed in 2 repos~1.3k tokens
    Auto-check: notes
  • Adapting Transfer Learning Models

    jeremylongshore/tons-of-skills-marketplace

    Build this skill automates the adaptation of pre-trained machine learning models using transfer learning techniques.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Agent Context Loader

    jeremylongshore/tons-of-skills-marketplace

    Execute proactive auto-loading: automatically detects and loads agents.md files.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Aggregating Performance Metrics

    jeremylongshore/tons-of-skills-marketplace

    Aggregate and centralize performance metrics from applications, systems, databases, caches, and services.

    2.8k GitHub stars~1.2k tokensUpdated today
    Auto-check passed
  • Analyzing Capacity Planning

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to analyze capacity requirements and plan for future growth.

    2.8k GitHub stars~947 tokensUpdated today
    Auto-check passed
  • Analyzing Database Indexes

    jeremylongshore/tons-of-skills-marketplace

    Process use when you need to work with database indexing. An agent skill from jeremylongshore/tons-of-skills-marketplace.

    2.8k GitHub stars~2k tokensUpdated today
    Auto-check passed

Questions about Coreweave Data Handling

What does Coreweave Data Handling do?

Handle training data and model artifacts on CoreWeave persistent storage. Coreweave Data Handling is an agent skill from jeremylongshore/tons-of-skills-marketplace. Handle training data and model artifacts on CoreWeave persistent storage.

When should I use Coreweave Data Handling?

Coreweave Data Handling fits situations like: managing large datasets; configuring storage classes; implementing data pipelines for GPU workloads; with phrases like coreweave data.

How do I install Coreweave Data Handling in Claude Code?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill coreweave-data-handling -a claude-code`. Or copy the skill folder (skills/.curated/coreweave-data-handling in jeremylongshore/tons-of-skills-marketplace) into .claude/skills/coreweave-data-handling in your project. Claude Code loads it when a task matches its description.

How do I install Coreweave Data Handling in Codex?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill coreweave-data-handling -a codex`. Or copy the skill folder (skills/.curated/coreweave-data-handling in jeremylongshore/tons-of-skills-marketplace) into .agents/skills/coreweave-data-handling in your project. Codex loads it when a task matches its description.

Can I use Coreweave Data Handling in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill coreweave-data-handling -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/coreweave-data-handling, .gemini/skills/coreweave-data-handling, .github/skills/coreweave-data-handling and .opencode/skills/coreweave-data-handling in your project.

What does Coreweave Data Handling need to run?

Going by SKILL.md and its folder, Coreweave Data Handling needs the command-line tools its instructions call (kubectl). Its frontmatter pre-approves these tools: Read, Write, Edit, Bash(kubectl:*), Grep. Compatibility (from SKILL.md): Designed for Claude Code.

Does Coreweave Data Handling access the network?

SKILL.md names 1 domain. As links in the text: kubernetes.io. This is read from the text; nothing was executed.

Is Coreweave Data Handling safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Coreweave Data Handling use?

Coreweave Data Handling is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Coreweave Data Handling use?

About 1.8k tokens (SKILL.md is roughly 7.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Coreweave Data Handling?

Skills that share tags, products or a category with Coreweave Data Handling: Crawl4AI Web Scraping (smallnest/goclaw, 599 stars), Glue 09 10 Migration (aws-samples/aws-glue-samples, 1.5k stars), Migrate Glue Devendpoint To Interactive Sessions (aws-samples/aws-glue-samples, 1.5k stars) and Dbt Databricks PR Ready (databricks/dbt-databricks, 380 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Coreweave Data Handling?

jeremylongshore (a GitHub user) maintains it in jeremylongshore/tons-of-skills-marketplace, which has 2,827 GitHub stars. The repository holds 3,342 skills in this directory. The repository was last updated on October 10, 2026.

Source: jeremylongshore/tons-of-skills-marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.