New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Spark SQL Optimizer

by jeremylongshore in jeremylongshore/tons-of-skills-marketplace

Optimize spark sql optimizer operations. An agent skill from jeremylongshore/tons-of-skills-marketplace.

MITAuto-check passedData & Analytics

Install Spark SQL Optimizer

skills CLI
$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill spark-sql-optimizer -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install jeremylongshore/tons-of-skills-marketplace spark-sql-optimizer --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/11-data-pipelines/spark-sql-optimizer .claude/skills/spark-sql-optimizer && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
spark-sql-optimizer
GitHub stars
2.8k
Token cost
~564 tokens
SKILL.md length
196 words
Files
1
Skills in repo
3,342
Repo updated
First seen
Licence
MIT

At a glance

Optimize spark sql optimizer operations. An agent skill from jeremylongshore/tons-of-skills-marketplace.

  • Works in 4 steps: Provides step-by-step guidance for spark… → Follows industry best practices and… → Generates production-ready code and… → …
  • : spark sql optimizer
  • SKILL.md covers Overview, When to Use, Instructions and Examples, plus 5 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Spark SQL Optimizer is an agent skill from jeremylongshore/tons-of-skills-marketplace. Optimize spark sql optimizer operations. Auto-activating skill for Data Pipelines. Triggers on: spark sql optimizer, spark sql optimizer Part of the Data Pipelines skill category. Use when working with spark sql optimizer functionality. Trigger with phrases like "spark sql optimizer", "spark optimizer", "spark".

Its SKILL.md is about 560 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts. Compatibility notes: Designed for Claude Code

It sits in Data & Analytics, covering Data pipelines and ETL. It works with Apache Spark. The repository describes itself as: Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com. The licence is MIT.

When your agent uses it

  • : spark sql optimizer
  • Spark sql optimizer Part of the Data Pipelines skill category
  • Working with spark sql optimizer functionality
  • With phrases like spark sql optimizer

Example prompts

  • “spark sql optimizer”
  • “spark optimizer”
  • “/spark-sql-optimizer”

Requirements

  • Compatibility (from SKILL.md): Designed for Claude Code
  • Pre-approved tools (allowed-tools): Read, Write, Edit, Bash(cmd:*), Grep

Workflow steps

4 steps, taken from the first numbered list in SKILL.md.

  1. Provides step-by-step guidance for spark sql optimizer
  2. Follows industry best practices and patterns
  3. Generates production-ready code and configurations
  4. Validates outputs against common standards

What it can do on your machine

Read from SKILL.md and the folder at commit 80f86df. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Write
    • Edit
    • Bash(cmd:*)
    • Grep

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

  • Compatibility

    Designed for Claude Code

    From compatibility in the SKILL.md frontmatter.

Context cost

Spark SQL Optimizer loads about 564 tokens when it runs. Until then it costs about 83 tokens; SKILL.md has 196 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~83
When it runs · the whole SKILL.md, loaded when a task matches
~564

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit 80f86df, republished under its MIT licence (© jeremylongshore). 196 words, ~564 tokens.

Download SKILL.mdSave it as .claude/skills/spark-sql-optimizer/SKILL.md (or your agent's skills folder).
name
spark-sql-optimizer
description
Optimize spark sql optimizer operations. Auto-activating skill for Data Pipelines. Triggers on: spark sql optimizer, spark sql optimizer Part of the Data Pipelines skill category. Use when working with spark sql optimizer functionality. Trigger with phrases like "spark sql optimizer", "spark optimizer", "spark".
allowed-tools
Read, Write, Edit, Bash(cmd:*), Grep
compatibility
Designed for Claude Code
version
1.0.0
license
MIT
author
Jeremy Longshore <jeremy@intentsolutions.io>
tags
data, data-engineering

Spark Sql Optimizer

Overview

This skill provides automated assistance for spark sql optimizer tasks within the Data Pipelines domain.

When to Use

This skill activates automatically when you:

  • Mention "spark sql optimizer" in your request
  • Ask about spark sql optimizer patterns or best practices
  • Need help with data pipeline skills covering etl, data transformation, workflow orchestration, and streaming data processing.

Instructions

  1. Provides step-by-step guidance for spark sql optimizer
  2. Follows industry best practices and patterns
  3. Generates production-ready code and configurations
  4. Validates outputs against common standards

Examples

Example: Basic Usage Request: "Help me with spark sql optimizer" Result: Provides step-by-step guidance and generates appropriate configurations

Prerequisites

  • Relevant development environment configured
  • Access to necessary tools and services
  • Basic understanding of data pipelines concepts

Output

  • Generated configurations and code
  • Best practice recommendations
  • Validation results

Error Handling

ErrorCauseSolution
Configuration invalidMissing required fieldsCheck documentation for required parameters
Tool not foundDependency not installedInstall required tools per prerequisites
Permission deniedInsufficient accessVerify credentials and permissions

Resources

  • Official documentation for related tools
  • Best practices guides
  • Community examples and tutorials

Part of the Data Pipelines skill category. Tags: etl, airflow, spark, streaming, data-engineering

© jeremylongshore, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/11-data-pipelines/spark-sql-optimizer of jeremylongshore/tons-of-skills-marketplace.

Open the folder on GitHubat commit 80f86df

Compare with similar skills

Spark SQL Optimizer next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Spark SQL Optimizer compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Spark SQL Optimizer this skilljeremylongshore/tons-of-skills-marketplace2.8k—~564Automated safety check: PassMIT
Migrate Glue Devendpoint To Interactive Sessionsaws-samples/aws-glue-samples1.5k—~3.6kAutomated safety check: PassMIT-0
Apache Spark EngineerJeffallan/claude-skills12k1 repos~1.7kAutomated safety check: PassMIT
Apache Spark Optimizationwshobson/agents40k9 repos~789Automated safety check: PassMIT
Data Engineerdavila7/claude-code-templates32k8 repos~2.8kAutomated safety check: PassMIT
Data PipelineRightNow-AI/openfang18k—~847Automated safety check: PassApache-2.0

Similar skills

  • Migrate Glue Devendpoint To Interactive Sessions

    aws-samples/aws-glue-samples

    Official

    Migrate a legacy AWS Glue development endpoint to a Glue interactive session, following the official AWS migration checklist.

    1.5k GitHub stars~3.6k tokensUpdated 1 mo ago
    Data & AnalyticsAuto-check passed

  • Apache Spark Engineer

    Jeffallan/claude-skills

    Guides writing and tuning Apache Spark jobs: DataFrame and RDD code, Spark SQL, partitioning, caching, shuffle tuning and structured streaming.

    12k GitHub starsUsed in 1 repo~1.7k tokens
    Data & AnalyticsAuto-check passed

  • Apache Spark Optimization

    wshobson/agents

    Speed up slow Apache Spark jobs by tuning partitions, shuffles, data skew, caching and executor memory, with do and don't rules for PySpark code.

    40k GitHub starsUsed in 9 repos~789 tokens
    Data & AnalyticsAuto-check passed

  • Data Engineer

    davila7/claude-code-templates

    Build scalable data pipelines, modern data warehouses, and real-time streaming architectures.

    32k GitHub starsUsed in 8 repos~2.8k tokens
    Data & AnalyticsAuto-check passed

  • Data Pipeline

    RightNow-AI/openfang

    Data pipeline expert for ETL, Apache Spark, Airflow, dbt, and data quality

    18k GitHub stars~847 tokensUpdated 3 mo ago
    Data & AnalyticsAuto-check passed

  • Data Engineering

    rohitg00/awesome-claude-code-toolkit

    Data engineering patterns for ETL pipelines, data warehousing, Apache Spark, and data quality validation

    2.7k GitHub stars~1.7k tokensUpdated 5 mo ago
    Data & AnalyticsAuto-check passed

More from jeremylongshore/tons-of-skills-marketplace

All 3,342 skills in this repo

  • Performing Security Code Review

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to conduct a security-focused code review using the security-agent plugin.

    2.8k GitHub starsUsed in 2 repos~1.3k tokens
    Auto-check: notes

  • Adapting Transfer Learning Models

    jeremylongshore/tons-of-skills-marketplace

    Build this skill automates the adaptation of pre-trained machine learning models using transfer learning techniques.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed

  • Agent Context Loader

    jeremylongshore/tons-of-skills-marketplace

    Execute proactive auto-loading: automatically detects and loads agents.md files.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed

  • Aggregating Performance Metrics

    jeremylongshore/tons-of-skills-marketplace

    Aggregate and centralize performance metrics from applications, systems, databases, caches, and services.

    2.8k GitHub stars~1.2k tokensUpdated today
    Auto-check passed

  • Analyzing Capacity Planning

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to analyze capacity requirements and plan for future growth.

    2.8k GitHub stars~947 tokensUpdated today
    Auto-check passed

  • Analyzing Database Indexes

    jeremylongshore/tons-of-skills-marketplace

    Process use when you need to work with database indexing. An agent skill from jeremylongshore/tons-of-skills-marketplace.

    2.8k GitHub stars~2k tokensUpdated today
    Auto-check passed

Works with

Categories

Questions about Spark SQL Optimizer

What does Spark SQL Optimizer do?

Optimize spark sql optimizer operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. Spark SQL Optimizer is an agent skill from jeremylongshore/tons-of-skills-marketplace. Optimize spark sql optimizer operations.

When should I use Spark SQL Optimizer?

Spark SQL Optimizer fits situations like: : spark sql optimizer; spark sql optimizer Part of the Data Pipelines skill category; working with spark sql optimizer functionality; with phrases like spark sql optimizer.

How do I install Spark SQL Optimizer in Claude Code?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill spark-sql-optimizer -a claude-code`. Or copy the skill folder (skills/11-data-pipelines/spark-sql-optimizer in jeremylongshore/tons-of-skills-marketplace) into .claude/skills/spark-sql-optimizer in your project. Claude Code loads it when a task matches its description.

How do I install Spark SQL Optimizer in Codex?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill spark-sql-optimizer -a codex`. Or copy the skill folder (skills/11-data-pipelines/spark-sql-optimizer in jeremylongshore/tons-of-skills-marketplace) into .agents/skills/spark-sql-optimizer in your project. Codex loads it when a task matches its description.

Can I use Spark SQL Optimizer in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill spark-sql-optimizer -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/spark-sql-optimizer, .gemini/skills/spark-sql-optimizer, .github/skills/spark-sql-optimizer and .opencode/skills/spark-sql-optimizer in your project.

What does Spark SQL Optimizer need to run?

SKILL.md names no scripts, command-line tools or credentials: Spark SQL Optimizer is instructions for the agent only. Its frontmatter pre-approves these tools: Read, Write, Edit, Bash(cmd:*), Grep. Compatibility (from SKILL.md): Designed for Claude Code.

Does Spark SQL Optimizer access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Spark SQL Optimizer safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Spark SQL Optimizer use?

Spark SQL Optimizer is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Spark SQL Optimizer use?

About 564 tokens (SKILL.md is roughly 2.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Spark SQL Optimizer?

Skills that share tags, products or a category with Spark SQL Optimizer: Migrate Glue Devendpoint To Interactive Sessions (aws-samples/aws-glue-samples, 1.5k stars), Apache Spark Engineer (Jeffallan/claude-skills, 12k stars), Apache Spark Optimization (wshobson/agents, 40k stars) and Data Engineer (davila7/claude-code-templates, 32k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Spark SQL Optimizer?

jeremylongshore (a GitHub user) maintains it in jeremylongshore/tons-of-skills-marketplace, which has 2,825 GitHub stars. The repository holds 3,342 skills in this directory. The repository was last updated on October 9, 2026.

Source: jeremylongshore/tons-of-skills-marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.