Agent skill

Softmax Kernel Optimization

by ZJLi2013 in ZJLi2013/awesome-kernel-skills

Optimize fused softmax kernels in Triton for NVIDIA and AMD GPUs.

No licenceAuto-check passedDatabases

Install Softmax Kernel Optimization

skills CLI
$ npx skills add ZJLi2013/awesome-kernel-skills --skill softmax-kernel-optimization -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install ZJLi2013/awesome-kernel-skills softmax-kernel-optimization --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/ZJLi2013/awesome-kernel-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/kernels/softmax .claude/skills/softmax-kernel-optimization && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
softmax-kernel-optimization
GitHub stars
102
Token cost
~742 tokens
SKILL.md length
320 words
Files
3
Skills in repo
12
Repo updated
First seen
Licence
None found

At a glance

Optimize fused softmax kernels in Triton for NVIDIA and AMD GPUs.

  • Works in 5 steps: Load entire row into registers (FP32) → Find row maximum: m = max(x) → Compute shifted exponentials: e = exp(x… → …
  • Optimizing softmax
  • SKILL.md covers Overview, Core Technique, Autotune Notes and Verification, plus 3 more sections
  • Runs Python scripts from its folder; calls python

What it does

Softmax Kernel Optimization is an agent skill from ZJLi2013/awesome-kernel-skills. Optimize fused softmax kernels in Triton for NVIDIA and AMD GPUs. Covers online max/sum reduction, multi-row processing, numerical stability, and warp-level patterns. Use when writing or optimizing softmax, log-softmax, or similar row-wise normalization kernels.

Its SKILL.md is about 740 tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files (for example `test_softmax.py` and `triton_template.py`).

It sits in Databases, covering Database schema design. It works with NVIDIA AI Platform.

When your agent uses it

  • Optimizing softmax
  • Similar row-wise normalization kernels

Example prompts

  • “/softmax-kernel-optimization”

Requirements

  • Python 3

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. Load entire row into registers (FP32)
  2. Find row maximum: m = max(x)
  3. Compute shifted exponentials: e = exp(x - m)
  4. Sum exponentials: s = sum(e)
  5. Normalize: out = e / s

What it can do on your machine

Read from SKILL.md and the folder at commit aba7662. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships script files (Python), which the agent can run.

    Shell commands in SKILL.md call:

    • python

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • triton-lang.org
    • arxiv.org

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Softmax Kernel Optimization loads about 742 tokens when it runs. Until then it costs about 73 tokens; SKILL.md has 320 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~73
When it runs · the whole SKILL.md, loaded when a task matches
~742

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 320 words (~742 tokens).

“Softmax: out[i] = exp(x[i] - max(x)) / sum(exp(x - max(x)))”

— opening of SKILL.md by ZJLi2013
name
softmax-kernel-optimization

Read the full SKILL.md on GitHub

Files

SKILL.md and 2 other files in skills/kernels/softmax of ZJLi2013/awesome-kernel-skills.

  • SKILL.md
  • test_softmax.py
  • triton_template.py

Open the folder on GitHubat commit aba7662

Compare with similar skills

Softmax Kernel Optimization next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Softmax Kernel Optimization compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Softmax Kernel Optimization this skillZJLi2013/awesome-kernel-skills102—~742Automated safety check: PassNone
SQL Optimization Patternsynulihao/AgentSkillOS61710 repos~3.3kAutomated safety check: PassNone
Add Mpk Taskmirage-project/mirage2.5k—~4.5kAutomated safety check: PassApache-2.0
Datamodellmnimbalyst/nimbalyst1.8k—~713Automated safety check: PassMIT
Sqlite Schema Designfastrepl/anarlog9.4k—~1.9kAutomated safety check: PassMIT
DB Migrationskurealnum/dotfiles290—~820Automated safety check: PassNone

Similar skills

  • SQL Optimization Patterns

    ynulihao/AgentSkillOS

    Master SQL query optimization, indexing strategies, and EXPLAIN analysis to dramatically improve database performance and eliminate slow queries.

    617 GitHub starsUsed in 10 repos~3.3k tokens
    DatabasesAuto-check passed
  • Add Mpk Task

    mirage-project/mirage

    Step-by-step guide for adding a new task implementation to Mirage Persistent Kernel (MPK).

    2.5k GitHub stars~4.5k tokensUpdated yesterday
    DatabasesAuto-check passed
  • Datamodellm

    nimbalyst/nimbalyst

    Create visual data models for database schemas using Nimbalyst's DataModelLM editor.

    1.8k GitHub stars~713 tokensUpdated yesterday
    DatabasesAuto-check passed
  • Sqlite Schema Design

    fastrepl/anarlog

    Design or review schemas for crates/cloudsync using SQLite Sync constraints, not generic SQLite advice.

    9.4k GitHub stars~1.9k tokensUpdated today
    DatabasesAuto-check passed
  • DB Migrations

    kurealnum/dotfiles

    A skill your agent uses when generating or regenerating Drizzle migration files, changing database schema tables or columns, resolving migration sequence conflicts after rebase, reviewing migration…

    290 GitHub stars~820 tokensUpdated 5 mo ago
    DatabasesAuto-check passed
  • Grow Panache's CommonMark spec conformance under Flavor::CommonMark by running every spec.txt example through the shared parser, comparing rendered HTML against the spec's expected HTML…

    234 GitHub stars~1.1k tokensUpdated yesterday
    DatabasesAuto-check passed

More from ZJLi2013/awesome-kernel-skills

All 12 skills in this repo
  • Cross Entropy Kernel

    ZJLi2013/awesome-kernel-skills

    Optimize fused cross-entropy loss kernels in Triton for NVIDIA and AMD GPUs.

    102 GitHub stars~461 tokensUpdated 6 mo ago
    Auto-check passed
  • Flash Attention Kernel

    ZJLi2013/awesome-kernel-skills

    Optimize FlashAttention-style fused attention kernels in Triton for NVIDIA and AMD GPUs.

    102 GitHub stars~697 tokensUpdated 6 mo ago
    Auto-check passed
  • Fused Moe Kernel

    ZJLi2013/awesome-kernel-skills

    Optimize Fused Mixture-of-Experts (MoE) kernels in Triton for NVIDIA and AMD GPUs.

    102 GitHub stars~699 tokensUpdated 6 mo ago
    Auto-check passed
  • Gemm Kernel Optimization

    ZJLi2013/awesome-kernel-skills

    Optimize dense matrix multiplication (GEMM) kernels in Triton for NVIDIA and AMD GPUs.

    102 GitHub stars~1.1k tokensUpdated 6 mo ago
    Auto-check passed
  • Iterative Kernel Optimization Loop

    ZJLi2013/awesome-kernel-skills

    Orchestrates continuous kernel optimization by chaining profiling, bottleneck diagnosis, tier-based optimization, verification, and benchmarking into an iterative loop.

    102 GitHub stars~2.5k tokensUpdated 6 mo ago
    Auto-check passed
  • Kernel Benchmark

    ZJLi2013/awesome-kernel-skills

    Unified kernel benchmarking protocol producing JSON results with latency, TFLOPS, GBps, and comparison against PyTorch baselines.

    102 GitHub stars~567 tokensUpdated 6 mo ago
    Auto-check passed

Categories

Questions about Softmax Kernel Optimization

What does Softmax Kernel Optimization do?

Optimize fused softmax kernels in Triton for NVIDIA and AMD GPUs. Softmax Kernel Optimization is an agent skill from ZJLi2013/awesome-kernel-skills. Optimize fused softmax kernels in Triton for NVIDIA and AMD GPUs.

When should I use Softmax Kernel Optimization?

Softmax Kernel Optimization fits situations like: optimizing softmax; similar row-wise normalization kernels.

How do I install Softmax Kernel Optimization in Claude Code?

Run `npx skills add ZJLi2013/awesome-kernel-skills --skill softmax-kernel-optimization -a claude-code`. Or copy the skill folder (skills/kernels/softmax in ZJLi2013/awesome-kernel-skills) into .claude/skills/softmax-kernel-optimization in your project. Claude Code loads it when a task matches its description.

How do I install Softmax Kernel Optimization in Codex?

Run `npx skills add ZJLi2013/awesome-kernel-skills --skill softmax-kernel-optimization -a codex`. Or copy the skill folder (skills/kernels/softmax in ZJLi2013/awesome-kernel-skills) into .agents/skills/softmax-kernel-optimization in your project. Codex loads it when a task matches its description.

Can I use Softmax Kernel Optimization in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add ZJLi2013/awesome-kernel-skills --skill softmax-kernel-optimization -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/softmax-kernel-optimization, .gemini/skills/softmax-kernel-optimization, .github/skills/softmax-kernel-optimization and .opencode/skills/softmax-kernel-optimization in your project.

What does Softmax Kernel Optimization need to run?

Going by SKILL.md and its folder, Softmax Kernel Optimization needs Python for the scripts in its folder and the command-line tools its instructions call (python). Our summary lists: Python 3.

Does Softmax Kernel Optimization access the network?

SKILL.md names 2 domains. As links in the text: triton-lang.org and arxiv.org. This is read from the text; nothing was executed.

Is Softmax Kernel Optimization safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Softmax Kernel Optimization use?

No licence was found for Softmax Kernel Optimization or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Softmax Kernel Optimization use?

About 742 tokens (SKILL.md is roughly 3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Softmax Kernel Optimization?

Skills that share tags, products or a category with Softmax Kernel Optimization: SQL Optimization Patterns (ynulihao/AgentSkillOS, 617 stars), Add Mpk Task (mirage-project/mirage, 2.5k stars), Datamodellm (nimbalyst/nimbalyst, 1.8k stars) and Sqlite Schema Design (fastrepl/anarlog, 9.4k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Softmax Kernel Optimization?

ZJLi2013 (a GitHub user) maintains it in ZJLi2013/awesome-kernel-skills, which has 102 GitHub stars. The repository holds 12 skills in this directory. The repository was last updated on March 31, 2026.

Source: ZJLi2013/awesome-kernel-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.