New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Torch Tensor Parallelism

by lazyFrogLOL in lazyFrogLOL/Harness_Engineering

This skill provides guidance for implementing tensor parallelism in PyTorch, specifically column-parallel and row-parallel linear layers.

No licenceAuto-check passedAI & LLM Engineering

Install Torch Tensor Parallelism

skills CLI
$ npx skills add lazyFrogLOL/Harness_Engineering --skill torch-tensor-parallelism -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install lazyFrogLOL/Harness_Engineering torch-tensor-parallelism --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/lazyFrogLOL/Harness_Engineering.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/torch-tensor-parallelism .claude/skills/torch-tensor-parallelism && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
torch-tensor-parallelism
GitHub stars
128
Token cost
~2.8k tokens
SKILL.md length
743 words
Files
1
Skills in repo
32
Repo updated
First seen
Licence
None found

At a glance

This skill provides guidance for implementing tensor parallelism in PyTorch, specifically column-parallel and row-parallel linear layers.

  • Works in 10 steps: Analyze Test Requirements First → Trace Through with Concrete Examples → Implement with File Verification → …
  • Implementing distributed neural network layers that split weights/activations across multiple ranks
  • SKILL.md covers Overview, When to Use This Skill, Critical Workflow: Verify… and Implementation Patterns, plus 3 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Torch Tensor Parallelism is an agent skill from lazyFrogLOL/Harness_Engineering. This skill provides guidance for implementing tensor parallelism in PyTorch, specifically column-parallel and row-parallel linear layers. Use when implementing distributed neural network layers that split weights/activations across multiple ranks, working with torch.distributed for model parallelism, or implementing ColumnParallelLinear and RowParallelLinear classes.

Its SKILL.md is about 2.8k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in AI & LLM Engineering, covering Deep learning. It works with PyTorch.

When your agent uses it

  • Implementing distributed neural network layers that split weights/activations across multiple ranks
  • Working with torch.distributed for model parallelism
  • Implementing ColumnParallelLinear and RowParallelLinear classes

Example prompts

  • “/torch-tensor-parallelism”

Requirements

  • Python 3

Workflow steps

10 steps, taken from the step headings in SKILL.md.

  1. Analyze Test Requirements First
  2. Trace Through with Concrete Examples
  3. Implement with File Verification
  4. Verify Without Running Tests
  5. Truncated File Writes
  6. Wrong Weight Splitting Dimension
  7. Bias Duplication in Row Parallel
  8. Gradient Flow Blocked by Conditionals
  9. Skipping Manual Verification
  10. Ignoring Edge Cases

What it can do on your machine

Read from SKILL.md and the folder at commit cae3b25. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are python and markdown).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Torch Tensor Parallelism loads about 2.8k tokens when it runs. Until then it costs about 99 tokens; SKILL.md has 743 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~99
When it runs · the whole SKILL.md, loaded when a task matches
~2.8k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 743 words (~2,801 tokens).

“This skill provides structured guidance for implementing tensor-parallel linear layers in PyTorch. Tensor parallelism splits individual layers across multiple devices/processes, enabling training of models too large for a single device. The two primary patterns are column parallelism (splitting output features)…”

— opening of SKILL.md by lazyFrogLOL
name
torch-tensor-parallelism

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skills/torch-tensor-parallelism of lazyFrogLOL/Harness_Engineering.

Open the folder on GitHubat commit cae3b25

Compare with similar skills

Torch Tensor Parallelism next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Torch Tensor Parallelism compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Torch Tensor Parallelism this skilllazyFrogLOL/Harness_Engineering128—~2.8kAutomated safety check: PassNone
Add Uint Supportpytorch/pytorch104k2 repos~2.3kAutomated safety check: PassCustom licence
CLIP Image-Text MatchingOrchestra-Research/AI-Research-SKILLs13k8 repos~1.7kAutomated safety check: PassMIT
Add Torch Shapes Examplefacebook/pyrefly7.1k—~1.3kAutomated safety check: PassMIT
Interview Cheatsheetwanshuiyin/ARIS-in-AI-Offer5801 repos~3.4kAutomated safety check: NotesMIT
Ghstack CIpytorch/pytorch104k—~1.4kAutomated safety check: PassCustom licence

Similar skills

  • Add Uint Support

    pytorch/pytorch

    Add unsigned integer (uint) type support to PyTorch operators by updating ATDISPATCH macros.

    104k GitHub starsUsed in 2 repos~2.3k tokens
    AI & LLM EngineeringAuto-check passed

  • CLIP Image-Text Matching

    Orchestra-Research/AI-Research-SKILLs

    Explains OpenAI's CLIP model for zero-shot image classification, image-text similarity, semantic image search and content moderation, with install steps and code patterns.

    13k GitHub starsUsed in 8 repos~1.7k tokens
    AI & LLM EngineeringAuto-check passed

  • Add Torch Shapes Example

    facebook/pyrefly

    Official

    A skill your agent uses when adding a new PyTorch model to Pyrefly's shape-tracking example corpus under tensor-shapes/pyrefly-torch-stubs/examples — i.e.

    7.1k GitHub stars~1.3k tokensUpdated today
    AI & LLM EngineeringAuto-check passed

  • Interview Cheatsheet

    wanshuiyin/ARIS-in-AI-Offer

    Generate a long-form Chinese interview-prep cheat sheet on a specific ML/LLM topic — formulas with derivations, from-scratch PyTorch code, comparison tables, and 25 高频面试题 (L1 必会 / L2 进阶 / L3 顶级 lab).

    580 GitHub starsUsed in 1 repo~3.4k tokens
    AI & LLM EngineeringAuto-check: notes

  • Ghstack CI

    pytorch/pytorch

    Manage CI for PyTorch ghstack stacks by running CI where its results are useful now and deferring other PRs with [no-ci].

    104k GitHub stars~1.4k tokensUpdated today
    AI & LLM EngineeringAuto-check passed

  • MUSA GPU Training Optimizer

    open-infra-skills/infra-skills

    Profiles, benchmarks and tunes AI training workloads on Moore Threads MUSA GPUs with a measurement-first process that keeps model behavior unchanged.

    141 GitHub stars~1.7k tokensUpdated 3 mo ago
    AI & LLM EngineeringAuto-check passed

More from lazyFrogLOL/Harness_Engineering

All 32 skills in this repo

  • Distribution Search

    lazyFrogLOL/Harness_Engineering

    Guidance for finding probability distributions that satisfy specific statistical constraints such as KL divergence targets, entropy requirements, or moment conditions.

    128 GitHub starsUsed in 1 repo~2.6k tokens
    Auto-check passed

  • Prove Plus Comm

    lazyFrogLOL/Harness_Engineering

    Guide for completing Coq proofs involving arithmetic properties like addition commutativity.

    128 GitHub starsUsed in 1 repo~1.2k tokens
    Auto-check passed

  • Raman Fitting

    lazyFrogLOL/Harness_Engineering

    This skill provides guidance for fitting peaks in Raman spectroscopy data, particularly for materials like graphene.

    128 GitHub starsUsed in 1 repo~1.5k tokens
    Auto-check passed

  • Chess Best Move

    lazyFrogLOL/Harness_Engineering

    Guide for analyzing chess positions from images and determining optimal moves.

    128 GitHub stars~1.6k tokensUpdated 4 mo ago
    Auto-check passed

  • Crack 7z Hash

    lazyFrogLOL/Harness_Engineering

    This skill provides guidance for cracking 7z archive password hashes.

    128 GitHub stars~1.3k tokensUpdated 4 mo ago
    Auto-check passed

  • Feal Linear Cryptanalysis

    lazyFrogLOL/Harness_Engineering

    This skill provides guidance for FEAL cipher linear cryptanalysis tasks.

    128 GitHub stars~1.7k tokensUpdated 4 mo ago
    Auto-check passed

Works with

Categories

Questions about Torch Tensor Parallelism

What does Torch Tensor Parallelism do?

This skill provides guidance for implementing tensor parallelism in PyTorch, specifically column-parallel and row-parallel linear layers. Torch Tensor Parallelism is an agent skill from lazyFrogLOL/Harness_Engineering. This skill provides guidance for implementing tensor parallelism in PyTorch, specifically column-parallel and row-parallel linear layers.

When should I use Torch Tensor Parallelism?

Torch Tensor Parallelism fits situations like: implementing distributed neural network layers that split weights/activations across multiple ranks; working with torch.distributed for model parallelism; implementing ColumnParallelLinear and RowParallelLinear classes.

How do I install Torch Tensor Parallelism in Claude Code?

Run `npx skills add lazyFrogLOL/Harness_Engineering --skill torch-tensor-parallelism -a claude-code`. Or copy the skill folder (skills/torch-tensor-parallelism in lazyFrogLOL/Harness_Engineering) into .claude/skills/torch-tensor-parallelism in your project. Claude Code loads it when a task matches its description.

How do I install Torch Tensor Parallelism in Codex?

Run `npx skills add lazyFrogLOL/Harness_Engineering --skill torch-tensor-parallelism -a codex`. Or copy the skill folder (skills/torch-tensor-parallelism in lazyFrogLOL/Harness_Engineering) into .agents/skills/torch-tensor-parallelism in your project. Codex loads it when a task matches its description.

Can I use Torch Tensor Parallelism in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add lazyFrogLOL/Harness_Engineering --skill torch-tensor-parallelism -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/torch-tensor-parallelism, .gemini/skills/torch-tensor-parallelism, .github/skills/torch-tensor-parallelism and .opencode/skills/torch-tensor-parallelism in your project.

What does Torch Tensor Parallelism need to run?

SKILL.md names no scripts, command-line tools or credentials: Torch Tensor Parallelism is instructions for the agent only. Our summary lists: Python 3.

Does Torch Tensor Parallelism access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Torch Tensor Parallelism safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Torch Tensor Parallelism use?

No licence was found for Torch Tensor Parallelism or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Torch Tensor Parallelism use?

About 2.8k tokens (SKILL.md is roughly 11k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Torch Tensor Parallelism?

Skills that share tags, products or a category with Torch Tensor Parallelism: Add Uint Support (pytorch/pytorch, 104k stars), CLIP Image-Text Matching (Orchestra-Research/AI-Research-SKILLs, 13k stars), Add Torch Shapes Example (facebook/pyrefly, 7.1k stars) and Interview Cheatsheet (wanshuiyin/ARIS-in-AI-Offer, 580 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Torch Tensor Parallelism?

lazyFrogLOL (a GitHub user) maintains it in lazyFrogLOL/Harness_Engineering, which has 128 GitHub stars. The repository holds 32 skills in this directory. The repository was last updated on May 18, 2026.

Source: lazyFrogLOL/Harness_Engineering on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.