Agent skill

NLP Alignment

by aiming-lab in aiming-lab/AutoResearchClaw

Best practices for LLM alignment techniques including RLHF, DPO, and instruction tuning.

MITAuto-check passedAI & LLM Engineering

Install NLP Alignment

skills CLI
$ npx skills add aiming-lab/AutoResearchClaw --skill nlp-alignment -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install aiming-lab/AutoResearchClaw nlp-alignment --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/aiming-lab/AutoResearchClaw.git skills-src && mkdir -p .claude/skills && cp -r skills-src/researchclaw/skills/builtin/domain/nlp-alignment .claude/skills/nlp-alignment && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
nlp-alignment
GitHub stars
15k
Token cost
~300 tokens
SKILL.md length
86 words
Files
1
Skills in repo
34
Repo updated
First seen
Licence
MIT

At a glance

Best practices for LLM alignment techniques including RLHF, DPO, and instruction tuning.

  • Working on alignment
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Tasks that involve Fine-tuning
  • Tasks that involve Natural language processing

What it does

NLP Alignment is an agent skill from aiming-lab/AutoResearchClaw. Best practices for LLM alignment techniques including RLHF, DPO, and instruction tuning. Use when working on alignment or safety.

Its SKILL.md is about 300 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in AI & LLM Engineering, covering Fine-tuning and Natural language processing. The repository describes itself as: Fully autonomous & self-evolving research from idea to paper. Chat an Idea. Get a Paper. 🦞. The licence is MIT.

When your agent uses it

  • Working on alignment
  • Tasks that involve Fine-tuning
  • Tasks that involve Natural language processing

Example prompts

  • “/nlp-alignment”

What it can do on your machine

Read from SKILL.md and the folder at commit be4ba47. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

NLP Alignment loads about 300 tokens when it runs. Until then it costs about 36 tokens; SKILL.md has 86 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~36
When it runs · the whole SKILL.md, loaded when a task matches
~300

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from aiming-lab/AutoResearchClaw at commit be4ba47, republished under its MIT licence (© aiming-lab). 86 words, ~300 tokens.

Download SKILL.mdSave it as .claude/skills/nlp-alignment/SKILL.md (or your agent's skills folder).
name
nlp-alignment
description
Best practices for LLM alignment techniques including RLHF, DPO, and instruction tuning. Use when working on alignment or safety.
metadata.category
domain
metadata.trigger-keywords
alignment,rlhf,dpo,reward model,preference,instruction tuning,safety
metadata.applicable-stages
9,10
metadata.priority
4
metadata.version
1.0
metadata.author
researchclaw
metadata.references
Ouyang et al., Training language models to follow instructions, NeurIPS 2022; Rafailov et al., DPO, NeurIPS 2023

LLM Alignment Best Practice

Methods:

  • RLHF: Train reward model → PPO fine-tuning (complex but powerful)
  • DPO: Direct preference optimization (simpler, no reward model needed)
  • GRPO: Group relative policy optimization
  • SFT: Supervised fine-tuning as alignment baseline

Training recipe:

  • Start with SFT on high-quality instruction data
  • DPO: lr=5e-7, beta=0.1, batch_size=64
  • PPO: lr=1e-6, clip=0.2, KL coeff=0.02
  • Use reference model for KL penalty
  • Evaluate on safety benchmarks (TruthfulQA, BBQ, etc.)

Common pitfalls:

  • Reward hacking: model finds shortcuts to high reward
  • Mode collapse: model generates repetitive outputs
  • Catastrophic forgetting: loses general capabilities

© aiming-lab, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in researchclaw/skills/builtin/domain/nlp-alignment of aiming-lab/AutoResearchClaw.

Open the folder on GitHubat commit be4ba47

Compare with similar skills

NLP Alignment next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

NLP Alignment compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
NLP Alignment this skillaiming-lab/AutoResearchClaw15k—~300Automated safety check: PassMIT
Hugging Face Transformers Usagedavila7/claude-code-templates32k12 repos~1.2kAutomated safety check: PassMIT
Running Zeroshot Nermaziyarpanahi/openmed5.5k—~1.7kAutomated safety check: PassApache-2.0
Transformersynulihao/AgentSkillOS617—~2.9kAutomated safety check: PassNone
AI ML Skillswentorai/research-plugins2981 repos~993Automated safety check: PassMIT
Text Analytics Methodsrevfactory/harness-1001.3k—~877Automated safety check: PassApache-2.0

Similar skills

  • Hugging Face Transformers Usage

    davila7/claude-code-templates

    Loads pre-trained Hugging Face Transformers models for text, vision and audio tasks, runs inference with pipelines and fine-tunes on custom datasets.

    32k GitHub starsUsed in 12 repos~1.2k tokens
    AI & LLM EngineeringAuto-check passed
  • Running Zeroshot Ner

    maziyarpanahi/openmed

    Extract arbitrary, custom entity types from clinical or biomedical text with no fine-tuning using OpenMed's GLiNER / GLiNER2 zero-shot support.

    5.5k GitHub stars~1.7k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed
  • Transformers

    ynulihao/AgentSkillOS

    Work with state-of-the-art machine learning models for NLP, computer vision, audio, and multimodal tasks using HuggingFace Transformers.

    617 GitHub stars~2.9k tokensUpdated 7 mo ago
    AI & LLM EngineeringAuto-check passed
  • AI ML Skills

    wentorai/research-plugins

    27 ai & machine learning skills. An agent skill from wentorai/research-plugins.

    298 GitHub starsUsed in 1 repo~993 tokens
    AI & LLM EngineeringAuto-check passed
  • Text Analytics Methods

    revfactory/harness-100

    Text analytics methodology. An agent skill from revfactory/harness-100.

    1.3k GitHub stars~877 tokensUpdated 6 mo ago
    AI & LLM EngineeringAuto-check passed
  • Text Processor

    revfactory/harness-100

    Text processing pipeline: an agent team collaborates to perform preprocessing, classification, entity/keyword extraction, sentiment analysis, summarization, structured data conversion, and report…

    1.3k GitHub stars~1.9k tokensUpdated 6 mo ago
    AI & LLM EngineeringAuto-check passed

More from aiming-lab/AutoResearchClaw

All 34 skills in this repo
  • A-Evolve Agent Improvement

    aiming-lab/AutoResearchClaw

    Diagnoses where an agent failed across runs and turns the findings into new skills, system prompt patches and knowledge entries, using the A-Evolve loop.

    15k GitHub stars~1.8k tokensUpdated 1 mo ago
    Auto-check passed
  • Metabolic Study Planner

    aiming-lab/AutoResearchClaw

    Turns a broad metabolic modelling topic into a concrete, paper-shaped plan with organism, model, perturbations, metrics and figures before any FBA code is written.

    15k GitHub stars~1.9k tokensUpdated 1 mo ago
    Auto-check passed
  • MFA Pipeline Orchestrator

    aiming-lab/AutoResearchClaw

    Runs a metabolic flux analysis from model loading to phenotype prediction and figures by handing work to four sub-agents in sequence.

    15k GitHub stars~923 tokensUpdated 1 mo ago
    Auto-check passed
  • Qiskit 2.x Quantum ML Reference

    aiming-lab/AutoResearchClaw

    Reference patterns for writing qiskit 2.x code for variational quantum machine learning: feature maps, VQC training, VQE for chemistry, MPS circuits and noise models.

    15k GitHub stars~4.7k tokensUpdated 1 mo ago
    Auto-check passed
  • Genome-Scale Metabolic Model Builder

    aiming-lab/AutoResearchClaw

    Builds or loads a genome-scale metabolic model in COBRApy, sets its growth medium and objective, and exports it as a validated JSON file for flux analysis.

    15k GitHub stars~1.4k tokensUpdated 1 mo ago
    Auto-check passed
  • Biopython Bioinformatics

    aiming-lab/AutoResearchClaw

    Quick reference for Biopython work: sequence operations, SeqIO file parsing, BLAST searches, Entrez queries, phylogenetic trees and PDB structure analysis.

    15k GitHub stars~810 tokensUpdated 1 mo ago
    Auto-check passed

Questions about NLP Alignment

What does NLP Alignment do?

Best practices for LLM alignment techniques including RLHF, DPO, and instruction tuning. NLP Alignment is an agent skill from aiming-lab/AutoResearchClaw. Best practices for LLM alignment techniques including RLHF, DPO, and instruction tuning.

When should I use NLP Alignment?

NLP Alignment fits situations like: working on alignment; tasks that involve Fine-tuning; tasks that involve Natural language processing.

How do I install NLP Alignment in Claude Code?

Run `npx skills add aiming-lab/AutoResearchClaw --skill nlp-alignment -a claude-code`. Or copy the skill folder (researchclaw/skills/builtin/domain/nlp-alignment in aiming-lab/AutoResearchClaw) into .claude/skills/nlp-alignment in your project. Claude Code loads it when a task matches its description.

How do I install NLP Alignment in Codex?

Run `npx skills add aiming-lab/AutoResearchClaw --skill nlp-alignment -a codex`. Or copy the skill folder (researchclaw/skills/builtin/domain/nlp-alignment in aiming-lab/AutoResearchClaw) into .agents/skills/nlp-alignment in your project. Codex loads it when a task matches its description.

Can I use NLP Alignment in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add aiming-lab/AutoResearchClaw --skill nlp-alignment -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/nlp-alignment, .gemini/skills/nlp-alignment, .github/skills/nlp-alignment and .opencode/skills/nlp-alignment in your project.

What does NLP Alignment need to run?

SKILL.md names no scripts, command-line tools or credentials: NLP Alignment is instructions for the agent only.

Does NLP Alignment access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is NLP Alignment safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does NLP Alignment use?

NLP Alignment is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does NLP Alignment use?

About 300 tokens (SKILL.md is roughly 1.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to NLP Alignment?

Skills that share tags, products or a category with NLP Alignment: Hugging Face Transformers Usage (davila7/claude-code-templates, 32k stars), Running Zeroshot Ner (maziyarpanahi/openmed, 5.5k stars), Transformers (ynulihao/AgentSkillOS, 617 stars) and AI ML Skills (wentorai/research-plugins, 298 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains NLP Alignment?

aiming-lab (a GitHub organization) maintains it in aiming-lab/AutoResearchClaw, which has 14,587 GitHub stars. The repository holds 34 skills in this directory. The repository was last updated on August 19, 2026.

Source: aiming-lab/AutoResearchClaw on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.