Hypothesis Generation
spacering-net/codeg
Structured hypothesis formulation from observations. An agent skill from spacering-net/codeg.
Survey and paper collection on LLMs for code generation. An agent skill from wentorai/research-plugins.
Install Code LLM Papers Guide
$ npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install wentorai/research-plugins code-llm-papers-guide --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/domains/cs/code-llm-papers-guide .claude/skills/code-llm-papers-guide && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "code-llm-papers-guide" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/domains/cs/code-llm-papers-guide into .claude/skills/code-llm-papers-guide/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "code-llm-papers-guide", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/wentorai/research-plugins/tree/main/skills/domains/cs/code-llm-papers-guideType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install wentorai/research-plugins code-llm-papers-guide --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/domains/cs/code-llm-papers-guide .agents/skills/code-llm-papers-guide && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "code-llm-papers-guide" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/domains/cs/code-llm-papers-guide into .agents/skills/code-llm-papers-guide/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "code-llm-papers-guide", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install wentorai/research-plugins code-llm-papers-guide --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/domains/cs/code-llm-papers-guide .cursor/skills/code-llm-papers-guide && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "code-llm-papers-guide" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/domains/cs/code-llm-papers-guide into .cursor/skills/code-llm-papers-guide/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "code-llm-papers-guide", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/wentorai/research-plugins.git --path skills/domains/cs/code-llm-papers-guide--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install wentorai/research-plugins code-llm-papers-guide --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/domains/cs/code-llm-papers-guide .gemini/skills/code-llm-papers-guide && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "code-llm-papers-guide" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/domains/cs/code-llm-papers-guide into .gemini/skills/code-llm-papers-guide/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "code-llm-papers-guide", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install wentorai/research-plugins code-llm-papers-guideInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/domains/cs/code-llm-papers-guide .github/skills/code-llm-papers-guide && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "code-llm-papers-guide" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/domains/cs/code-llm-papers-guide into .github/skills/code-llm-papers-guide/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "code-llm-papers-guide", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install wentorai/research-plugins code-llm-papers-guide --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/domains/cs/code-llm-papers-guide .opencode/skills/code-llm-papers-guide && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "code-llm-papers-guide" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/domains/cs/code-llm-papers-guide into .opencode/skills/code-llm-papers-guide/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "code-llm-papers-guide", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
code-llm-papers-guide- GitHub stars
- 298
- Used in
- 1 other repo
- Token cost
- ~1.1k tokens
- SKILL.md length
- 165 words
- Files
- 1
- Skills in repo
- 428
- Repo updated
- First seen
- Licence
- MIT
At a glance
Survey and paper collection on LLMs for code generation. An agent skill from wentorai/research-plugins.
- Works in 5 steps: Literature survey: Map the Code LLM… → Model selection: Compare code models for… → Benchmark analysis: Track… → …
- Research & Science work in your project
- SKILL.md covers Overview, Taxonomy, Key Models Timeline and Benchmark Tracking, plus 4 more sections
- Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
What it does
Code LLM Papers Guide is an agent skill from wentorai/research-plugins. Survey and paper collection on LLMs for code generation
Its SKILL.md is about 1.1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Research & Science. The repository describes itself as: 350+ academic research skills, MCP configs, and plugins for Research-Claw and AI agents. The licence is MIT.
When your agent uses it
- Research & Science work in your project
Example prompts
- “/code-llm-papers-guide”
Requirements
- Python 3
Workflow steps
5 steps, taken from the first numbered list in SKILL.md.
- Literature survey: Map the Code LLM research landscape
- Model selection: Compare code models for specific tasks
- Benchmark analysis: Track state-of-the-art on standard benchmarks
- Research planning: Identify open problems and trends
- Course material: Teach software engineering + AI intersection
What it can do on your machine
Read from SKILL.md and the folder at commit bf44b3c. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
No scripts in the folder and no shell commands in SKILL.md (its code samples are python and markdown).
From the folder's file list and the shell code blocks in SKILL.md.
Network
Links to these hosts (documentation or services it may open):
github.comarxiv.orgswebench.com
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Code LLM Papers Guide loads about 1.1k tokens when it runs. Until then it costs about 19 tokens; SKILL.md has 165 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
The full file from wentorai/research-plugins at commit bf44b3c, republished under its MIT licence (© wentorai). 165 words, ~1,132 tokens.
Download SKILL.mdSave it as
.claude/skills/code-llm-papers-guide/SKILL.md (or your agent's skills folder).- name
- code-llm-papers-guide
- description
- Survey and paper collection on LLMs for code generation
Code LLM Papers Guide
Overview
This curated collection covers LLMs for code — from foundational models (Codex, CodeGen, StarCoder) through code generation, completion, repair, translation, and understanding. Accompanies a TMLR survey paper providing systematic categorization. Tracks 500+ papers across pre-training, fine-tuning, evaluation, and application of code-focused language models.
Taxonomy
Code LLMs
├── Pre-training
│ ├── Encoder-only (CodeBERT, GraphCodeBERT)
│ ├── Decoder-only (Codex, CodeGen, StarCoder, DeepSeek-Coder)
│ └── Encoder-Decoder (CodeT5, PLBART)
├── Fine-tuning & Alignment
│ ├── Instruction tuning (WizardCoder, Magicoder)
│ ├── RLHF for code (CodeRL)
│ └── Self-play (AlphaCode)
├── Applications
│ ├── Code generation (NL → Code)
│ ├── Code completion (infilling)
│ ├── Code repair (bug fixing)
│ ├── Code translation (language conversion)
│ ├── Code summarization (Code → NL)
│ ├── Test generation
│ └── Code review
└── Evaluation
├── Benchmarks (HumanEval, MBPP, SWE-bench)
├── Metrics (pass@k, CodeBLEU)
└── Security analysisKey Models Timeline
| Model | Year | Organization | Parameters | Key Innovation |
|---|---|---|---|---|
| CodeBERT | 2020 | Microsoft | 125M | Bimodal NL-PL pre-training |
| Codex | 2021 | OpenAI | 12B | GPT-3 fine-tuned on GitHub |
| AlphaCode | 2022 | DeepMind | 41B | Competitive programming |
| StarCoder | 2023 | BigCode | 15B | Fill-in-the-middle, 1T tokens |
| CodeLlama | 2023 | Meta | 34B | Llama 2 + code specialization |
| DeepSeek-Coder | 2024 | DeepSeek | 33B | 2T token project-level training |
| Qwen2.5-Coder | 2024 | Alibaba | 32B | 5.5T tokens, multi-language |
Benchmark Tracking
# Track model performance on HumanEval
humaneval_scores = {
"GPT-4": {"pass_at_1": 67.0, "pass_at_10": 86.0},
"Claude 3.5 Sonnet": {"pass_at_1": 64.0},
"DeepSeek-Coder-33B": {"pass_at_1": 56.1},
"CodeLlama-34B": {"pass_at_1": 48.8},
"StarCoder2-15B": {"pass_at_1": 46.3},
"GPT-3.5-Turbo": {"pass_at_1": 48.1},
}
print(f"{'Model':<25} {'pass@1':>8} {'pass@10':>8}")
print("-" * 43)
for model, scores in sorted(
humaneval_scores.items(),
key=lambda x: x[1].get("pass_at_1", 0),
reverse=True,
):
p1 = scores.get("pass_at_1", "—")
p10 = scores.get("pass_at_10", "—")
print(f"{model:<25} {str(p1):>8} {str(p10):>8}")Research Directions
### Active Areas (2024-2025)
1. **Repository-level generation** — Understanding full codebases
2. **Agentic coding** — LLMs using tools (debugger, terminal)
3. **Formal verification** — Proving correctness of generated code
4. **Multi-language** — Cross-language transfer and translation
5. **Security** — Detecting and avoiding vulnerable code
6. **Long context** — Processing large codebases (100k+ tokens)
7. **Code editing** — Natural language instructions for code changesPaper Search
import arxiv
def find_code_llm_papers(topic="code generation", max_results=20):
"""Find recent Code LLM papers on arXiv."""
query = f"abs:{topic} AND (abs:large language model OR abs:LLM)"
search = arxiv.Search(
query=query,
max_results=max_results,
sort_by=arxiv.SortCriterion.SubmittedDate,
)
for result in search.results():
print(f"[{result.published.strftime('%Y-%m-%d')}] "
f"{result.title}")
find_code_llm_papers("code generation")
find_code_llm_papers("automated program repair")Use Cases
- Literature survey: Map the Code LLM research landscape
- Model selection: Compare code models for specific tasks
- Benchmark analysis: Track state-of-the-art on standard benchmarks
- Research planning: Identify open problems and trends
- Course material: Teach software engineering + AI intersection
References
© wentorai, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
Just SKILL.md in skills/domains/cs/code-llm-papers-guide of wentorai/research-plugins.
Open the folder on GitHubat commit bf44b3c
Used in 1 other repository
We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in wentorai/research-plugins, which our catalogue first saw on October 7, 2026.
Compare with similar skills
Code LLM Papers Guide next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Code LLM Papers Guide this skillwentorai/research-plugins | 298 | 1 repos | ~1.1k | Automated safety check: Pass | MIT | |
| Hypothesis Generationspacering-net/codeg | 3.8k | 15 repos | ~3.6k | Automated safety check: Notes | MIT | |
| GitHub Deep Researchbytedance/deer-flow | 83k | 5 repos | ~1.3k | Automated safety check: Pass | MIT | |
| Nature Paper CardYuan1z0825/nature-skills | 46k | 2 repos | ~2.1k | Automated safety check: Pass | Apache-2.0 | |
| Read arXiv Paperkarpathy/nanochat | 58k | 2 repos | ~494 | Automated safety check: Pass | MIT | |
| Content Research Writerweapp-tailwindcss/weapp-tailwindcss | 1.9k | 25 repos | ~3.5k | Automated safety check: Pass | MIT |
Similar skills
GitHub Deep Research
bytedance/deer-flow
Researches a GitHub repository over four rounds using the GitHub API and web search, then writes a structured markdown report with timeline, metrics and Mermaid diagrams.
Nature Paper Card
Yuan1z0825/nature-skills
Builds a structured deep-reading card for one scientific paper, covering methods, how experiments support claims, limitations and research ideas, with a script to prepare the source.
Read arXiv Paper
karpathy/nanochat
Fetches the TeX source of an arXiv paper from its URL, reads it and writes a markdown summary tied to the nanochat project.
Content Research Writer
weapp-tailwindcss/weapp-tailwindcss
Assists in writing high-quality content by conducting research, adding citations, improving hooks, iterating on outlines, and providing real-time feedback on each section.
Peer Review
spacering-net/codeg
Structured manuscript/grant review with checklist-based evaluation.
More from wentorai/research-plugins
All 428 skills in this repoAbstract Writing Guide
wentorai/research-plugins
Craft structured research abstracts that maximize clarity and journal acceptance
Academic Citation Manager
wentorai/research-plugins
Manage academic citations across BibTeX, APA, MLA, and Chicago formats
Academic Paper Summarizer
wentorai/research-plugins
Summarize academic papers with structured extraction of key elements
Academic Study Methods
wentorai/research-plugins
Evidence-based study techniques for academic learning and retention
Academic Tone Guide
wentorai/research-plugins
Adjust writing tone and register for academic audiences and venues
Academic Translation Guide
wentorai/research-plugins
Academic translation, post-editing, and Chinglish correction guide
Related
Categories
Questions about Code LLM Papers Guide
What does Code LLM Papers Guide do?
Survey and paper collection on LLMs for code generation. An agent skill from wentorai/research-plugins. Code LLM Papers Guide is an agent skill from wentorai/research-plugins.
When should I use Code LLM Papers Guide?
Code LLM Papers Guide fits situations like: research & Science work in your project.
How do I install Code LLM Papers Guide in Claude Code?
Run `npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a claude-code`. Or copy the skill folder (skills/domains/cs/code-llm-papers-guide in wentorai/research-plugins) into .claude/skills/code-llm-papers-guide in your project. Claude Code loads it when a task matches its description.
How do I install Code LLM Papers Guide in Codex?
Run `npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a codex`. Or copy the skill folder (skills/domains/cs/code-llm-papers-guide in wentorai/research-plugins) into .agents/skills/code-llm-papers-guide in your project. Codex loads it when a task matches its description.
Can I use Code LLM Papers Guide in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add wentorai/research-plugins --skill code-llm-papers-guide -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/code-llm-papers-guide, .gemini/skills/code-llm-papers-guide, .github/skills/code-llm-papers-guide and .opencode/skills/code-llm-papers-guide in your project.
What does Code LLM Papers Guide need to run?
SKILL.md names no scripts, command-line tools or credentials: Code LLM Papers Guide is instructions for the agent only. Our summary lists: Python 3.
Does Code LLM Papers Guide access the network?
SKILL.md names 3 domains. As links in the text: github.com, arxiv.org and swebench.com. This is read from the text; nothing was executed.
Is Code LLM Papers Guide safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Code LLM Papers Guide use?
Code LLM Papers Guide is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Code LLM Papers Guide use?
About 1.1k tokens (SKILL.md is roughly 4.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Code LLM Papers Guide?
Skills that share tags, products or a category with Code LLM Papers Guide: Hypothesis Generation (spacering-net/codeg, 3.8k stars), GitHub Deep Research (bytedance/deer-flow, 83k stars), Nature Paper Card (Yuan1z0825/nature-skills, 46k stars) and Read arXiv Paper (karpathy/nanochat, 58k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Code LLM Papers Guide?
wentorai (a GitHub user) maintains it in wentorai/research-plugins, which has 298 GitHub stars. The repository holds 428 skills in this directory. The repository was last updated on June 19, 2026.
Source: wentorai/research-plugins on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.