A skill your agent uses when designing or auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venue's spread (benchmarks, corpus studies, case studies, user…

MITAuto-check passedResearch & Science

Install Oopsla Experiments

skills CLI
$ npx skills add brycewang-stanford/Awesome-Journal-Skills --skill oopsla-experiments -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install brycewang-stanford/Awesome-Journal-Skills oopsla-experiments --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/brycewang-stanford/Awesome-Journal-Skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/OOPSLA-Skills/skills/oopsla-experiments .claude/skills/oopsla-experiments && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
oopsla-experiments
GitHub stars
1.2k
Token cost
~1k tokens
SKILL.md length
390 words
Files
1
Skills in repo
2,387
Repo updated
First seen
Licence
MIT

At a glance

A skill your agent uses when designing or auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venue's spread (benchmarks, corpus studies, case studies, user…

  • Auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venues spread (benchmarks
  • SKILL.md covers Claim-type → evidence-type…, Baselines and workloads that…, Sizing experiments to the… and Analysis floor, plus 1 more section
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Mechanized proofs)

What it does

Oopsla Experiments is an agent skill from brycewang-stanford/Awesome-Journal-Skills. Use when designing or auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venue's spread (benchmarks, corpus studies, case studies, user studies, mechanized proofs), building baselines and workloads that survive the SIGPLAN checklist, and sizing experiments to the round calendar.

Its SKILL.md is about 1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Research & Science. The repository describes itself as: Journal-specific Claude Code/Codex skill packs covering mainstream journals — AER, QJE, Nature, Cell, 管理世界, 经济研究 & 200+ more — your fast track to getting published. | 覆盖主流期刊的… The licence is MIT.

When your agent uses it

  • Auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venues spread (benchmarks
  • Mechanized proofs)
  • Building baselines and workloads that survive the SIGPLAN checklist
  • Sizing experiments to the round calendar

Example prompts

  • “/oopsla-experiments”

What it can do on your machine

Read from SKILL.md and the folder at commit 932eb23. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Oopsla Experiments loads about 1k tokens when it runs. Until then it costs about 85 tokens; SKILL.md has 390 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~85
When it runs · the whole SKILL.md, loaded when a task matches
~1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from brycewang-stanford/Awesome-Journal-Skills at commit 932eb23, republished under its MIT licence (© brycewang-stanford). 390 words, ~1,044 tokens.

Download SKILL.mdSave it as .claude/skills/oopsla-experiments/SKILL.md (or your agent's skills folder).
name
oopsla-experiments
description
Use when designing or auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venue's spread (benchmarks, corpus studies, case studies, user studies, mechanized proofs), building baselines and workloads that survive the SIGPLAN checklist, and sizing experiments to the round calendar.

OOPSLA Experiments

OOPSLA's evaluation question is not "is there a big table?" but "does the evidence type match the claim type?" The venue's published scope runs from mathematical formalisms to empirical studies, and its exemplars span benchmark suites, measurement methodology, corpus mining, and language experience reports (resources/exemplars/library.md) — so the first design act is choosing the right instrument, and the second is executing it to the SIGPLAN Empirical Evaluation Guidelines standard that reviewers apply checklist-in-hand (oopsla-reproducibility operationalizes the pillars).

Claim-type → evidence-type routing

Claim typePrimary evidenceCommon OOPSLA failure
"Faster / cheaper"Benchmarks vs strongest baseline, variance reportedWeak baseline; startup vs steady-state conflated
"More expressive / safer"Formal result + programs witnessing the boundaryExpressiveness asserted by example only
"Programmers benefit"User study or field data with a designAnecdote from the authors' own use
"Occurs in practice"Corpus study with stated selection ruleConvenience sample of famous repos
"The design generalizes"Second instantiation (language/runtime/domain)Single-host generalization claims
"Semantics is right"Mechanization or proofs + conformance testsCalculus untethered from the implementation

A paper may need two rows; it rarely supports five. Cutting a claim is cheaper than defending its missing evidence through a Major Revision.

Show full SKILL.md (198 more words)Show less

Baselines and workloads that survive scrutiny

  • The baseline is what a skeptical expert would actually use today, tuned the way its own paper tunes it — document versions and flags in the paper.
  • Workload selection needs a rule (suite version, corpus filter, sampling frame) stated before results; exclusions listed with reasons. Curated-only workload sets are the most quietly fatal reviewer finding.
  • For LLM-era tooling claims, hold out for contamination: date-split corpora, and report sensitivity to prompt/configuration where relevant.
  • Negative controls: include a configuration where your mechanism should not help and show that it doesn't. Nothing signals honesty faster.

Sizing experiments to the round calendar

The two-round system changes experimental economics. Between an R1 verdict and the R2 resubmission there are only months, so:

text
Design now, before Round N:
  - matrix of runs a reviewer could plausibly demand (extra baseline,
    larger corpus, second platform) with wall-clock + hardware cost each
  - keep the harness parameterized so a demanded cell is a config change
  - archive raw results per run (the ledger of oopsla-reproducibility)
Payoff: a Minor Revision executes in days; a Major Revision's
expectation list maps to known cells instead of new engineering.

Analysis floor

  • Repetition counts, warmup handling, and dispersion (CI or IQR) for every performance number; significance or effect size where comparisons are the claim.
  • Summaries chosen deliberately (geomean for ratios) and stated.
  • Human-subject work: sample size rationale, task design, and ethics/IRB status — the venue takes the human-aspects lane seriously enough to review it by social-science norms.
  • Case studies report failures encountered, not only successes; an experience report with zero friction reads as marketing (oopsla-writing-style).

Output format

text
[Routing] claim → evidence rows used + mismatches found
[Baseline audit] strongest-sensible test: pass / gaps
[Workload rule] stated / absent; exclusions justified: yes/no
[Demand matrix] anticipated reviewer demands with cost estimates
[Analysis floor] repetitions/dispersion/summary-statistic compliance

© brycewang-stanford, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in OOPSLA-Skills/skills/oopsla-experiments of brycewang-stanford/Awesome-Journal-Skills.

Open the folder on GitHubat commit 932eb23

Compare with similar skills

Oopsla Experiments next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Oopsla Experiments compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Oopsla Experiments this skillbrycewang-stanford/Awesome-Journal-Skills1.2k—~1kAutomated safety check: PassMIT
Hypothesis Generationspacering-net/codeg3.8k15 repos~3.6kAutomated safety check: NotesMIT
GitHub Deep Researchbytedance/deer-flow83k5 repos~1.3kAutomated safety check: PassMIT
Nature Paper CardYuan1z0825/nature-skills46k2 repos~2.1kAutomated safety check: PassApache-2.0
Read arXiv Paperkarpathy/nanochat58k2 repos~494Automated safety check: PassMIT
Content Research Writerweapp-tailwindcss/weapp-tailwindcss1.9k25 repos~3.5kAutomated safety check: PassMIT

Similar skills

  • Hypothesis Generation

    spacering-net/codeg

    Structured hypothesis formulation from observations. An agent skill from spacering-net/codeg.

    3.8k GitHub starsUsed in 15 repos~3.6k tokens
    Research & ScienceAuto-check: notes
  • GitHub Deep Research

    bytedance/deer-flow

    Researches a GitHub repository over four rounds using the GitHub API and web search, then writes a structured markdown report with timeline, metrics and Mermaid diagrams.

    83k GitHub starsUsed in 5 repos~1.3k tokens
    Research & ScienceAuto-check passed
  • Nature Paper Card

    Yuan1z0825/nature-skills

    Builds a structured deep-reading card for one scientific paper, covering methods, how experiments support claims, limitations and research ideas, with a script to prepare the source.

    46k GitHub starsUsed in 2 repos~2.1k tokens
    Research & ScienceAuto-check passed
  • Read arXiv Paper

    karpathy/nanochat

    Fetches the TeX source of an arXiv paper from its URL, reads it and writes a markdown summary tied to the nanochat project.

    58k GitHub starsUsed in 2 repos~494 tokens
    Research & ScienceAuto-check passed
  • Content Research Writer

    weapp-tailwindcss/weapp-tailwindcss

    Assists in writing high-quality content by conducting research, adding citations, improving hooks, iterating on outlines, and providing real-time feedback on each section.

    1.9k GitHub starsUsed in 25 repos~3.5k tokens
    Research & ScienceAuto-check passed
  • Peer Review

    spacering-net/codeg

    Structured manuscript/grant review with checklist-based evaluation.

    3.8k GitHub starsUsed in 18 repos~5.9k tokens
    Research & ScienceAuto-check: notes

More from brycewang-stanford/Awesome-Journal-Skills

All 2,387 skills in this repo
  • Aaag Data Analysis

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when running and reporting the analysis for an Annals of the American Association of Geographers manuscript — spatial statistics and modeling, remote-sensing accuracy, or…

    1.2k GitHub stars~1.3k tokensUpdated 11 days ago
    Auto-check passed
  • Aaag Literature Positioning

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when positioning an Annals of the American Association of Geographers manuscript in the literature — engaging geographic scholarship across the relevant area and the…

    1.2k GitHub stars~1.3k tokensUpdated 11 days ago
    Auto-check passed
  • Aaag Rebuttal

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when responding to an Annals of the American Association of Geographers decision letter (major/minor revision) — building a point-by-point response to the subject editor and…

    1.2k GitHub stars~1.4k tokensUpdated 11 days ago
    Auto-check passed
  • Aaag Research Design

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when defending the research design of an Annals of the American Association of Geographers manuscript — spatial/quantitative analysis and GIScience, remote-sensing and…

    1.2k GitHub stars~1.4k tokensUpdated 11 days ago
    Auto-check passed
  • Aaag Review Process

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when you need to understand how the Annals of the American Association of Geographers evaluates a manuscript — double-anonymous review routed through a subject editor by…

    1.2k GitHub stars~1.3k tokensUpdated 11 days ago
    Auto-check passed
  • Aaag Submission

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when running the final pre-submission preflight for the Annals of the American Association of Geographers via ScholarOne Manuscripts — area/article-type selection…

    1.2k GitHub stars~1.6k tokensUpdated 11 days ago
    Auto-check passed

Questions about Oopsla Experiments

What does Oopsla Experiments do?

A skill your agent uses when designing or auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venue's spread (benchmarks, corpus studies, case studies, user…. Oopsla Experiments is an agent skill from brycewang-stanford/Awesome-Journal-Skills. Use when designing or auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venue's spread (benchmarks, corpus studies, case studies, user studies, mechanized proofs), building baselines and workloads that survive the SIGPLAN checklist, and sizing experiments to the round calendar.

When should I use Oopsla Experiments?

Oopsla Experiments fits situations like: auditing the evaluation of an OOPSLA paper — matching evidence type to claim type across the venues spread (benchmarks; mechanized proofs); building baselines and workloads that survive the SIGPLAN checklist; sizing experiments to the round calendar.

How do I install Oopsla Experiments in Claude Code?

Run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill oopsla-experiments -a claude-code`. Or copy the skill folder (OOPSLA-Skills/skills/oopsla-experiments in brycewang-stanford/Awesome-Journal-Skills) into .claude/skills/oopsla-experiments in your project. Claude Code loads it when a task matches its description.

How do I install Oopsla Experiments in Codex?

Run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill oopsla-experiments -a codex`. Or copy the skill folder (OOPSLA-Skills/skills/oopsla-experiments in brycewang-stanford/Awesome-Journal-Skills) into .agents/skills/oopsla-experiments in your project. Codex loads it when a task matches its description.

Can I use Oopsla Experiments in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill oopsla-experiments -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/oopsla-experiments, .gemini/skills/oopsla-experiments, .github/skills/oopsla-experiments and .opencode/skills/oopsla-experiments in your project.

What does Oopsla Experiments need to run?

SKILL.md names no scripts, command-line tools or credentials: Oopsla Experiments is instructions for the agent only.

Does Oopsla Experiments access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Oopsla Experiments safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Oopsla Experiments use?

Oopsla Experiments is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Oopsla Experiments use?

About 1k tokens (SKILL.md is roughly 4.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Oopsla Experiments?

Skills that share tags, products or a category with Oopsla Experiments: Hypothesis Generation (spacering-net/codeg, 3.8k stars), GitHub Deep Research (bytedance/deer-flow, 83k stars), Nature Paper Card (Yuan1z0825/nature-skills, 46k stars) and Read arXiv Paper (karpathy/nanochat, 58k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Oopsla Experiments?

brycewang-stanford (a GitHub user) maintains it in brycewang-stanford/Awesome-Journal-Skills, which has 1,219 GitHub stars. The repository holds 2,387 skills in this directory. The repository was last updated on September 27, 2026.

Source: brycewang-stanford/Awesome-Journal-Skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.