A skill your agent uses when designing studies and measurement for a Journal of Applied Psychology (JAP) manuscript so they meet the journal's high bar on construct validity, causal inference…

MITAuto-check passedResearch & Science

Install Joap Study Design

skills CLI
$ npx skills add brycewang-stanford/Awesome-Journal-Skills --skill joap-study-design -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install brycewang-stanford/Awesome-Journal-Skills joap-study-design --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/brycewang-stanford/Awesome-Journal-Skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/Journal-of-Applied-Psychology-Skills/skills/joap-study-design .claude/skills/joap-study-design && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
joap-study-design
GitHub stars
1.2k
Token cost
~1.9k tokens
SKILL.md length
655 words
Files
1
Skills in repo
2,387
Repo updated
First seen
Licence
MIT

At a glance

A skill your agent uses when designing studies and measurement for a Journal of Applied Psychology (JAP) manuscript so they meet the journal's high bar on construct validity, causal inference…

  • Works in 5 steps: Construct validity first. Use validated… → Earn the causal claim. Cross-sectional… → Design against CMV. Build in procedural… → …
  • Causal inference
  • SKILL.md covers When to trigger, Design standards, Common-method variance — the… and Sample-size justification —…, plus 6 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Joap Study Design is an agent skill from brycewang-stanford/Awesome-Journal-Skills. Use when designing studies and measurement for a Journal of Applied Psychology (JAP) manuscript so they meet the journal's high bar on construct validity, causal inference, common-method variance, nested/multilevel data, and sample-size justification. Strengthens the design and measurement plan; it does not write code.

Its SKILL.md is about 1.9k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Research & Science, covering Experimental design and Econometrics and empirical research. The repository describes itself as: Journal-specific Claude Code/Codex skill packs covering mainstream journals — AER, QJE, Nature, Cell, 管理世界, 经济研究 & 200+ more — your fast track to getting published. | 覆盖主流期刊的… The licence is MIT.

When your agent uses it

  • Causal inference
  • Common-method variance
  • Nested/multilevel data
  • Sample-size justification

Example prompts

  • “/joap-study-design”

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. Construct validity first. Use validated measures; report reliability and, where the construct is
  2. Earn the causal claim. Cross-sectional single-source correlation rarely suffices. Strengthen
  3. Design against CMV. Build in procedural remedies (temporal/source/measurement separation,
  4. Model the nesting. If employees are nested in teams/units/firms, justify N at each level, report
  5. Justify sample size at the right level. Power for the effect that carries the claim (e.g., the

What it can do on your machine

Read from SKILL.md and the folder at commit 932eb23. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Joap Study Design loads about 1.9k tokens when it runs. Until then it costs about 85 tokens; SKILL.md has 655 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~85
When it runs · the whole SKILL.md, loaded when a task matches
~1.9k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from brycewang-stanford/Awesome-Journal-Skills at commit 932eb23, republished under its MIT licence (© brycewang-stanford). 655 words, ~1,856 tokens.

Download SKILL.mdSave it as .claude/skills/joap-study-design/SKILL.md (or your agent's skills folder).
name
joap-study-design
description
Use when designing studies and measurement for a Journal of Applied Psychology (JAP) manuscript so they meet the journal's high bar on construct validity, causal inference, common-method variance, nested/multilevel data, and sample-size justification. Strengthens the design and measurement plan; it does not write code.

Study Design & Measurement (joap-study-design)

JAP holds measurement and design to an exacting standard. The recurring killers are common-method variance (CMV), weak causal warrants (cross-sectional single-source data), unmodeled nesting, and construct validity gaps. This skill hardens the design before data collection, where most of these problems can actually be solved.

When to trigger

  • Planning a study, a multi-study package, or a measurement strategy
  • Writing a preregistration / pre-analysis plan
  • A reviewer questioned CMV, causal inference, measurement, nesting, or power
  • Justifying sample size at the relevant level of analysis

Design standards

  1. Construct validity first. Use validated measures; report reliability and, where the construct is new or contested, provide validity evidence (CFA, convergent/discriminant, measurement invariance across groups/time). A weak measure dooms an otherwise good design.
  2. Earn the causal claim. Cross-sectional single-source correlation rarely suffices. Strengthen with temporal separation (multi-wave), multiple sources (self + supervisor + objective), experimental or quasi-experimental legs, or a field experiment.
  3. Design against CMV. Build in procedural remedies (temporal/source/measurement separation, protected anonymity) and plan statistical checks; declare the strategy up front. Post hoc Harman's single-factor test alone is treated as insufficient at JAP.
  4. Model the nesting. If employees are nested in teams/units/firms, justify N at each level, report ICC(1)/ICC(2) and r_wg for aggregated constructs, and use multilevel models — do not ignore dependence or aggregate away the structure without justification.
  5. Justify sample size at the right level. Power for the effect that carries the claim (e.g., the cross-level interaction or indirect effect), not just the total N; for multilevel designs, the L2 sample size usually constrains power.

Common-method variance — the JAP design playbook

RemedyTypeNote
Temporal separation (multi-wave)proceduralpredictor and outcome at different waves
Source separation (self + other/objective)proceduralthe strongest single defense
Measurement/context separationproceduraldifferent scales/formats for predictor vs outcome
Protected anonymity, balanced itemsproceduralreduces consistency and acquiescence bias
Marker variable / CFA marker techniquestatisticalplan a theoretically unrelated marker in advance
ULMC (unmeasured latent method construct)statisticalreport alongside, not instead of, procedural remedies

Sample-size justification — worked example (illustrative)

For the servant-leadership package, justify N at the level the hypotheses live, before collecting.

Multilevel field study (2-2-2 / 2-1-2 mediation):
  Constraint: 74 teams (L2) drives power for the team-level indirect effect.
  Power target: 80% for the indirect effect (Monte Carlo power for multilevel
                mediation), assuming a path ≈ .25, b path ≈ .30, ICC(1) ≈ .15.
  Result: target ≥ 70 teams, ~8 members each → ~560–620; we collect 612 in 74.
Lab experiment (causal leg):
  Between-subjects, two conditions; power for the interaction (H3 boundary),
  N ≈ 240 at 80%, alpha .05; fixed-N, no optional stopping.
Aggregation: report ICC(1), ICC(2), r_wg(j) to justify team-level aggregation
            of psychological safety; preregister exclusion rules.

Pre-data lockdown checklist

Degree of freedomLock before data?Where it lives
Hypotheses + direction + levelyespreregistration
Measures (all scales, all items)yespreregistration (prevents scale cherry-picking)
CMV remedies (procedural + planned statistical)yesdesign + preregistration
Aggregation rules (ICC/r_wg thresholds)yesanalysis plan
Exclusion rules (careless responding, attrition)yespreregistration
Covariates / model formyesanalysis plan
Exploratory analysesallowed, labeledreported separately, post hoc
Show full SKILL.md (242 more words)Show less

Design-stage reviewer pushback and the venue fix

  • "Cross-sectional, same-source — common method bias" → add temporal/source separation or an experimental leg; declare procedural remedies, not just a Harman's test.
  • "You ignored nesting" → model multilevel structure; report ICC(1)/ICC(2)/r_wg; justify aggregation.
  • "Measure validity unclear" → report reliability, CFA fit, and invariance; cite scale provenance.
  • "Underpowered for the cross-level effect" → repower at the constraining level; report the Monte Carlo power analysis (handoff to joap-data-analysis).

Execution bridge (StatsPAI / Stata MCP)

Estimate and audit the design, don't only describe it. Full map: execution-with-mcp. JAP is organizational psychology — multilevel survey/field data and experiments; cluster at the right level and apply mediation/moderation discipline.

  • detect_design → recommend → fit with as_handle=true → audit_result.
  • Observational causal claims: staggered DiD (callaway_santanna / sun_abraham + bacon_decomposition + honest_did_from_result); IV (effective_f_test + anderson_rubin_ci); RDD (rdrobust + mccrary_test).
  • Experiments: randomization-based inference, romano_wolf for many-outcome family-wise control, and mediate for mediation (not naive controlling-away).
  • Sensitivity: oster_delta / sensemakr for observational claims.

Report the effect size in interpretable units; route the full battery to the appendix/supplement. A run end-to-end (synthetic data, real returns) is in the JF execution walkthrough.

Anti-patterns

  • Cross-sectional single-source self-report as the sole evidentiary base
  • CMV addressed only by a post hoc Harman's single-factor test
  • Nested data analyzed as if independent, or aggregated without ICC/r_wg justification
  • New or modified measures with no validity evidence
  • Sample size justified by total N while the carrying effect lives at L2

Output format

【Construct validity】reliability + CFA/invariance evidence? [Y/N]
【Causal warrant】temporal / multi-source / experimental leg present? [Y/N]
【CMV】procedural remedies + planned statistical check declared? [Y/N]
【Nesting】levels, ICC/r_wg, multilevel model justified? [Y/N/NA]
【Sample size】powered for the carrying effect at the right level? [Y/N]
【Next】joap-data-analysis

Supplementary resources

© brycewang-stanford, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in Journal-of-Applied-Psychology-Skills/skills/joap-study-design of brycewang-stanford/Awesome-Journal-Skills.

Open the folder on GitHubat commit 932eb23

Compare with similar skills

Joap Study Design next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Joap Study Design compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Joap Study Design this skillbrycewang-stanford/Awesome-Journal-Skills1.2k—~1.9kAutomated safety check: PassMIT
Causalai-analyst-lab/ai-analyst304—~1.8kAutomated safety check: PassMIT
Fin Experiment Designcsmar432/finai-research109—~4.2kAutomated safety check: PassMIT
Judea PearlK-Dense-AI/mimeo282—~1.7kAutomated safety check: PassMIT
Academic Paper Verifybrycewang-stanford/Auto-Empirical-Research-Skills4.5k—~2.9kAutomated safety check: PassCustom licence
Designing Experimentsforyourhealth111-pixel/Vibe-Skills3.6k—~600Automated safety check: PassApache-2.0

Similar skills

  • Causal

    ai-analyst-lab/ai-analyst

    Causal inference toolkit for when experiments are not possible: estimate treatment effects from observational data with assumption checks and mandatory caveats.

    304 GitHub stars~1.8k tokensUpdated 9 days ago
    Research & ScienceAuto-check passed
  • Fin Experiment Design

    csmar432/finai-research

    经济金融实证方法设计。根据研究想法和REFINEDDESIGN.md,生成完整的实证研究设计方案,覆盖识别策略选择、样本构建、变量定义、稳健性检验清单和内生性处理方案。

    109 GitHub stars~4.2k tokensUpdated 3 days ago
    Research & ScienceAuto-check passed
  • Judea Pearl

    K-Dense-AI/mimeo

    Applies Judea Pearl's causal reasoning frameworks to distinguish correlation from causation, evaluate AI capabilities, and make counterfactual decisions.

    282 GitHub stars~1.7k tokensUpdated 1 mo ago
    Research & ScienceAuto-check passed
  • Academic Paper Verify

    brycewang-stanford/Auto-Empirical-Research-Skills

    Thoroughly verify all code, tables, figures, modeling decisions, and quantitative claims in an academic paper against its source R scripts and output files.

    4.5k GitHub stars~2.9k tokensUpdated 4 days ago
    Research & ScienceAuto-check passed
  • Designing Experiments

    foryourhealth111-pixel/Vibe-Skills

    Design experiments and quasi-experiments before analysis. An agent skill from foryourhealth111-pixel/Vibe-Skills.

    3.6k GitHub stars~600 tokensUpdated 1 mo ago
    Research & ScienceAuto-check passed
  • Jape Identification Strategy

    franklee16/academic-research-skills

    A skill your agent uses when designing or defending the empirical identification of a Journal of Applied Econometrics (JAE) manuscript — a credible strategy applied to real data, with assumptions…

    223 GitHub starsUsed in 1 repo~707 tokens
    Research & ScienceAuto-check passed

More from brycewang-stanford/Awesome-Journal-Skills

All 2,387 skills in this repo
  • Aaag Data Analysis

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when running and reporting the analysis for an Annals of the American Association of Geographers manuscript — spatial statistics and modeling, remote-sensing accuracy, or…

    1.2k GitHub stars~1.3k tokensUpdated 12 days ago
    Auto-check passed
  • Aaag Literature Positioning

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when positioning an Annals of the American Association of Geographers manuscript in the literature — engaging geographic scholarship across the relevant area and the…

    1.2k GitHub stars~1.3k tokensUpdated 12 days ago
    Auto-check passed
  • Aaag Rebuttal

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when responding to an Annals of the American Association of Geographers decision letter (major/minor revision) — building a point-by-point response to the subject editor and…

    1.2k GitHub stars~1.4k tokensUpdated 12 days ago
    Auto-check passed
  • Aaag Research Design

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when defending the research design of an Annals of the American Association of Geographers manuscript — spatial/quantitative analysis and GIScience, remote-sensing and…

    1.2k GitHub stars~1.4k tokensUpdated 12 days ago
    Auto-check passed
  • Aaag Review Process

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when you need to understand how the Annals of the American Association of Geographers evaluates a manuscript — double-anonymous review routed through a subject editor by…

    1.2k GitHub stars~1.3k tokensUpdated 12 days ago
    Auto-check passed
  • Aaag Submission

    brycewang-stanford/Awesome-Journal-Skills

    A skill your agent uses when running the final pre-submission preflight for the Annals of the American Association of Geographers via ScholarOne Manuscripts — area/article-type selection…

    1.2k GitHub stars~1.6k tokensUpdated 12 days ago
    Auto-check passed

Questions about Joap Study Design

What does Joap Study Design do?

A skill your agent uses when designing studies and measurement for a Journal of Applied Psychology (JAP) manuscript so they meet the journal's high bar on construct validity, causal inference…. Joap Study Design is an agent skill from brycewang-stanford/Awesome-Journal-Skills. Use when designing studies and measurement for a Journal of Applied Psychology (JAP) manuscript so they meet the journal's high bar on construct validity, causal inference, common-method variance, nested/multilevel data, and sample-size justification.

When should I use Joap Study Design?

Joap Study Design fits situations like: causal inference; common-method variance; nested/multilevel data; sample-size justification.

How do I install Joap Study Design in Claude Code?

Run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill joap-study-design -a claude-code`. Or copy the skill folder (Journal-of-Applied-Psychology-Skills/skills/joap-study-design in brycewang-stanford/Awesome-Journal-Skills) into .claude/skills/joap-study-design in your project. Claude Code loads it when a task matches its description.

How do I install Joap Study Design in Codex?

Run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill joap-study-design -a codex`. Or copy the skill folder (Journal-of-Applied-Psychology-Skills/skills/joap-study-design in brycewang-stanford/Awesome-Journal-Skills) into .agents/skills/joap-study-design in your project. Codex loads it when a task matches its description.

Can I use Joap Study Design in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill joap-study-design -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/joap-study-design, .gemini/skills/joap-study-design, .github/skills/joap-study-design and .opencode/skills/joap-study-design in your project.

What does Joap Study Design need to run?

SKILL.md names no scripts, command-line tools or credentials: Joap Study Design is instructions for the agent only.

Does Joap Study Design access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Joap Study Design safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Joap Study Design use?

Joap Study Design is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Joap Study Design use?

About 1.9k tokens (SKILL.md is roughly 7.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Joap Study Design?

Skills that share tags, products or a category with Joap Study Design: Causal (ai-analyst-lab/ai-analyst, 304 stars), Fin Experiment Design (csmar432/finai-research, 109 stars), Judea Pearl (K-Dense-AI/mimeo, 282 stars) and Academic Paper Verify (brycewang-stanford/Auto-Empirical-Research-Skills, 4.5k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Joap Study Design?

brycewang-stanford (a GitHub user) maintains it in brycewang-stanford/Awesome-Journal-Skills, which has 1,228 GitHub stars. The repository holds 2,387 skills in this directory. The repository was last updated on September 27, 2026.

Source: brycewang-stanford/Awesome-Journal-Skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.