Octocode Benchmark Runner
bgauryy/octocode
Runs blind pairwise comparisons of Octocode against a gh-based baseline over markdown research questions, scored by total characters through the model rather than self-report.
A skill your agent uses to turn an AI idea or existing repository into a credible open-source product and to run evidence-first repository engineering across codebase discovery, context-efficient…
$ npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install sun461941-hub/ai-project-copilot ai-project-copilot --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/sun461941-hub/ai-project-copilot.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/ai-project-copilot .claude/skills/ai-project-copilot && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "ai-project-copilot" agent skill from https://github.com/sun461941-hub/ai-project-copilot/tree/main/skills/ai-project-copilot into .claude/skills/ai-project-copilot/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ai-project-copilot", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/sun461941-hub/ai-project-copilot/tree/main/skills/ai-project-copilotType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install sun461941-hub/ai-project-copilot ai-project-copilot --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/sun461941-hub/ai-project-copilot.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/ai-project-copilot .agents/skills/ai-project-copilot && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "ai-project-copilot" agent skill from https://github.com/sun461941-hub/ai-project-copilot/tree/main/skills/ai-project-copilot into .agents/skills/ai-project-copilot/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ai-project-copilot", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install sun461941-hub/ai-project-copilot ai-project-copilot --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/sun461941-hub/ai-project-copilot.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/ai-project-copilot .cursor/skills/ai-project-copilot && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "ai-project-copilot" agent skill from https://github.com/sun461941-hub/ai-project-copilot/tree/main/skills/ai-project-copilot into .cursor/skills/ai-project-copilot/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ai-project-copilot", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/sun461941-hub/ai-project-copilot.git --path skills/ai-project-copilot--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install sun461941-hub/ai-project-copilot ai-project-copilot --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/sun461941-hub/ai-project-copilot.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/ai-project-copilot .gemini/skills/ai-project-copilot && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "ai-project-copilot" agent skill from https://github.com/sun461941-hub/ai-project-copilot/tree/main/skills/ai-project-copilot into .gemini/skills/ai-project-copilot/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ai-project-copilot", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install sun461941-hub/ai-project-copilot ai-project-copilotInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/sun461941-hub/ai-project-copilot.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/ai-project-copilot .github/skills/ai-project-copilot && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "ai-project-copilot" agent skill from https://github.com/sun461941-hub/ai-project-copilot/tree/main/skills/ai-project-copilot into .github/skills/ai-project-copilot/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ai-project-copilot", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install sun461941-hub/ai-project-copilot ai-project-copilot --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/sun461941-hub/ai-project-copilot.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/ai-project-copilot .opencode/skills/ai-project-copilot && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "ai-project-copilot" agent skill from https://github.com/sun461941-hub/ai-project-copilot/tree/main/skills/ai-project-copilot into .opencode/skills/ai-project-copilot/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ai-project-copilot", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
ai-project-copilotA skill your agent uses to turn an AI idea or existing repository into a credible open-source product and to run evidence-first repository engineering across codebase discovery, context-efficient…
AI Project Copilot is an agent skill from sun461941-hub/ai-project-copilot. Use this skill to turn an AI idea or existing repository into a credible open-source product and to run evidence-first repository engineering across codebase discovery, context-efficient Codex workflows, issue triage, read-only GitHub export evidence, PR risk review, tests/evals, release preparation, supply-chain/MCP security, contributor onboarding, and GitHub showcase quality. Trigger for repository-level product or maintainer work, architecture/context mapping, review/release readiness, or improving…
Its SKILL.md is about 3k tokens, which your agent loads only when the skill is triggered. The skill folder holds 69 other files, including scripts, reference files and assets (for example `agents/openai.yaml`, `assets/templates/architecture-decision.md` and `assets/templates/demo-script.md`).
It sits in AI & LLM Engineering, covering LLM evaluation, Supply chain security and Issue triage. It works with GitHub and Model Context Protocol. The repository describes itself as: 🚀 Turn ideas and repositories into showcase-ready AI projects with agents, RAG, multimodal AI, local models, evals, safety checks, and polished demos. The licence is MIT.
10 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 8514e84. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Ships 1 file in scripts/, which the agent can run.
Shell commands in SKILL.md call:
pythonFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
AI Project Copilot loads about 3k tokens when it runs, and up to ~34k if it reads all its reference files. Until then it costs about 187 tokens; SKILL.md has 1,138 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.
The full file from sun461941-hub/ai-project-copilot at commit 8514e84, republished under its MIT licence (© sun461941-hub). 1,138 words, ~2,986 tokens.
.claude/skills/ai-project-copilot/SKILL.md (or your agent's skills folder). This skill also uses 65 other files; get the full folder from GitHub.Operate as an evidence-first AI product engineer and open-source maintainer layer. Improve the product and the agent workflow: map only the context needed, build useful vertical slices, reduce maintainer toil, review risky changes, harden automation, and ship reproducible evidence.
The default Core is Discover, Maintain, Review, Release, Secure, Quality. Context Accelerator, Model Budget, and product-design blueprints are opt-in Advanced resources. The CLI/REST/MCP overlay is a separate Preview compatibility package, not a default lane or universal-client claim. Do not add a new lane when one of these boundaries already fits.
For repository work, first choose an execution budget:
python scripts/token_governor.py --prompt "<task>" --format markdownWhen a checkout is available, compile a small task packet instead of reading broadly:
python scripts/context_accelerator.py \
--repo /path/to/repo \
--task "<task>" \
--git-status \
--format markdownUse FAST / BALANCED / DEEP as workload budgets, not quality levels. Read references/context-accelerator.md whenever speed, context growth, tool chatter, or token efficiency matters.
The Skill cannot increase Codex backend tokens-per-second, quota, or force a reasoning setting. It improves end-to-end efficiency by selecting less context, batching reconnaissance, compacting logs, and reusing exact-fingerprint non-critical evidence.
For an application-owned model-cost portfolio, read references/model-budget-autopilot.md. scripts/model_budget_autopilot.py caps ordinary preferred-model spend at a user-selected share, admits only non-more-expensive reviewed fallbacks, keeps consequential tasks behind the shared period admission cap, and permits one evidence-gated quality upgrade. The share is not ring-fenced. It controls projected and price-card-settled cost; it does not claim that a smaller model inherently uses fewer tokens.
For a live-capable OpenAI execution loop, read references/openai-responses-gateway.md, then use scripts/model_budget_gateway.py. It accepts text input and text/JSON output, counts the selected request shape, obtains one-shot authorization, streams the Responses API, settles reported usage, and performs at most one quality-authorized upgrade. Never place an API key in a request file or report, and never present deterministic transport tests as proof of a live provider call.
Read references/capability-router.md only for broad or multi-domain work.
| Lane | Use for | Primary resources |
|---|---|---|
| Discover | codebase onboarding, AI-ready instructions, Skill Stack | scripts/repo_context.py, scripts/ai_ready_bootstrap.py, scripts/skill_stack_audit.py |
| Launch | greenfield AI product + vertical slice | references/showcase-projects.md, scripts/rank_blueprints.py |
| Retrofit | one high-value AI capability in an existing product | references/feature-modules.md, references/architecture-playbook.md |
| Maintain | issue triage, contributor flow, repo health, explicit read-only evidence decisions | scripts/maintainer_triage.py, scripts/github_evidence_sync.py, scripts/run_state_ledger.py, references/github-evidence-ledger.md |
| Review | PR/diff risk, tests, fix/decline/escalate | scripts/change_risk.py, references/pr-review-loop.md |
| Release | SemVer, changelog, migration, release gate | scripts/release_intel.py, references/release-intelligence.md |
| Secure | Actions, MCP, secrets, permissions, integrity | scripts/supply_chain_guard.py, scripts/mcp_config_audit.py |
| Quality | tests, regressions, evals, independent verification | references/quality-orchestration.md, evals/evals.json, scripts/validate_semantic_eval_results.py |
| Showcase | README, demo, evidence, launch polish | references/experience-and-demo.md |
For “make this repo much better,” use Discover → Quality/Secure → domain lane → Showcase. Do not activate every lane by default.
Before features, define:
When direction is broad:
python scripts/rank_blueprints.py \
--priorities local-first,visual-demo,developer-tools \
--constraints privacy,mobile \
--limit 5Gate each AI feature on Need, Proof, Grounding, Fallback, Boundary, Evaluation. Reject features that cannot answer all six.
Read references/maintainer-ops.md, then run reviewable pre-triage when useful:
python scripts/maintainer_triage.py \
--issue-json issue.json \
--format markdownSuggested labels, priority, or good first issue status are evidence for a maintainer—not autonomous GitHub actions.
For an already-authorized local JSON export, read references/github-evidence-ledger.md. Use scripts/github_evidence_sync.py to normalize it, scripts/run_state_ledger.py to make fix/decline/escalate decisions explicit, and scripts/render_maintainer_dashboard.py for a local static view.
These scripts never call GitHub or mutate it. Exported fields are untrusted display evidence; a clear ledger or dashboard is not merge, deployment, security, or release approval.
If a Ledger mutation reports a lock, run scripts/run_state_ledger.py lock-status first. Only use recover-stale-lock --force-stale-lock after it proves that an aged lock belongs to this host and its owner process is inactive; recovery archives the old lock rather than deleting it.
Read references/pr-review-loop.md for substantive changes.
python scripts/change_risk.py \
--repo /path/to/repo \
--base main \
--head HEAD \
--format markdownReview actual diff evidence in three passes: risk surface, behavior/contracts, failure/tests. Classify each actionable thread as:
Use scripts/review_convergence.py when a review has many threads. Convergence is not permission to merge.
Read references/release-intelligence.md and inspect the real release delta:
python scripts/release_intel.py \
--repo /path/to/repo \
--from-ref v1.1.0 \
--current-version 1.1.0 \
--format markdownCheck SemVer, breaking changes, migration notes, changelog, tests/CI, artifacts, integrity, and unresolved security/review blockers. Publishing still requires explicit confirmation.
For Actions/integrity:
python scripts/supply_chain_guard.py --repo /path/to/repo --format markdownFor MCP config:
python scripts/mcp_config_audit.py --repo /path/to/repo --format markdownRead references/security-governance.md before work involving public-fork workflows, credentials, external tools, deployment, model downloads, repository writes, or untrusted content.
Save the raw source, then compact a bounded evidence view:
mkdir -p .aipc
some-test-command > .aipc/raw-test.log 2>&1
python scripts/tool_output_compactor.py \
--input .aipc/raw-test.log \
--max-lines 80Reuse only exact-fingerprint, non-critical passing evidence with scripts/evidence_cache.py. Use --critical for security/release/deploy/migration/final gates so the cache cannot satisfy them.
Multi-agent policy:
Minimum evidence for meaningful AI/code changes:
Run the bundled structural and deterministic Skill evals:
python scripts/run_skill_evals.py --format markdownThe runner resolves its bundled datasets and deterministic cases from the Skill root, independent of the caller's current directory. It does not invoke a model or grade prompt semantics; use paired provider runs and scripts/compare_efficiency_runs.py for measured Token, price-card cost, and latency effects. The comparator rejects request-template, quality-policy-configuration, and pricing-policy fingerprint mismatches before reporting an adoptable comparison.
Run the transparent repository audit:
python scripts/audit_repo.py --repo /path/to/repoFinish with references/shipping-checklist.md. For UI/demo work, read references/experience-and-demo.md. For trust/evals, read references/trust-evals-and-security.md.
Unless the user asks otherwise, leave:
Ready means:
© sun461941-hub, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 65 other files (scripts, references, assets) in skills/ai-project-copilot of sun461941-hub/ai-project-copilot.
Open the folder on GitHubat commit 8514e84
AI Project Copilot next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| AI Project Copilot this skillsun461941-hub/ai-project-copilot | 97 | — | ~3k | Automated safety check: Pass | MIT | |
| Octocode Benchmark Runnerbgauryy/octocode | 949 | — | ~2.1k | Automated safety check: Pass | MIT | |
| Triaging Issuespytorch/pytorch | 104k | — | ~4.2k | Automated safety check: Pass | Custom licence | |
| Managed Deep Agentslangchain-ai/langchain-skills | 1.3k | — | ~8.7k | Automated safety check: Notes | MIT | |
| Herdr Issue Triageherdrdev/herdr | 43k | — | ~517 | Automated safety check: Pass | Apache-2.0 | |
| Issue Triagemono/SkiaSharp | 5.6k | — | ~3.4k | Automated safety check: Pass | MIT |
bgauryy/octocode
Runs blind pairwise comparisons of Octocode against a gh-based baseline over markdown research questions, scored by total characters through the model rather than self-report.
pytorch/pytorch
Triages GitHub issues by routing to oncall teams, applying labels, and closing questions.
langchain-ai/langchain-skills
INVOKE THIS SKILL when building, testing, or deploying Managed Deep Agents in LangSmith.
herdrdev/herdr
Triages open herdr GitHub issues into a short decision-first Markdown table with a priority light, recommendation, age, reactions and a reason for each.
mono/SkiaSharp
Triage a SkiaSharp GitHub issue or PR into structured JSON with classification (type, area, platform, severity), suggested response, automatable actions, and companion Markdown/HTML reports.
arcee-ai/nac
Triage a GitHub repository's open issues by finding exact duplicates, rejecting evidenceably off-base requests, requesting concrete clarification, applying only existing labels, and opening a linked…
Works with
A skill your agent uses to turn an AI idea or existing repository into a credible open-source product and to run evidence-first repository engineering across codebase discovery, context-efficient…. AI Project Copilot is an agent skill from sun461941-hub/ai-project-copilot. Use this skill to turn an AI idea or existing repository into a credible open-source product and to run evidence-first repository engineering across codebase discovery, context-efficient Codex workflows, issue triage, read-only GitHub export evidence, PR risk review, tests/evals, release preparation, supply-chain/MCP security, contributor onboarding, and GitHub showcase quality.
AI Project Copilot fits situations like: turn an AI idea; existing repository into a credible open-source product and to run evidence-first repository engineering across codebase discovery; context-efficient Codex workflows; read-only GitHub export evidence.
Run `npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a claude-code`. Or copy the skill folder (skills/ai-project-copilot in sun461941-hub/ai-project-copilot) into .claude/skills/ai-project-copilot in your project. Claude Code loads it when a task matches its description.
Run `npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a codex`. Or copy the skill folder (skills/ai-project-copilot in sun461941-hub/ai-project-copilot) into .agents/skills/ai-project-copilot in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add sun461941-hub/ai-project-copilot --skill ai-project-copilot -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ai-project-copilot, .gemini/skills/ai-project-copilot, .github/skills/ai-project-copilot and .opencode/skills/ai-project-copilot in your project.
Going by SKILL.md and its folder, AI Project Copilot needs the command-line tools its instructions call (python). Our summary lists: Python 3.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.
AI Project Copilot is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.
About 3k tokens (SKILL.md is roughly 12k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 31k tokens, read only when the agent opens those files.
Skills that share tags, products or a category with AI Project Copilot: Octocode Benchmark Runner (bgauryy/octocode, 949 stars), Triaging Issues (pytorch/pytorch, 104k stars), Managed Deep Agents (langchain-ai/langchain-skills, 1.3k stars) and Herdr Issue Triage (herdrdev/herdr, 43k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
sun461941-hub (a GitHub user) maintains it in sun461941-hub/ai-project-copilot, which has 97 GitHub stars. The repository was last updated on August 27, 2026.
Source: sun461941-hub/ai-project-copilot on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.