GitHub · LLM evaluation

Research, create, improve, migrate, evaluate, package, install-check, govern, and safely publish qiaomu-flavored agent skills from workflows, prompts, transcripts, docs, SOPs, runbooks, scripts, or…

joeseesun/qiaomu-meta-skill

Runs blind pairwise comparisons of Octocode against a gh-based baseline over markdown research questions, scored by total characters through the model rather than self-report.

bgauryy/octocode

A skill your agent uses to turn an AI idea or existing repository into a credible open-source product and to run evidence-first repository engineering across codebase discovery, context-efficient…

sun461941-hub/ai-project-copilot

Benchmark a third-party coding-agent harness against FrontierHarness Eval using Runta runtimes.

frontier-harness-eval/eval

Adds a new task to the bench-swe pipeline from a real GitHub bug-fix issue or pull request, then checks the generated task file and patch.

ory/lumen

Runs a measurable keep-or-discard improvement loop against a runnable sensor, from framing a goal and KPI through baseline, judging and held-out verification.

bgauryy/octocode

[Beta] CI-only eval regression runner using gh-aw (GitHub Agentic Workflows).

pskoett/pskoett-ai-skills

Auto-discover all skills with evals in RConsortium/pharma-skills, benchmark each with vs.

RConsortium/pharma-skills

INVOKE THIS SKILL when building, testing, or deploying Managed Deep Agents in LangSmith.

langchain-ai/langchain-skills

Author and validate Vally evals for Agent Skills under .github/skills.

Azure/azure-sdk-tools