Agent evaluation and testing

Agent skill for test-long-runner - invoke with $agent-test-long-runner

ruvnet/ruflo

Evaluate any agent skill against a merged framework — Anthropic's Claude Code best practices plus Matt Pocock's writing-great-skills methodology — across 4 axes (Trigger, Structure, Steering…

fabricioctelles/skills

Measure whether a skill helps by comparing runs with and without it.

boshu2/agentops

Evaluate agent behavior with versioned cases and explicit verifiers.

sickn33/agentic-awesome-skills

A skill your agent uses when my-pi-agent tests, typecheck, lint, Pi CLI startup, OpenCode/MCP, Feishu channel, prompt rendering, memory/state, web-console/desktop build, or UI behavior fails…

skuramatata/my-pi-agent

Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on real-world…

davila7/claude-code-templates

Design reproducible evaluations for AI agents with representative task sets, explicit rubrics, appropriate graders, baselines, regression gates, and failure analysis.

seb1n/awesome-ai-agent-skills

Launch Devolutions Gateway from source for local coding-agent tests with loopback listeners by default; require explicit opt-in before binding to non-localhost addresses.

Devolutions/devolutions-gateway

A skill your agent uses when summarizing agent evaluations where autonomous, assisted, failed, timed-out, or invalid outcomes must remain distinct and comparable.

sickn33/agentic-awesome-skills

Evaluate an AI workflow against representative cases and its permitted actions.

suboss87/FDEOps

A skill your agent uses when my-pi-agent tests, typecheck, lint, /code workflow, verifier probes, Feishu channel handling, MCP bootstrap, skill install, or task resume behavior fails unexpectedly.

skuramatata/my-pi-agent

Apex test execution, coverage analysis, and test-fix loops with 120-point scoring.

Jaganpro/sf-skills

Autonomous AI agent benchmark evaluation register: task completion rates, planning accuracy, tool invocation precision, and cost benchmarks.

sickn33/agentic-awesome-skills

Run reproducible DeepSWE coding-agent benchmark evaluations through OpenRouter and mini-swe-agent.

sickn33/agentic-awesome-skills

Sets up eval-driven development for Claude Code workflows: capability and regression evals, three grader types and pass@k reliability metrics.

affaan-m/ECC

A skill your agent uses when the user asks to design a multi-agent system, pick an orchestration pattern (supervisor/swarm/pipeline), generate tool schemas for agents, or evaluate agent execution…

alirezarezvani/claude-skills

Agentforce Builder metadata path for Builder-managed topics/actions, Prompt Builder templates, GenAiFunction/GenAiPlugin, Models API, and custom Lightning types.

Jaganpro/sf-skills

Evaluate and improve Claude Code commands, skills, and agents.

NeoLabHQ/context-engineering-kit

法律 Skill 分层质量评测工具。消费 skill-lint 的通用质量结论，再用三份测试材料、通用六维度、场景微调和律师 taste 评估法律产出，并定位最小修复单元。本技能应在审查、回归验证或发布验收法律 Skill 时使用。不要用于代替通用 Skill lint、正式法律意见或跨场景排名。

cat-xierluo/legal-skills

Apex test execution, coverage analysis, and test-fix loops with 120-point scoring.

forcedotcom/sf-skills

Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on re...

benjaminasterA/antigravity-awesome-skills

Create, improve, and evaluate agent skills (SKILL.md plus reference files).

himself65/finance-skills

Generate human and AI agent test scripts from user journey specifications.

paralleldrive/aidd

Toolkit management: create and evaluate skills and agents, manage routing tables, generate Claude.md.

notque/vexjoy-agent

This skill helps an LLM generate correct AxAgent RLM/runtime code using @ax-llm/ax.

dosco/aithy

Evaluate a $map- skill's trigger accuracy and cost. An agent skill from azalio/map-framework.

azalio/map-framework

Evaluate a /map- skill's trigger accuracy and cost. An agent skill from azalio/map-framework.

azalio/map-framework

Run the instrumented specification search in the user's own statistical language — Stata (reghdfe, ivreghdfe, rdrobust, did2s), R (fixest, rdrobust, did2s), Python (statsmodels, linearmodels) or…

brycewang-stanford/Auto-Empirical-Research-Skills

Advanced AI agent benchmark scenarios that push Vercel's cutting-edge platform features — Workflow SDK, AI Gateway, MCP, Chat SDK, Queues, Flags, Sandbox, and multi-agent orchestration.

vercel/vercel-plugin

Create, edit, and evaluate agent skills iteratively. An agent skill from HezaoHezao/poirot.

HezaoHezao/poirot

Testing: TDD, E2E, preferred patterns, test-value audits, verification, agent testing.

notque/vexjoy-agent

A skill your agent uses when planning or reviewing tests for a code change, choosing between unit, focused regression, integration, contract, end-to-end, performance, security, property-based, or…

AnastasiyaW/codex-claude-code-config

Set up testing and debug common issues in Agent Kernel projects.

yaalalabs/agent-kernel

Plan and run conversational AI agent evaluations with test generation and analysis.

mikeyobrien/rho

Validate the output of any installed skill against an assertion manifest — word counts, required patterns, forbidden phrases, required sections, source citation.

BankrBot/skills

MLflow 3 GenAI agent evaluation. An agent skill from databricks/databricks-agent-skills.

databricks/databricks-agent-skills

Run isolated eval and grading calls using CC 2.1.81 --bare mode.

yonatangross/orchestkit

Routes any legal task to the right LLM, like OpenRouter but for legal work and grounded in benchmarks instead of brand loyalty.

lawve-ai/awesome-legal-skills