Agent skill

Openevidence Observability

by jeremylongshore in jeremylongshore/tons-of-skills-marketplace

Monitor OpenEvidence workflow quality, evidence traceability, adoption, and safety signals using approved local evidence.

MITAuto-check passedDevOps & Cloud

Install Openevidence Observability

skills CLI
$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill openevidence-observability -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install jeremylongshore/tons-of-skills-marketplace openevidence-observability --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/.curated/openevidence-observability .claude/skills/openevidence-observability && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
openevidence-observability
GitHub stars
2.8k
Token cost
~1.1k tokens
SKILL.md length
442 words
Files
2 (incl. references)
Skills in repo
3,342
Repo updated
First seen
Licence
MIT

At a glance

Monitor OpenEvidence workflow quality, evidence traceability, adoption, and safety signals using approved local evidence.

  • Works in 6 steps: Define the monitored workflow, cohort,… → Select measures for completion, citation… → Sample the minimum authorized records… → …
  • Working with OpenEvidence in a healthcare organization
  • SKILL.md covers Overview, Prerequisites, Tool Discipline and Current Contract, plus 7 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Openevidence Observability is an agent skill from jeremylongshore/tons-of-skills-marketplace. Monitor OpenEvidence workflow quality, evidence traceability, adoption, and safety signals using approved local evidence. Use when working with OpenEvidence in a healthcare organization. Trigger with "openevidence observability", "OpenEvidence quality", or a matching workflow request.

Its SKILL.md is about 1.1k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including reference files (for example `references/official-docs.md`). Compatibility notes: Designed for Claude Code; requires authorized OpenEvidence access and qualified clinical review for patient-care use

It sits in DevOps & Cloud, covering Observability. The repository describes itself as: Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com. The licence is MIT.

When your agent uses it

  • Working with OpenEvidence in a healthcare organization
  • With openevidence observability
  • OpenEvidence quality
  • A matching workflow request

Example prompts

  • “openevidence observability”
  • “OpenEvidence quality”
  • “/openevidence-observability”

Requirements

  • Compatibility (from SKILL.md): Designed for Claude Code; requires authorized OpenEvidence access and qualified clinical review for patient-care use
  • Pre-approved tools (allowed-tools): Read, Glob, Grep, WebFetch, Write, Edit

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

  1. Define the monitored workflow, cohort, period, data authority, clinical owner, and escalation thresholds.
  2. Select measures for completion, citation traceability, unsupported claims, reviewer overrides, time burden, incidents, and training gaps.
  3. Sample the minimum authorized records and de-identify evidence used outside the care record.
  4. Have qualified reviewers score outputs with a stable rubric and record inter-reviewer disagreement.
  5. Trend results without inferring patient outcomes or vendor-wide performance from a local sample.
  6. Publish findings, limitations, actions, owners, thresholds, and the next review date.

What it can do on your machine

Read from SKILL.md and the folder at commit cfae287. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Glob
    • Grep
    • WebFetch
    • Write
    • Edit

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • openevidence.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

  • Compatibility

    Designed for Claude Code; requires authorized OpenEvidence access and qualified clinical review for patient-care use

    From compatibility in the SKILL.md frontmatter.

Context cost

Openevidence Observability loads about 1.1k tokens when it runs, and up to ~1.8k if it reads all its reference files. Until then it costs about 78 tokens; SKILL.md has 442 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~78
When it runs · the whole SKILL.md, loaded when a task matches
~1.1k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~1.8k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit cfae287, republished under its MIT licence (© jeremylongshore). 442 words, ~1,115 tokens.

Download SKILL.mdSave it as .claude/skills/openevidence-observability/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
openevidence-observability
description
Monitor OpenEvidence workflow quality, evidence traceability, adoption, and safety signals using approved local evidence. Use when working with OpenEvidence in a healthcare organization. Trigger with "openevidence observability", "OpenEvidence quality", or a matching workflow request.
allowed-tools
Read, Glob, Grep, WebFetch, Write, Edit
compatibility
Designed for Claude Code; requires authorized OpenEvidence access and qualified clinical review for patient-care use
argument-hint
[audit-period] [workflow]
version
1.14.0
author
Jeremy Longshore <jeremy@intentsolutions.io>
license
MIT
tags
saas, openevidence, quality, monitoring
model
inherit
effort
high

OpenEvidence Quality and Adoption Audit

Overview

Create a human-centered review loop without claiming access to private product telemetry. Keep inputs minimal, separate observed facts from assumptions, and leave consequential decisions with the named accountable owner.

Prerequisites

  • A clearly bounded workflow, accountable clinical owner, and organizational policy
  • Current first-party OpenEvidence documentation and applicable institution agreements
  • Synthetic or properly authorized minimum-necessary data

Tool Discipline

Use Read, Glob, and Grep to inspect supplied policies, plans, and evidence. Use WebFetch only for current first-party OpenEvidence documentation. Use Write or Edit only when the user requests a named deliverable with an approved destination. Never expose credentials, PHI, recordings, or unrestricted environment output.

Current Contract

  • No public observability API or standard metrics export is documented.
  • Measurements must come from authorized account/institution records and redacted quality samples.
  • Volume and speed are insufficient without citation, applicability, and safety review.

Authentication

Use only the official OpenEvidence web/mobile sign-in or an institution-approved access path. Do not invent API keys, OAuth clients, SDK credentials, service accounts, or private endpoints. Never ask a user to reveal a password, session token, cookie, or recovery code.

Instructions

  1. Define the monitored workflow, cohort, period, data authority, clinical owner, and escalation thresholds.
  2. Select measures for completion, citation traceability, unsupported claims, reviewer overrides, time burden, incidents, and training gaps.
  3. Sample the minimum authorized records and de-identify evidence used outside the care record.
  4. Have qualified reviewers score outputs with a stable rubric and record inter-reviewer disagreement.
  5. Trend results without inferring patient outcomes or vendor-wide performance from a local sample.
  6. Publish findings, limitations, actions, owners, thresholds, and the next review date.
Show full SKILL.md (174 more words)Show less

Approval Boundaries

Do not create or share accounts; change access, roles, agreements, consent, retention, or security settings; enter PHI; record a conversation; copy content into another system; contact a patient; make a diagnosis or treatment decision; submit billing; transmit a support packet; run a production pilot; or represent vendor capabilities without explicit approval from the accountable owner. A qualified professional remains responsible for clinical decisions.

Output

Return scope, current first-party evidence and date, data classification, workflow or findings, citations reviewed, assumptions rejected, clinical and governance owners, approval state, unresolved risk, and the exact next action. Redact patient and credential data.

Error Handling

ConditionResponse
Telemetry unavailableUse an approved sample or survey and label coverage.
Metric hides harmAdd safety and override measures before reporting success.
Sample contains PHIKeep it in the governed system or stop the audit export.

Examples

This compact example shows the minimum reviewable handoff; adapt fields to the approved workflow without adding sensitive data.

Input:

text
period=30d; workflow=Ask; sample=25 de-identified reviews

Expected handoff:

text
traceability=measured; overrides=recorded; incidents=1; actions=3

Resources

© jeremylongshore, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file (references) in skills/.curated/openevidence-observability of jeremylongshore/tons-of-skills-marketplace.

  • SKILL.md
  • references/official-docs.md

Open the folder on GitHubat commit cfae287

Compare with similar skills

Openevidence Observability next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Openevidence Observability compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Openevidence Observability this skilljeremylongshore/tons-of-skills-marketplace2.8k—~1.1kAutomated safety check: PassMIT
Vercel Optimize Auditvercel-labs/agent-skills32k8 repos~4.3kAutomated safety check: PassNone
Kubeshark Installerkubeshark/kubeshark12k—~3.6kAutomated safety check: NotesApache-2.0
Kubeshark KFL2 Filter Referencekubeshark/kubeshark12k—~3.6kAutomated safety check: PassApache-2.0
KubeSphere ServiceMesh Managerkubesphere/kubesphere17k—~2.4kAutomated safety check: PassCustom licence
Kubernetes Network Root Cause Analysiskubeshark/kubeshark12k—~5.3kAutomated safety check: PassApache-2.0

Similar skills

  • Vercel Optimize Audit

    vercel-labs/agent-skills

    Official

    Runs a metrics-first audit of a deployed Vercel project, gating investigations on real signals to produce ranked, citation-backed cost and performance recommendations.

    32k GitHub starsUsed in 8 repos~4.3k tokens
    DevOps & CloudAuto-check passed
  • Kubeshark Installer

    kubeshark/kubeshark

    Installs and configures Kubeshark on a Kubernetes cluster, choosing between the quick CLI path and a Helm install with custom values.

    12k GitHub stars~3.6k tokensUpdated yesterday
    DevOps & CloudAuto-check: notes
  • Syntax reference for KFL2, the CEL-based display filter language used to search Kubernetes network traffic captured by Kubeshark, loaded before any filter is written.

    12k GitHub stars~3.6k tokensUpdated yesterday
    DevOps & CloudAuto-check passed
  • KubeSphere ServiceMesh Manager

    kubesphere/kubesphere

    Installs, checks and troubleshoots the KubeSphere ServiceMesh extension (Istio, Kiali, Jaeger), including grayscale release, sidecar injection, topology and tracing issues.

    17k GitHub stars~2.4k tokensUpdated 2 mo ago
    DevOps & CloudAuto-check passed
  • Investigates past Kubernetes incidents from Kubeshark traffic snapshots: takes captures, dissects API calls, extracts PCAPs and compares traffic over time.

    12k GitHub stars~5.3k tokensUpdated yesterday
    DevOps & CloudAuto-check passed
  • Caveman Gateway Setup

    JuliusBrussee/caveman

    Routes every LLM call in a repository through the Caveman Cloud gateway in record mode, so requests and costs are measured without changing behavior.

    111k GitHub starsUsed in 1 repo~2.6k tokens
    DevOps & CloudAuto-check: warnings

More from jeremylongshore/tons-of-skills-marketplace

All 3,342 skills in this repo
  • Performing Security Code Review

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to conduct a security-focused code review using the security-agent plugin.

    2.8k GitHub starsUsed in 2 repos~1.3k tokens
    Auto-check: notes
  • Adapting Transfer Learning Models

    jeremylongshore/tons-of-skills-marketplace

    Build this skill automates the adaptation of pre-trained machine learning models using transfer learning techniques.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Agent Context Loader

    jeremylongshore/tons-of-skills-marketplace

    Execute proactive auto-loading: automatically detects and loads agents.md files.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Aggregating Performance Metrics

    jeremylongshore/tons-of-skills-marketplace

    Aggregate and centralize performance metrics from applications, systems, databases, caches, and services.

    2.8k GitHub stars~1.2k tokensUpdated today
    Auto-check passed
  • Analyzing Capacity Planning

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to analyze capacity requirements and plan for future growth.

    2.8k GitHub stars~947 tokensUpdated today
    Auto-check passed
  • Analyzing Database Indexes

    jeremylongshore/tons-of-skills-marketplace

    Process use when you need to work with database indexing. An agent skill from jeremylongshore/tons-of-skills-marketplace.

    2.8k GitHub stars~2k tokensUpdated today
    Auto-check passed

Categories

Questions about Openevidence Observability

What does Openevidence Observability do?

Monitor OpenEvidence workflow quality, evidence traceability, adoption, and safety signals using approved local evidence. Openevidence Observability is an agent skill from jeremylongshore/tons-of-skills-marketplace. Monitor OpenEvidence workflow quality, evidence traceability, adoption, and safety signals using approved local evidence.

When should I use Openevidence Observability?

Openevidence Observability fits situations like: working with OpenEvidence in a healthcare organization; with openevidence observability; openEvidence quality; A matching workflow request.

How do I install Openevidence Observability in Claude Code?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill openevidence-observability -a claude-code`. Or copy the skill folder (skills/.curated/openevidence-observability in jeremylongshore/tons-of-skills-marketplace) into .claude/skills/openevidence-observability in your project. Claude Code loads it when a task matches its description.

How do I install Openevidence Observability in Codex?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill openevidence-observability -a codex`. Or copy the skill folder (skills/.curated/openevidence-observability in jeremylongshore/tons-of-skills-marketplace) into .agents/skills/openevidence-observability in your project. Codex loads it when a task matches its description.

Can I use Openevidence Observability in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill openevidence-observability -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/openevidence-observability, .gemini/skills/openevidence-observability, .github/skills/openevidence-observability and .opencode/skills/openevidence-observability in your project.

What does Openevidence Observability need to run?

SKILL.md names no scripts, command-line tools or credentials: Openevidence Observability is instructions for the agent only. Its frontmatter pre-approves these tools: Read, Glob, Grep, WebFetch, Write, Edit. Compatibility (from SKILL.md): Designed for Claude Code; requires authorized OpenEvidence access and qualified clinical review for patient-care use.

Does Openevidence Observability access the network?

SKILL.md names 1 domain. As links in the text: openevidence.com. This is read from the text; nothing was executed.

Is Openevidence Observability safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Openevidence Observability use?

Openevidence Observability is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Openevidence Observability use?

About 1.1k tokens (SKILL.md is roughly 4.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 641 tokens, read only when the agent opens those files.

What are the alternatives to Openevidence Observability?

Skills that share tags, products or a category with Openevidence Observability: Vercel Optimize Audit (vercel-labs/agent-skills, 32k stars), Kubeshark Installer (kubeshark/kubeshark, 12k stars), Kubeshark KFL2 Filter Reference (kubeshark/kubeshark, 12k stars) and KubeSphere ServiceMesh Manager (kubesphere/kubesphere, 17k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Openevidence Observability?

jeremylongshore (a GitHub user) maintains it in jeremylongshore/tons-of-skills-marketplace, which has 2,827 GitHub stars. The repository holds 3,342 skills in this directory. The repository was last updated on October 10, 2026.

Source: jeremylongshore/tons-of-skills-marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.