Agent skill

Cohere Observability

by jeremylongshore in jeremylongshore/tons-of-skills-marketplace

Instrument Cohere requests, streams, retrieval, tools, limits, quality, and cost with low-cardinality telemetry and safe traces.

MITAuto-check passedDevOps & Cloud

Install Cohere Observability

skills CLI
$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill cohere-observability -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install jeremylongshore/tons-of-skills-marketplace cohere-observability --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/.curated/cohere-observability .claude/skills/cohere-observability && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
cohere-observability
GitHub stars
2.8k
Token cost
~1.1k tokens
SKILL.md length
432 words
Files
2 (incl. references)
Skills in repo
3,342
Repo updated
First seen
Licence
MIT

At a glance

Instrument Cohere requests, streams, retrieval, tools, limits, quality, and cost with low-cardinality telemetry and safe traces.

  • Works in 6 steps: Define service objectives and an… → Create counters for requests, outcomes,… → Create histograms for queue, retrieval,… → …
  • Monitoring a Cohere service
  • SKILL.md covers Overview, Prerequisites, Tool Discipline and Current Contract, plus 7 more sections
  • Needs CO_API_KEY

What it does

Cohere Observability is an agent skill from jeremylongshore/tons-of-skills-marketplace. Instrument Cohere requests, streams, retrieval, tools, limits, quality, and cost with low-cardinality telemetry and safe traces. Use when monitoring a Cohere service. Trigger with "Cohere observability", "Cohere metrics", or "monitor Cohere".

Its SKILL.md is about 1.1k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including reference files (for example `references/official-docs.md`). Compatibility notes: Designed for Claude Code; live verification requires network access and an approved Cohere API key

It sits in DevOps & Cloud, covering Observability. The repository describes itself as: Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com. The licence is MIT.

When your agent uses it

  • Monitoring a Cohere service
  • With Cohere observability

Example prompts

  • “Cohere observability”
  • “Cohere metrics”
  • “monitor Cohere”
  • “/cohere-observability”

Requirements

  • A credential in CO_API_KEY
  • Compatibility (from SKILL.md): Designed for Claude Code; live verification requires network access and an approved Cohere API key
  • Pre-approved tools (allowed-tools): Read, Glob, Grep, WebFetch, Write, Edit

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

  1. Define service objectives and an allowlist of telemetry fields before instrumenting.
  2. Create counters for requests, outcomes, retries, throttles, circuit transitions, and tool decisions.
  3. Create histograms for queue, retrieval, provider, first-event, completion, and end-to-end duration.
  4. Record usage and cost units without tenant names or unbounded request IDs as metric labels.
  5. Build alerts for availability, sustained throttling, queue age, latency, quality, and spend.
  6. Test redaction, trace propagation, stream cancellation, and incident correlation.

What it can do on your machine

Read from SKILL.md and the folder at commit cfae287. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Glob
    • Grep
    • WebFetch
    • Write
    • Edit

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • status.cohere.com
    • docs.cohere.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • CO_API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

  • Compatibility

    Designed for Claude Code; live verification requires network access and an approved Cohere API key

    From compatibility in the SKILL.md frontmatter.

Context cost

Cohere Observability loads about 1.1k tokens when it runs, and up to ~1.9k if it reads all its reference files. Until then it costs about 66 tokens; SKILL.md has 432 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~66
When it runs · the whole SKILL.md, loaded when a task matches
~1.1k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~1.9k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit cfae287, republished under its MIT licence (© jeremylongshore). 432 words, ~1,083 tokens.

Download SKILL.mdSave it as .claude/skills/cohere-observability/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
cohere-observability
description
Instrument Cohere requests, streams, retrieval, tools, limits, quality, and cost with low-cardinality telemetry and safe traces. Use when monitoring a Cohere service. Trigger with "Cohere observability", "Cohere metrics", or "monitor Cohere".
allowed-tools
Read, Glob, Grep, WebFetch, Write, Edit
compatibility
Designed for Claude Code; live verification requires network access and an approved Cohere API key
argument-hint
[service] [telemetry-backend]
version
1.6.0
author
Jeremy Longshore <jeremy@intentsolutions.io>
license
MIT
tags
saas, cohere, observability
model
inherit
effort
high

Cohere Observability

Overview

Expose enough evidence to separate application, retrieval, model, capacity, and provider failures without logging credentials or customer content.

Prerequisites

  • The target repository, runtime, environment, and accountable owner
  • An approved Cohere team and key for any live verification
  • Current quality, security, privacy, capacity, and change-control requirements

Tool Discipline

Use Read, Glob, and Grep to inspect code, configuration, and evidence. Use WebFetch only for current Cohere primary documentation. Use Write or Edit only when the user requested implementation and the exact target files are known; never write credentials or customer content.

Current Contract

  • Measure queue, retrieval, provider, first-event, completion, and tool durations separately.
  • Label metrics with bounded dimensions such as endpoint, operation, resolved model, environment, outcome, and retry class.
  • Keep prompts, documents, embeddings, keys, and raw tool arguments out of telemetry by default.
  • Pair operational metrics with sampled quality, citation, and safety evaluations.

Authentication

Use an environment-specific key injected from an approved secret manager. Never print, persist, commit, or place CO_API_KEY in an example. Confirm access with the least costly bounded operation appropriate to the task, and treat key creation, rotation, revocation, role changes, and production-capacity requests as owner-approved actions.

Instructions

  1. Define service objectives and an allowlist of telemetry fields before instrumenting.
  2. Create counters for requests, outcomes, retries, throttles, circuit transitions, and tool decisions.
  3. Create histograms for queue, retrieval, provider, first-event, completion, and end-to-end duration.
  4. Record usage and cost units without tenant names or unbounded request IDs as metric labels.
  5. Build alerts for availability, sustained throttling, queue age, latency, quality, and spend.
  6. Test redaction, trace propagation, stream cancellation, and incident correlation.
Show full SKILL.md (164 more words)Show less

Approval Boundaries

Do not expose or rotate keys, change Cohere Team roles, accept commercial terms, enable sensitive production data, increase spend or capacity, switch production models, send a support bundle, or execute model-proposed side effects without the accountable owner's approval. Keep diagnosis read-only unless implementation was requested.

Output

Return the resolved API and model contract, files or settings inspected, evidence collected, validation result, remaining risk, owner, and rollback or next action. Redact keys, authorization headers, prompts, retrieved documents, embeddings, customer identifiers, and unrestricted environment output.

Error Handling

ConditionResponse
Cardinality spikeRemove unbounded labels and aggregate request identifiers in logs only.
Prompt in traceRedact it and review retained telemetry as a data incident.
Missing terminal eventMark the stream incomplete and count a distinct outcome.
False provider alertSplit local queue/retrieval time from Cohere duration.

Examples

Use this compact handoff shape to keep the selected scope, validation evidence, and operational result reviewable.

Input:

text
service=rag-api; backend=otel; content-logging=off; quality-sampling=1%

Expected handoff:

text
metrics=bounded; traces=redacted; slo=defined; alerts=tested

Resources

© jeremylongshore, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file (references) in skills/.curated/cohere-observability of jeremylongshore/tons-of-skills-marketplace.

  • SKILL.md
  • references/official-docs.md

Open the folder on GitHubat commit cfae287

Compare with similar skills

Cohere Observability next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Cohere Observability compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Cohere Observability this skilljeremylongshore/tons-of-skills-marketplace2.8k—~1.1kAutomated safety check: PassMIT
Vercel Optimize Auditvercel-labs/agent-skills32k8 repos~4.3kAutomated safety check: PassNone
Kubeshark Installerkubeshark/kubeshark12k—~3.6kAutomated safety check: NotesApache-2.0
Kubeshark KFL2 Filter Referencekubeshark/kubeshark12k—~3.6kAutomated safety check: PassApache-2.0
KubeSphere ServiceMesh Managerkubesphere/kubesphere17k—~2.4kAutomated safety check: PassCustom licence
Kubernetes Network Root Cause Analysiskubeshark/kubeshark12k—~5.3kAutomated safety check: PassApache-2.0

Similar skills

  • Vercel Optimize Audit

    vercel-labs/agent-skills

    Official

    Runs a metrics-first audit of a deployed Vercel project, gating investigations on real signals to produce ranked, citation-backed cost and performance recommendations.

    32k GitHub starsUsed in 8 repos~4.3k tokens
    DevOps & CloudAuto-check passed
  • Kubeshark Installer

    kubeshark/kubeshark

    Installs and configures Kubeshark on a Kubernetes cluster, choosing between the quick CLI path and a Helm install with custom values.

    12k GitHub stars~3.6k tokensUpdated yesterday
    DevOps & CloudAuto-check: notes
  • Syntax reference for KFL2, the CEL-based display filter language used to search Kubernetes network traffic captured by Kubeshark, loaded before any filter is written.

    12k GitHub stars~3.6k tokensUpdated yesterday
    DevOps & CloudAuto-check passed
  • KubeSphere ServiceMesh Manager

    kubesphere/kubesphere

    Installs, checks and troubleshoots the KubeSphere ServiceMesh extension (Istio, Kiali, Jaeger), including grayscale release, sidecar injection, topology and tracing issues.

    17k GitHub stars~2.4k tokensUpdated 2 mo ago
    DevOps & CloudAuto-check passed
  • Investigates past Kubernetes incidents from Kubeshark traffic snapshots: takes captures, dissects API calls, extracts PCAPs and compares traffic over time.

    12k GitHub stars~5.3k tokensUpdated yesterday
    DevOps & CloudAuto-check passed
  • Caveman Gateway Setup

    JuliusBrussee/caveman

    Routes every LLM call in a repository through the Caveman Cloud gateway in record mode, so requests and costs are measured without changing behavior.

    111k GitHub starsUsed in 1 repo~2.6k tokens
    DevOps & CloudAuto-check: warnings

More from jeremylongshore/tons-of-skills-marketplace

All 3,342 skills in this repo
  • Performing Security Code Review

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to conduct a security-focused code review using the security-agent plugin.

    2.8k GitHub starsUsed in 2 repos~1.3k tokens
    Auto-check: notes
  • Adapting Transfer Learning Models

    jeremylongshore/tons-of-skills-marketplace

    Build this skill automates the adaptation of pre-trained machine learning models using transfer learning techniques.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Agent Context Loader

    jeremylongshore/tons-of-skills-marketplace

    Execute proactive auto-loading: automatically detects and loads agents.md files.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Aggregating Performance Metrics

    jeremylongshore/tons-of-skills-marketplace

    Aggregate and centralize performance metrics from applications, systems, databases, caches, and services.

    2.8k GitHub stars~1.2k tokensUpdated today
    Auto-check passed
  • Analyzing Capacity Planning

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to analyze capacity requirements and plan for future growth.

    2.8k GitHub stars~947 tokensUpdated today
    Auto-check passed
  • Analyzing Database Indexes

    jeremylongshore/tons-of-skills-marketplace

    Process use when you need to work with database indexing. An agent skill from jeremylongshore/tons-of-skills-marketplace.

    2.8k GitHub stars~2k tokensUpdated today
    Auto-check passed

Categories

Questions about Cohere Observability

What does Cohere Observability do?

Instrument Cohere requests, streams, retrieval, tools, limits, quality, and cost with low-cardinality telemetry and safe traces. Cohere Observability is an agent skill from jeremylongshore/tons-of-skills-marketplace. Instrument Cohere requests, streams, retrieval, tools, limits, quality, and cost with low-cardinality telemetry and safe traces.

When should I use Cohere Observability?

Cohere Observability fits situations like: monitoring a Cohere service; with Cohere observability.

How do I install Cohere Observability in Claude Code?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill cohere-observability -a claude-code`. Or copy the skill folder (skills/.curated/cohere-observability in jeremylongshore/tons-of-skills-marketplace) into .claude/skills/cohere-observability in your project. Claude Code loads it when a task matches its description.

How do I install Cohere Observability in Codex?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill cohere-observability -a codex`. Or copy the skill folder (skills/.curated/cohere-observability in jeremylongshore/tons-of-skills-marketplace) into .agents/skills/cohere-observability in your project. Codex loads it when a task matches its description.

Can I use Cohere Observability in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill cohere-observability -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/cohere-observability, .gemini/skills/cohere-observability, .github/skills/cohere-observability and .opencode/skills/cohere-observability in your project.

What does Cohere Observability need to run?

Going by SKILL.md and its folder, Cohere Observability needs credentials named CO_API_KEY. Our summary lists: A credential in CO_API_KEY. Its frontmatter pre-approves these tools: Read, Glob, Grep, WebFetch, Write, Edit. Compatibility (from SKILL.md): Designed for Claude Code; live verification requires network access and an approved Cohere API key.

Does Cohere Observability access the network?

SKILL.md names 2 domains. As links in the text: status.cohere.com and docs.cohere.com. This is read from the text; nothing was executed.

Is Cohere Observability safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Cohere Observability use?

Cohere Observability is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Cohere Observability use?

About 1.1k tokens (SKILL.md is roughly 4.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 820 tokens, read only when the agent opens those files.

What are the alternatives to Cohere Observability?

Skills that share tags, products or a category with Cohere Observability: Vercel Optimize Audit (vercel-labs/agent-skills, 32k stars), Kubeshark Installer (kubeshark/kubeshark, 12k stars), Kubeshark KFL2 Filter Reference (kubeshark/kubeshark, 12k stars) and KubeSphere ServiceMesh Manager (kubesphere/kubesphere, 17k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Cohere Observability?

jeremylongshore (a GitHub user) maintains it in jeremylongshore/tons-of-skills-marketplace, which has 2,827 GitHub stars. The repository holds 3,342 skills in this directory. The repository was last updated on October 10, 2026.

Source: jeremylongshore/tons-of-skills-marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.