Agent skill

Sentry Setup AI Monitoring

by LiorVainer in LiorVainer/data-israel

Setup Sentry AI Agent Monitoring in any project. An agent skill from LiorVainer/data-israel.

Apache-2.0Auto-check passedAI & LLM Engineering

Install Sentry Setup AI Monitoring

skills CLI
$ npx skills add LiorVainer/data-israel --skill sentry-setup-ai-monitoring -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install LiorVainer/data-israel sentry-setup-ai-monitoring --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/LiorVainer/data-israel.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/sentry-setup-ai-monitoring .claude/skills/sentry-setup-ai-monitoring && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
sentry-setup-ai-monitoring
GitHub stars
130
Token cost
~1.8k tokens
SKILL.md length
489 words
Files
1
Skills in repo
6
Repo updated
First seen
Licence
Apache-2.0

At a glance

Setup Sentry AI Agent Monitoring in any project. An agent skill from LiorVainer/data-israel.

  • Asked to monitor LLM calls
  • SKILL.md covers Invoke This Skill When, Prerequisites, Data Capture Warning and Detection First, plus 6 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Track AI agents

What it does

Sentry Setup AI Monitoring is an agent skill from LiorVainer/data-israel. Setup Sentry AI Agent Monitoring in any project. Use when asked to monitor LLM calls, track AI agents, or instrument OpenAI/Anthropic/Vercel AI/LangChain/Google GenAI/Pydantic AI. Detects installed AI SDKs and configures appropriate integrations.

Its SKILL.md is about 1.8k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in AI & LLM Engineering, covering Building AI agents. It works with Sentry, LangChain, OpenAI and Vercel. The repository describes itself as: AI agent network that connects to Israeli open data sources - ask questions in Hebrew, get answers grounded in real data with charts and sources. The licence is Apache-2.0.

When your agent uses it

  • Asked to monitor LLM calls
  • Track AI agents
  • Instrument OpenAI/Anthropic/Vercel AI/LangChain/Google GenAI/Pydantic AI

Example prompts

  • “/sentry-setup-ai-monitoring”

Requirements

  • Python 3
  • Node.js

What it can do on your machine

Read from SKILL.md and the folder at commit 6522504. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are javascript, bash and python).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • docs.sentry.io

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Sentry Setup AI Monitoring loads about 1.8k tokens when it runs. Until then it costs about 68 tokens; SKILL.md has 489 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~68
When it runs · the whole SKILL.md, loaded when a task matches
~1.8k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from LiorVainer/data-israel at commit 6522504, republished under its Apache-2.0 licence (© LiorVainer). 489 words, ~1,819 tokens.

Download SKILL.mdSave it as .claude/skills/sentry-setup-ai-monitoring/SKILL.md (or your agent's skills folder).
name
sentry-setup-ai-monitoring
description
Setup Sentry AI Agent Monitoring in any project. Use when asked to monitor LLM calls, track AI agents, or instrument OpenAI/Anthropic/Vercel AI/LangChain/Google GenAI/Pydantic AI. Detects installed AI SDKs and configures appropriate integrations.
license
Apache-2.0

Setup Sentry AI Agent Monitoring

Configure Sentry to track LLM calls, agent executions, tool usage, and token consumption.

Invoke This Skill When

  • User asks to "monitor AI/LLM calls" or "track OpenAI/Anthropic usage"
  • User wants "AI observability" or "agent monitoring"
  • User asks about token usage, model latency, or AI costs

Important: The SDK versions, API names, and code samples below are examples. Always verify against docs.sentry.io before implementing, as APIs and minimum versions may have changed.

Prerequisites

AI monitoring requires tracing enabled (tracesSampleRate > 0).

Data Capture Warning

Prompt and output recording captures user content that is likely PII. Before enabling recordInputs/recordOutputs (JS) or include_prompts/send_default_pii (Python), confirm:

  • The application's privacy policy permits capturing user prompts and model responses
  • Captured data complies with applicable regulations (GDPR, CCPA, etc.)
  • Sentry data retention settings are appropriate for the sensitivity of the data

Ask the user whether they want prompt/output capture enabled. Do not enable it by default — configure it only when explicitly requested or confirmed. Use tracesSampleRate: 1.0 only in development; in production, use a lower value or a tracesSampler function.

Detection First

Always detect installed AI SDKs before configuring:

bash
# JavaScript
grep -E '"(openai|@anthropic-ai/sdk|ai|@langchain|@google/genai)"' package.json

# Python
grep -E '(openai|anthropic|langchain|huggingface)' requirements.txt pyproject.toml 2>/dev/null

Supported SDKs

JavaScript
PackageIntegrationMin Sentry SDKAuto?
openaiopenAIIntegration()10.28.0Yes
@anthropic-ai/sdkanthropicAIIntegration()10.28.0Yes
ai (Vercel)vercelAIIntegration()10.6.0Yes*
@langchain/*langChainIntegration()10.28.0Yes
@langchain/langgraphlangGraphIntegration()10.28.0Yes
@google/genaigoogleGenAIIntegration()10.28.0Yes

*Vercel AI: 10.6.0+ for Node.js, Cloudflare Workers, Vercel Edge Functions, Bun. 10.12.0+ for Deno. Requires experimental_telemetry per-call.

Python

Integrations auto-enable when the AI package is installed — no explicit registration needed:

PackageAuto?Notes
openaiYesIncludes OpenAI Agents SDK
anthropicYes
langchain / langgraphYes
huggingface_hubYes
google-genaiYes
pydantic-aiYes
litellmNoRequires explicit integration
mcp (Model Context Protocol)Yes

JavaScript Configuration

Show full SKILL.md (208 more words)Show less
Node.js — auto-enabled integrations

Just ensure tracing is enabled. Integrations auto-enable when the AI package is installed:

javascript
Sentry.init({
  dsn: "YOUR_DSN",
  tracesSampleRate: 1.0, // Lower in production (e.g., 0.1)
  // OpenAI, Anthropic, Google GenAI, LangChain integrations auto-enable in Node.js
});

To customize (e.g., enable prompt capture — see Data Capture Warning):

javascript
integrations: [
  Sentry.openAIIntegration({
    // recordInputs: true,  // Opt-in: captures prompt content (PII)
    // recordOutputs: true, // Opt-in: captures response content (PII)
  }),
],
Browser / Next.js OpenAI (manual wrapping required)

In browser-side code or Next.js meta-framework apps, auto-instrumentation is not available. Wrap the client manually:

javascript
import OpenAI from "openai";
import * as Sentry from "@sentry/nextjs"; // or @sentry/react, @sentry/browser

const openai = Sentry.instrumentOpenAiClient(new OpenAI());
// Use 'openai' client as normal
LangChain / LangGraph (auto-enabled)
javascript
integrations: [
  Sentry.langChainIntegration({
    // recordInputs: true,  // Opt-in: captures prompt content (PII)
    // recordOutputs: true, // Opt-in: captures response content (PII)
  }),
  Sentry.langGraphIntegration({
    // recordInputs: true,
    // recordOutputs: true,
  }),
],
Vercel AI SDK

Add to sentry.edge.config.ts for Edge runtime:

javascript
integrations: [Sentry.vercelAIIntegration()],

Enable telemetry per-call:

javascript
await generateText({
  model: openai("gpt-4o"),
  prompt: "Hello",
  experimental_telemetry: {
    isEnabled: true,
    // recordInputs: true,  // Opt-in: captures prompt content (PII)
    // recordOutputs: true, // Opt-in: captures response content (PII)
  },
});

Python Configuration

Integrations auto-enable — just init with tracing. Only add explicit imports to customize options:

python
import sentry_sdk

sentry_sdk.init(
    dsn="YOUR_DSN",
    traces_sample_rate=1.0,  # Lower in production (e.g., 0.1)
    # send_default_pii=True,  # Opt-in: required for prompt capture (sends user PII)
    # Integrations auto-enable when the AI package is installed.
    # Only specify explicitly to customize (e.g., include_prompts):
    # integrations=[OpenAIIntegration(include_prompts=True)],
)

Manual Instrumentation

Use when no supported SDK is detected.

Span Types
op ValuePurpose
gen_ai.requestIndividual LLM calls
gen_ai.invoke_agentAgent execution lifecycle
gen_ai.execute_toolTool/function calls
gen_ai.handoffAgent-to-agent transitions
Example (JavaScript)
javascript
await Sentry.startSpan({
  op: "gen_ai.request",
  name: "LLM request gpt-4o",
  attributes: { "gen_ai.request.model": "gpt-4o" },
}, async (span) => {
  span.setAttribute("gen_ai.request.messages", JSON.stringify(messages));
  const result = await llmClient.complete(prompt);
  span.setAttribute("gen_ai.usage.input_tokens", result.inputTokens);
  span.setAttribute("gen_ai.usage.output_tokens", result.outputTokens);
  return result;
});
Key Attributes
AttributeDescription
gen_ai.request.modelModel identifier
gen_ai.request.messagesJSON input messages
gen_ai.usage.input_tokensInput token count
gen_ai.usage.output_tokensOutput token count
gen_ai.agent.nameAgent identifier
gen_ai.tool.nameTool identifier

Enable prompt/output capture only after confirming with the user (see Data Capture Warning above).

Verification

After configuring, make an LLM call and check the Sentry Traces dashboard. AI spans appear with gen_ai.* operations showing model, token counts, and latency.

Troubleshooting

IssueSolution
AI spans not appearingVerify tracesSampleRate > 0, check SDK version
Token counts missingSome providers don't return tokens for streaming
Prompts not capturedEnable recordInputs/include_prompts
Vercel AI not workingAdd experimental_telemetry to each call

© LiorVainer, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in .agents/skills/sentry-setup-ai-monitoring of LiorVainer/data-israel.

Open the folder on GitHubat commit 6522504

Compare with similar skills

Sentry Setup AI Monitoring next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Sentry Setup AI Monitoring compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Sentry Setup AI Monitoring this skillLiorVainer/data-israel130—~1.8kAutomated safety check: PassApache-2.0
Sentry Setup AI Monitoringgetsentry/sentry-for-ai268—~5.5kAutomated safety check: NotesApache-2.0
Sentry Instrumentgetsentry/sentry-for-ai268—~3.2kAutomated safety check: PassApache-2.0
Add Example AgentGetBindu/Bindu10k—~1.1kAutomated safety check: NotesCustom licence
Failproof AI SDK IntegrationFailproofAI/failproofai5.3k—~6kAutomated safety check: PassCustom licence
Upgrade Stripekanchengw/cnllm1733 repos~1.4kAutomated safety check: PassApache-2.0

Similar skills

  • Sentry Setup AI Monitoring

    getsentry/sentry-for-ai

    Official

    Setup Sentry AI Agent Monitoring in any project. An agent skill from getsentry/sentry-for-ai.

    268 GitHub stars~5.5k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check: notes
  • Sentry Instrument

    getsentry/sentry-for-ai

    Official

    Instrument an application with Sentry — detect the platform, install and initialize the SDK if needed, and wire up any signal — error monitoring, tracing/performance, logging, metrics, profiling…

    268 GitHub stars~3.2k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed
  • Add Example Agent

    GetBindu/Bindu

    Add a new self-contained example agent under examples/. An agent skill from GetBindu/Bindu.

    10k GitHub stars~1.1k tokensUpdated 1 mo ago
    AI & LLM EngineeringAuto-check: notes
  • Failproof AI SDK Integration

    FailproofAI/failproofai

    Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.

    5.3k GitHub stars~6k tokensUpdated 4 days ago
    AI & LLM EngineeringAuto-check passed
  • Upgrade Stripe

    kanchengw/cnllm

    Guide for upgrading Stripe API versions and SDKs. An agent skill from kanchengw/cnllm.

    173 GitHub starsUsed in 3 repos~1.4k tokens
    AI & LLM EngineeringAuto-check passed
  • Official

    Migrates Python LangChain Deep Agents applications to Pydantic AI and Pydantic AI Harness while preserving the application's observed behavior.

    21k GitHub stars~1.7k tokensUpdated today
    AI & LLM EngineeringAuto-check passed

More from LiorVainer/data-israel

  • Mastra

    LiorVainer/data-israel

    Comprehensive Mastra framework guide. An agent skill from LiorVainer/data-israel.

    130 GitHub starsUsed in 2 repos~1.6k tokens
    Auto-check passed
  • Access and compare Israeli supermarket prices using mandatory Price Transparency Law data feeds.

    130 GitHub stars~2.3k tokensUpdated 5 mo ago
    Auto-check passed
  • Backlog

    LiorVainer/data-israel

    This skill should be used when the user asks to 'add to backlog', 'create a backlog item', 'show backlog', 'list backlog tasks', 'what's in the backlog', 'move to backlog', 'check backlog', 'backlog…

    130 GitHub stars~1.3k tokensUpdated 5 mo ago
    Auto-check passed
  • Govmap API

    LiorVainer/data-israel

    This skill should be used when the user asks about 'GovMap layers', 'GovMap API', 'map layers', 'entitiesByPoint', 'layer metadata', 'govmap endpoints', 'what layers are available', 'query map data…

    130 GitHub stars~1.7k tokensUpdated 5 mo ago
    Auto-check passed
  • Add Data Source

    LiorVainer/data-israel

    This skill should be used when the user asks to 'add a data source', 'create a new data source', 'add a new API', 'integrate a new data provider', 'add new tools', or mentions adding Israeli…

    130 GitHub stars~2.6k tokensUpdated 5 mo ago
    Auto-check: notes

Questions about Sentry Setup AI Monitoring

What does Sentry Setup AI Monitoring do?

Setup Sentry AI Agent Monitoring in any project. An agent skill from LiorVainer/data-israel. Sentry Setup AI Monitoring is an agent skill from LiorVainer/data-israel. Setup Sentry AI Agent Monitoring in any project.

When should I use Sentry Setup AI Monitoring?

Sentry Setup AI Monitoring fits situations like: asked to monitor LLM calls; track AI agents; instrument OpenAI/Anthropic/Vercel AI/LangChain/Google GenAI/Pydantic AI.

How do I install Sentry Setup AI Monitoring in Claude Code?

Run `npx skills add LiorVainer/data-israel --skill sentry-setup-ai-monitoring -a claude-code`. Or copy the skill folder (.agents/skills/sentry-setup-ai-monitoring in LiorVainer/data-israel) into .claude/skills/sentry-setup-ai-monitoring in your project. Claude Code loads it when a task matches its description.

How do I install Sentry Setup AI Monitoring in Codex?

Run `npx skills add LiorVainer/data-israel --skill sentry-setup-ai-monitoring -a codex`. Or copy the skill folder (.agents/skills/sentry-setup-ai-monitoring in LiorVainer/data-israel) into .agents/skills/sentry-setup-ai-monitoring in your project. Codex loads it when a task matches its description.

Can I use Sentry Setup AI Monitoring in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add LiorVainer/data-israel --skill sentry-setup-ai-monitoring -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/sentry-setup-ai-monitoring, .gemini/skills/sentry-setup-ai-monitoring, .github/skills/sentry-setup-ai-monitoring and .opencode/skills/sentry-setup-ai-monitoring in your project.

What does Sentry Setup AI Monitoring need to run?

SKILL.md names no scripts, command-line tools or credentials: Sentry Setup AI Monitoring is instructions for the agent only. Our summary lists: Python 3; Node.js.

Does Sentry Setup AI Monitoring access the network?

SKILL.md names 1 domain. As links in the text: docs.sentry.io. This is read from the text; nothing was executed.

Is Sentry Setup AI Monitoring safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Sentry Setup AI Monitoring use?

Sentry Setup AI Monitoring is published under the Apache-2.0 licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Sentry Setup AI Monitoring use?

About 1.8k tokens (SKILL.md is roughly 7.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Sentry Setup AI Monitoring?

Skills that share tags, products or a category with Sentry Setup AI Monitoring: Sentry Setup AI Monitoring (getsentry/sentry-for-ai, 268 stars), Sentry Instrument (getsentry/sentry-for-ai, 268 stars), Add Example Agent (GetBindu/Bindu, 10k stars) and Failproof AI SDK Integration (FailproofAI/failproofai, 5.3k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Sentry Setup AI Monitoring?

LiorVainer (a GitHub user) maintains it in LiorVainer/data-israel, which has 130 GitHub stars. The repository holds 6 skills in this directory. The repository was last updated on May 13, 2026.

Source: LiorVainer/data-israel on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.