New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Official agent skill

Monitoring Ingestion Pipeline

by PostHog in PostHog/posthog

Guide for using the Grafana MCP to monitor and diagnose the Node.js ingestion pipeline workers in production.

OfficialCustom licenceAuto-check passedDevOps & Cloud

Install Monitoring Ingestion Pipeline

skills CLI
$ npx skills add PostHog/posthog --skill monitoring-ingestion-pipeline -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install PostHog/posthog monitoring-ingestion-pipeline --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/PostHog/posthog.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/monitoring-ingestion-pipeline .claude/skills/monitoring-ingestion-pipeline && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
monitoring-ingestion-pipeline
GitHub stars
40k
Token cost
~9.1k tokens
SKILL.md length
2,243 words
Files
2 (incl. references)
Skills in repo
254
Repo updated
First seen
Licence
Custom licence

At a glance

Guide for using the Grafana MCP to monitor and diagnose the Node.js ingestion pipeline workers in production.

  • Works in 3 steps: MSK ingestion cluster (consume side) —… → WarpStream ingestion VC (output side) —… → MSK ingestion cluster (feedback/DLQ…
  • Investigating event lag
  • SKILL.md covers Environment context, Observability landscape, Stable waypoints and Discovery workflows, plus 2 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Monitoring Ingestion Pipeline is an agent skill from PostHog/posthog, published by the product's own GitHub organization. Guide for using the Grafana MCP to monitor and diagnose the Node.js ingestion pipeline workers in production. Use when investigating event lag, drops, pipeline errors, person/group processing, Kafka consumer health, Redis, Postgres, ClickHouse downstream health, or any ingestion worker question. Covers prod-us and prod-eu environments.

Its SKILL.md is about 9.1k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including reference files (for example `references/investigation-playbooks.md`).

It sits in DevOps & Cloud, covering Monitoring and alerting, Data warehousing and Event-driven systems. It works with Grafana, Model Context Protocol, Node.js and ClickHouse. The repository describes itself as: :hedgehog: PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, flags, experiments, error…

When your agent uses it

  • Investigating event lag
  • Pipeline errors
  • Person/group processing
  • Kafka consumer health

Example prompts

  • “/monitoring-ingestion-pipeline”

Requirements

  • Node.js

Workflow steps

3 steps, taken from the first numbered list in SKILL.md.

  1. MSK ingestion cluster (consume side) — KAFKA_CONSUMER_METADATA_BROKER_LIST.
  2. WarpStream ingestion VC (output side) — KAFKA_WARPSTREAM_PRODUCER_METADATA_BROKER_LIST.
  3. MSK ingestion cluster (feedback/DLQ producer) — same physical cluster as item 1,

What it can do on your machine

Read from SKILL.md and the folder at commit c012c8d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Monitoring Ingestion Pipeline loads about 9.1k tokens when it runs, and up to ~14k if it reads all its reference files. Until then it costs about 92 tokens; SKILL.md has 2,243 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~92
When it runs · the whole SKILL.md, loaded when a task matches
~9.1k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~14k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 2,243 words (~9,137 tokens).

“The ingestion pipeline (nodejs/) is PostHog's Node.js event processing layer. It consumes events from Kafka (produced by the capture service), runs them through processing steps (person resolution, group assignment, property overrides, etc.), and produces enriched events to ClickHouse-bound Kafka topics.”

— opening of SKILL.md by PostHog, Custom licence
name
monitoring-ingestion-pipeline

Read the full SKILL.md on GitHub

Files

SKILL.md and 1 other file (references) in .agents/skills/monitoring-ingestion-pipeline of PostHog/posthog.

  • SKILL.md
  • references/investigation-playbooks.md

Open the folder on GitHubat commit c012c8d

Used in 1 other repository

We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders. This page covers the copy in PostHog/posthog, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Monitoring Ingestion Pipeline next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Monitoring Ingestion Pipeline compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Monitoring Ingestion Pipeline this skillPostHog/posthog40k—~9.1kAutomated safety check: PassCustom licence
Clickhouse Observabilityjeremylongshore/tons-of-skills-marketplace2.8k—~1.4kAutomated safety check: PassMIT
Datasources Provisioninggrafana/skills282—~2.8kAutomated safety check: PassApache-2.0
Ops Reporthaacked/dotfiles134—~8kAutomated safety check: NotesNone
Opensourcefaqdigoal/blog8.6k—~966Automated safety check: PassGPL-2.0
Clickhouse Webhooks Eventsjeremylongshore/tons-of-skills-marketplace2.8k—~1.7kAutomated safety check: PassMIT

Similar skills

  • Clickhouse Observability

    jeremylongshore/tons-of-skills-marketplace

    Monitor ClickHouse with Prometheus metrics, Grafana dashboards, system table queries, and alerting for query performance, merge health, and resource usage.

    2.8k GitHub stars~1.4k tokensUpdated today
    DevOps & CloudAuto-check passed

  • Datasources Provisioning

    grafana/skills

    Official

    Generate a copy-paste Grafana data source provisioning file (YAML or Terraform) for any plugin from its standardized settings schema on the plugins CDN.

    282 GitHub stars~2.8k tokensUpdated 2 days ago
    DevOps & CloudAuto-check passed

  • Ops Report

    haacked/dotfiles

    Generate a 24-hour operational health report for a PostHog service by querying Grafana dashboards and Prometheus metrics.

    134 GitHub stars~8k tokensUpdated yesterday
    DevOps & CloudAuto-check: notes

  • Opensourcefaq

    digoal/blog

    解答与开源产品有关的深度技术问题，输出图文并茂的 Markdown 技术文章。触发条件：用户提出与开源项目（如 PostgreSQL、Redis、Kafka、Kubernetes、ClickHouse、Flink 等）相关的技术问题，并提供源码目录或 URL、deepwiki repo 名称。即使用户只说"帮我解答这个开源问题"或"分析一下这个项目的某个机制"，也应使用本…

    8.6k GitHub stars~966 tokensUpdated yesterday
    DatabasesAuto-check passed

  • Clickhouse Webhooks Events

    jeremylongshore/tons-of-skills-marketplace

    Ingest data into ClickHouse from webhooks, Kafka, and streaming sources with batching, dedup, and exactly-once patterns.

    2.8k GitHub stars~1.7k tokensUpdated today
    Backend & APIsAuto-check passed

  • AWS Storage

    aws/agent-toolkit-for-aws

    Official

    Selects, investigates, and compares AWS object, file, and block storage services, and answers cost, performance, configuration, security, and troubleshooting questions about storage services.

    2.8k GitHub stars~5.8k tokensUpdated yesterday
    DatabasesAuto-check passed

More from PostHog/posthog

All 254 skills in this repo

  • Authoring Log Alerts

    PostHog/posthog

    Official

    Author useful, low-noise log alerts on services in a PostHog project.

    40k GitHub stars~3k tokensUpdated today
    Auto-check passed

  • Autoresolving PR Conflicts

    PostHog/posthog

    Official

    Operating procedure for the conflict-autoresolver agent: sweep open PostHog/posthog PRs that conflict with master, resolve the trivial conflicts (generated artifacts deterministically, source…

    40k GitHub stars~4.2k tokensUpdated today
    Auto-check passed

  • Diagnosing Stacktrace Symbolication

    PostHog/posthog

    Official

    Help users debug PostHog Error Tracking stack-trace symbolication for any supported platform — JavaScript/TypeScript web, React Native (Hermes), Android (Proguard / R8), or iOS / macOS (dSYM).

    40k GitHub stars~2.2k tokensUpdated today
    Auto-check passed

  • Exploring Apm Traces

    PostHog/posthog

    Official

    Investigates distributed application performance using PostHog APM (OpenTelemetry span) data via MCP.

    40k GitHub stars~3.5k tokensUpdated today
    Auto-check passed

  • Exploring LLM Traces

    PostHog/posthog

    Official

    Debug and inspect LLM/AI agent traces using PostHog's MCP tools.

    40k GitHub stars~4.4k tokensUpdated today
    Auto-check passed

  • Investigate Metric

    PostHog/posthog

    Official

    Diagnose why a product metric changed (dropped, spiked, or plateaued) by orchestrating breakdowns, actors, paths, lifecycle, retention, and annotations queries.

    40k GitHub stars~1.9k tokensUpdated today
    Auto-check passed

Works with

Categories

Questions about Monitoring Ingestion Pipeline

What does Monitoring Ingestion Pipeline do?

Guide for using the Grafana MCP to monitor and diagnose the Node.js ingestion pipeline workers in production. Monitoring Ingestion Pipeline is an agent skill from PostHog/posthog, published by the product's own GitHub organization.js ingestion pipeline workers in production.

When should I use Monitoring Ingestion Pipeline?

Monitoring Ingestion Pipeline fits situations like: investigating event lag; pipeline errors; person/group processing; kafka consumer health.

How do I install Monitoring Ingestion Pipeline in Claude Code?

Run `npx skills add PostHog/posthog --skill monitoring-ingestion-pipeline -a claude-code`. Or copy the skill folder (.agents/skills/monitoring-ingestion-pipeline in PostHog/posthog) into .claude/skills/monitoring-ingestion-pipeline in your project. Claude Code loads it when a task matches its description.

How do I install Monitoring Ingestion Pipeline in Codex?

Run `npx skills add PostHog/posthog --skill monitoring-ingestion-pipeline -a codex`. Or copy the skill folder (.agents/skills/monitoring-ingestion-pipeline in PostHog/posthog) into .agents/skills/monitoring-ingestion-pipeline in your project. Codex loads it when a task matches its description.

Can I use Monitoring Ingestion Pipeline in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add PostHog/posthog --skill monitoring-ingestion-pipeline -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/monitoring-ingestion-pipeline, .gemini/skills/monitoring-ingestion-pipeline, .github/skills/monitoring-ingestion-pipeline and .opencode/skills/monitoring-ingestion-pipeline in your project.

What does Monitoring Ingestion Pipeline need to run?

SKILL.md names no scripts, command-line tools or credentials: Monitoring Ingestion Pipeline is instructions for the agent only. Our summary lists: Node.js.

Does Monitoring Ingestion Pipeline access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Monitoring Ingestion Pipeline safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Monitoring Ingestion Pipeline use?

Monitoring Ingestion Pipeline has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Monitoring Ingestion Pipeline use?

About 9.1k tokens (SKILL.md is roughly 37k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 5.2k tokens, read only when the agent opens those files.

What are the alternatives to Monitoring Ingestion Pipeline?

Skills that share tags, products or a category with Monitoring Ingestion Pipeline: Clickhouse Observability (jeremylongshore/tons-of-skills-marketplace, 2.8k stars), Datasources Provisioning (grafana/skills, 282 stars), Ops Report (haacked/dotfiles, 134 stars) and Opensourcefaq (digoal/blog, 8.6k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Monitoring Ingestion Pipeline?

PostHog (a GitHub organization, an official publisher) maintains it in PostHog/posthog, which has 40,209 GitHub stars. The repository holds 254 skills in this directory. The repository was last updated on October 10, 2026.

Source: PostHog/posthog on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.