Agent skill

Doctrine Batch Processing

by dev-toolings in dev-toolings/superpowers-symfony

Process large datasets with Doctrine (ORM 3 toIterable, flush+clear, bulk DQL) and memory management

MITAuto-check: notesDatabases

Install Doctrine Batch Processing

skills CLI
$ npx skills add dev-toolings/superpowers-symfony --skill doctrine-batch-processing -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install dev-toolings/superpowers-symfony doctrine-batch-processing --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/dev-toolings/superpowers-symfony.git skills-src && mkdir -p .claude/skills && cp -r skills-src/content/skills/doctrine-batch-processing .claude/skills/doctrine-batch-processing && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
doctrine-batch-processing
GitHub stars
222
Token cost
~464 tokens
SKILL.md length
230 words
Files
2
Skills in repo
44
Repo updated
First seen
Licence
MIT

At a glance

Process large datasets with Doctrine (ORM 3 toIterable, flush+clear, bulk DQL) and memory management

  • Works in 5 steps: Measure the dataset size and the memory… → Stream reads with toIterable(), or… → Flush and clear() every N items, and… → …
  • Tasks that involve Data pipelines and ETL
  • SKILL.md covers Use when, Default workflow, Guardrails and Progressive disclosure, plus 2 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Doctrine Batch Processing is an agent skill from dev-toolings/superpowers-symfony. Process large datasets with Doctrine (ORM 3 toIterable, flush+clear, bulk DQL) and memory management

Its SKILL.md is about 460 tokens, which your agent loads only when the skill is triggered. The skill folder holds 1 other file (for example `reference.md`).

It sits in Databases, covering Data pipelines and ETL and ORMs and data access. The repository describes itself as: Claude Code plugin for Symfony 7.4 LTS & 8.x — 44 skills, 7 AI subagents & 13 commands for API Platform v4, Doctrine ORM 3, TDD (Pest/PHPUnit), Messenger, security & DDD. The licence is MIT.

When your agent uses it

  • Tasks that involve Data pipelines and ETL
  • Tasks that involve ORMs and data access

Example prompts

  • “/doctrine-batch-processing”

Requirements

  • Pre-approved tools (allowed-tools): Read, Glob, Grep, Write, Edit, Bash

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. Measure the dataset size and the memory budget of the process.
  2. Stream reads with toIterable(), or paginate by id (id > :lastId) for very large tables.
  3. Flush and clear() every N items, and re-fetch anything needed after a clear.
  4. Use DQL UPDATE/DELETE or DBAL for bulk writes that need no hydration.
  5. Log memory usage and progress, and make the run resumable.

What it can do on your machine

Read from SKILL.md and the folder at commit 459bcd0. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Glob
    • Grep
    • Write
    • Edit
    • Bash

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Doctrine Batch Processing loads about 464 tokens when it runs. Until then it costs about 32 tokens; SKILL.md has 230 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~32
When it runs · the whole SKILL.md, loaded when a task matches
~464

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: notes

The automated check noted patterns worth knowing about, such as sudo or a known installer.

  • NotePre-approves every shell command (allowed-tools: Bash)SKILL.md
    allowed-tools: Read, Glob, Grep, Write, Edit, Bash

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from dev-toolings/superpowers-symfony at commit 459bcd0, republished under its MIT licence (© dev-toolings). 230 words, ~464 tokens.

Download SKILL.mdSave it as .claude/skills/doctrine-batch-processing/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
doctrine-batch-processing
description
Process large datasets with Doctrine (ORM 3 toIterable, flush+clear, bulk DQL) and memory management
allowed-tools
Read, Glob, Grep, Write, Edit, Bash
capabilities
read, search, edit, shell
tags
doctrine, performance

Doctrine Batch Processing (Symfony)

Use when

  • Processing more rows than fit in memory: imports, exports, backfills.
  • A command or worker runs out of memory iterating over entities.
  • Updating or deleting many rows at once.
  • Inserting large volumes through Doctrine or DBAL.

Default workflow

  1. Measure the dataset size and the memory budget of the process.
  2. Stream reads with toIterable(), or paginate by id (id > :lastId) for very large tables.
  3. Flush and clear() every N items, and re-fetch anything needed after a clear.
  4. Use DQL UPDATE/DELETE or DBAL for bulk writes that need no hydration.
  5. Log memory usage and progress, and make the run resumable.

Guardrails

  • Never findAll() on a table that grows.
  • Entities loaded before a clear() are detached: do not modify or persist them.
  • Bulk DQL and DBAL skip lifecycle events and listeners. Check what relies on them.
  • On ORM 3, Query#iterate() and setSQLLogger() are gone: use toIterable() and a logging middleware.
  • Paginate by id rather than by offset: offsets get slower and skip rows when data moves.

Progressive disclosure

  • Use this file for execution posture and risk controls.
  • Open references when deep implementation details are needed.

Output contract

  • A batch loop with an explicit batch size and clear points.
  • The choice between ORM, DQL bulk and DBAL for each write, with the reason.
  • Memory measurements before and after on a realistic volume.

References

  • reference.md

© dev-toolings, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file in content/skills/doctrine-batch-processing of dev-toolings/superpowers-symfony.

  • SKILL.md
  • reference.md

Open the folder on GitHubat commit 459bcd0

Compare with similar skills

Doctrine Batch Processing next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Doctrine Batch Processing compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Doctrine Batch Processing this skilldev-toolings/superpowers-symfony222—~464Automated safety check: NotesMIT
DB SculptorEliasOulkadi/shokunin114—~3.1kAutomated safety check: NotesMIT
Clickhouse IohellangleZ/burn-in-cceverywhere-ralph11214 repos~2.5kAutomated safety check: PassNone
Analyzing Dataastronomer/agents450—~1.3kAutomated safety check: PassApache-2.0
Tinybird Datafile RulesTryGhost/Ghost55k—~417Automated safety check: PassMIT
Optimizing Databricks SQLAltimateAI/data-engineering-skills127—~6.7kAutomated safety check: PassMIT

Similar skills

  • DB Sculptor

    EliasOulkadi/shokunin

    Design database schemas with Prisma/Drizzle, PostgreSQL index strategy (B-tree, GIN, GiST, BRIN, Hash), query optimization (EXPLAIN ANALYZE), migration safety (expand/contract, zero-downtime), and…

    114 GitHub stars~3.1k tokensUpdated 3 days ago
    DatabasesAuto-check: notes
  • Clickhouse Io

    hellangleZ/burn-in-cceverywhere-ralph

    ClickHouse database patterns, query optimization, analytics, and data engineering best practices for high-performance analytical workloads.

    112 GitHub starsUsed in 14 repos~2.5k tokens
    DatabasesAuto-check passed
  • Analyzing Data

    astronomer/agents

    Queries the data warehouse with SQL and answers business questions about data.

    450 GitHub stars~1.3k tokensUpdated 2 days ago
    DatabasesAuto-check passed
  • Rules for writing Tinybird datasources, pipes, endpoints and materialized views, with SQL constraints, optimization habits and deduplication patterns.

    55k GitHub stars~417 tokensUpdated yesterday
    DatabasesAuto-check passed
  • Optimizing Databricks SQL

    AltimateAI/data-engineering-skills

    Analyze DBSQL queries, including SQL embedded in notebooks (spark.sql(...), %sql cells), for anti-patterns, lint issues, and performance problems, using Databricks-specific dialect and platform…

    127 GitHub stars~6.7k tokensUpdated 6 days ago
    DatabasesAuto-check passed
  • Batch Processing Clinical Text

    maziyarpanahi/openmed

    Run large-scale batch NER, PII extraction, or de-identification over many clinical notes on-device with OpenMed, with sharding, checkpointing, resumability, and append-only JSONL output.

    5.5k GitHub stars~2.2k tokensUpdated 2 days ago
    DatabasesAuto-check passed

More from dev-toolings/superpowers-symfony

All 44 skills in this repo
  • Symfony Scheduler

    dev-toolings/superpowers-symfony

    Schedule recurring tasks with the Symfony Scheduler component (native since 7.x); define schedules, triggers, and integrate with Messenger

    222 GitHub stars~526 tokensUpdated 2 days ago
    Auto-check: notes
  • API Platform Dto Resources

    dev-toolings/superpowers-symfony

    Map entities to API DTOs in API Platform (v5, 4.4, 4.3) with the Symfony Object Mapper ([Map], stateOptions) for decoupled input/output contracts

    222 GitHub stars~593 tokensUpdated 2 days ago
    Auto-check: notes
  • API Platform Filters

    dev-toolings/superpowers-symfony

    Implement API Platform filters - Parameters API (QueryParameter, v5/4.4/4.3) and the [ApiFilter] attribute deprecated since 4.4 - for search, date, range, boolean, and custom filtering

    222 GitHub stars~610 tokensUpdated 2 days ago
    Auto-check: notes
  • API Platform Resources

    dev-toolings/superpowers-symfony

    Configure API Platform resources (v5, 4.4, 4.3) with explicit operations, pagination, and typed OpenAPI for clean, versioned REST/GraphQL APIs

    222 GitHub stars~560 tokensUpdated 2 days ago
    Auto-check: notes
  • API Platform Security

    dev-toolings/superpowers-symfony

    Secure API Platform resources with security expressions, voters, securityPostValidation, and operation-level access control

    222 GitHub stars~551 tokensUpdated 2 days ago
    Auto-check: notes
  • API Platform Serialization

    dev-toolings/superpowers-symfony

    Control API Platform serialization with groups, [Context], IRI links (readableLink/writableLink), and custom context builders

    222 GitHub stars~519 tokensUpdated 2 days ago
    Auto-check: notes

Questions about Doctrine Batch Processing

What does Doctrine Batch Processing do?

Process large datasets with Doctrine (ORM 3 toIterable, flush+clear, bulk DQL) and memory management. Doctrine Batch Processing is an agent skill from dev-toolings/superpowers-symfony.

When should I use Doctrine Batch Processing?

Doctrine Batch Processing fits situations like: tasks that involve Data pipelines and ETL; tasks that involve ORMs and data access.

How do I install Doctrine Batch Processing in Claude Code?

Run `npx skills add dev-toolings/superpowers-symfony --skill doctrine-batch-processing -a claude-code`. Or copy the skill folder (content/skills/doctrine-batch-processing in dev-toolings/superpowers-symfony) into .claude/skills/doctrine-batch-processing in your project. Claude Code loads it when a task matches its description.

How do I install Doctrine Batch Processing in Codex?

Run `npx skills add dev-toolings/superpowers-symfony --skill doctrine-batch-processing -a codex`. Or copy the skill folder (content/skills/doctrine-batch-processing in dev-toolings/superpowers-symfony) into .agents/skills/doctrine-batch-processing in your project. Codex loads it when a task matches its description.

Can I use Doctrine Batch Processing in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add dev-toolings/superpowers-symfony --skill doctrine-batch-processing -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/doctrine-batch-processing, .gemini/skills/doctrine-batch-processing, .github/skills/doctrine-batch-processing and .opencode/skills/doctrine-batch-processing in your project.

What does Doctrine Batch Processing need to run?

SKILL.md names no scripts, command-line tools or credentials: Doctrine Batch Processing is instructions for the agent only. Its frontmatter pre-approves these tools: Read, Glob, Grep, Write, Edit, Bash.

Does Doctrine Batch Processing access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Doctrine Batch Processing safe to install?

Our automated static check of SKILL.md found notes only (pre-approves every shell command (allowed-tools: bash)), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.

What licence does Doctrine Batch Processing use?

Doctrine Batch Processing is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Doctrine Batch Processing use?

About 464 tokens (SKILL.md is roughly 1.9k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Doctrine Batch Processing?

Skills that share tags, products or a category with Doctrine Batch Processing: DB Sculptor (EliasOulkadi/shokunin, 114 stars), Clickhouse Io (hellangleZ/burn-in-cceverywhere-ralph, 112 stars), Analyzing Data (astronomer/agents, 450 stars) and Tinybird Datafile Rules (TryGhost/Ghost, 55k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Doctrine Batch Processing?

dev-toolings (a GitHub organization) maintains it in dev-toolings/superpowers-symfony, which has 222 GitHub stars. The repository holds 44 skills in this directory. The repository was last updated on October 5, 2026.

Source: dev-toolings/superpowers-symfony on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.