Caching Architecture
majiayu000/litellm-rs
LiteLLM-RS response caching architecture. An agent skill from majiayu000/litellm-rs.
Change the LLM Gateway request path in apps/gateway — chat and other endpoints, routing and provider selection, error and finish-reason classification, streaming, request logging, Redis use…
$ npx skills add theopenco/llmgateway --skill gateway -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install theopenco/llmgateway gateway --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/theopenco/llmgateway.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/gateway .claude/skills/gateway && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "gateway" agent skill from https://github.com/theopenco/llmgateway/tree/main/.agents/skills/gateway into .claude/skills/gateway/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gateway", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/theopenco/llmgateway/tree/main/.agents/skills/gatewayType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add theopenco/llmgateway --skill gateway -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install theopenco/llmgateway gateway --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/theopenco/llmgateway.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/gateway .agents/skills/gateway && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "gateway" agent skill from https://github.com/theopenco/llmgateway/tree/main/.agents/skills/gateway into .agents/skills/gateway/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gateway", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add theopenco/llmgateway --skill gateway -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install theopenco/llmgateway gateway --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/theopenco/llmgateway.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/gateway .cursor/skills/gateway && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "gateway" agent skill from https://github.com/theopenco/llmgateway/tree/main/.agents/skills/gateway into .cursor/skills/gateway/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gateway", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/theopenco/llmgateway.git --path .agents/skills/gateway--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add theopenco/llmgateway --skill gateway -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install theopenco/llmgateway gateway --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/theopenco/llmgateway.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/gateway .gemini/skills/gateway && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "gateway" agent skill from https://github.com/theopenco/llmgateway/tree/main/.agents/skills/gateway into .gemini/skills/gateway/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gateway", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install theopenco/llmgateway gatewayInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add theopenco/llmgateway --skill gateway -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/theopenco/llmgateway.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/gateway .github/skills/gateway && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "gateway" agent skill from https://github.com/theopenco/llmgateway/tree/main/.agents/skills/gateway into .github/skills/gateway/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gateway", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add theopenco/llmgateway --skill gateway -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install theopenco/llmgateway gateway --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/theopenco/llmgateway.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/gateway .opencode/skills/gateway && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "gateway" agent skill from https://github.com/theopenco/llmgateway/tree/main/.agents/skills/gateway into .opencode/skills/gateway/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gateway", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
gatewayChange the LLM Gateway request path in apps/gateway — chat and other endpoints, routing and provider selection, error and finish-reason classification, streaming, request logging, Redis use…
Gateway is an agent skill from theopenco/llmgateway. Change the LLM Gateway request path in apps/gateway — chat and other endpoints, routing and provider selection, error and finish-reason classification, streaming, request logging, Redis use, user-supplied content URLs, and graceful shutdown. Use when editing apps/gateway/src or packages/actions request shaping, adding an endpoint, fetching remote content, changing fallback or routing, or debugging missing logs, hung Redis commands, or shutdown errors.
Its SKILL.md is about 740 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Databases, covering Model routing and gateways. It works with Redis. The repository describes itself as: Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Read from SKILL.md and the folder at commit 414b1b9. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Gateway loads about 736 tokens when it runs. Until then it costs about 116 tokens; SKILL.md has 299 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 299 words (~736 tokens).
“The gateway is latency-critical and high-throughput.”
Just SKILL.md in .agents/skills/gateway of theopenco/llmgateway.
Open the folder on GitHubat commit 414b1b9
Gateway next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Gateway this skilltheopenco/llmgateway | 1.7k | — | ~736 | Automated safety check: Pass | Custom licence | |
| Caching Architecturemajiayu000/litellm-rs | 117 | — | ~2k | Automated safety check: Pass | MIT | |
| Provider Architecturemajiayu000/litellm-rs | 117 | — | ~4.9k | Automated safety check: Pass | MIT | |
| Manor Dev Stack Run Verifymanor-os/manor-ai | 162 | — | ~607 | Automated safety check: Notes | Custom licence | |
| Openrouter Caching Strategyjeremylongshore/tons-of-skills-marketplace | 2.8k | — | ~2.4k | Automated safety check: Pass | MIT | |
| Openrouter Reference Architecturejeremylongshore/tons-of-skills-marketplace | 2.8k | — | ~2.7k | Automated safety check: Pass | MIT |
majiayu000/litellm-rs
LiteLLM-RS response caching architecture. An agent skill from majiayu000/litellm-rs.
majiayu000/litellm-rs
LiteLLM-RS provider system in two tiers - data-driven OpenAI-compatible catalog entries auto-routed through OpenAILikeProvider, plus code-based provider modules implementing the LLMProvider trait…
manor-os/manor-ai
A skill your agent uses when starting, verifying, debugging, or repairing the local Manor self-hosted dev stack, Docker Compose services, seeded demo login, API/web/worker health…
jeremylongshore/tons-of-skills-marketplace
Implement caching for OpenRouter API responses to reduce cost and latency.
jeremylongshore/tons-of-skills-marketplace
Design production architectures using OpenRouter as the LLM gateway.
redis/node-redis
Add a new Redis command (or command variant) to node-redis end-to-end — the <NAME.ts Command file, its registration with JSDoc in the package commands/index.ts, and a co-located <NAME.spec.ts with…
theopenco/llmgateway
Write and validate an LLM Gateway marketing blog post in the repository's current house style, including structured frontmatter and a gpt-image-2 OpenGraph image.
theopenco/llmgateway
Run and report repository model or provider-mapping benchmarks.
theopenco/llmgateway
Create, update, and audit repository-local agent skills against the current LLM Gateway codebase.
theopenco/llmgateway
Security best practices, vulnerability review, and full security audits for LLM Gateway.
theopenco/llmgateway
Write a new LLM Gateway changelog entry. An agent skill from theopenco/llmgateway.
theopenco/llmgateway
Write a new LLM Gateway docs Knowledge base page under apps/docs/content/(product)/learn with light and dark dashboard screenshots.
Works with
Categories
Change the LLM Gateway request path in apps/gateway — chat and other endpoints, routing and provider selection, error and finish-reason classification, streaming, request logging, Redis use…. Gateway is an agent skill from theopenco/llmgateway. Change the LLM Gateway request path in apps/gateway — chat and other endpoints, routing and provider selection, error and finish-reason classification, streaming, request logging, Redis use, user-supplied content URLs, and graceful shutdown.
Gateway fits situations like: editing apps/gateway/src; packages/actions request shaping; adding an endpoint; fetching remote content.
Run `npx skills add theopenco/llmgateway --skill gateway -a claude-code`. Or copy the skill folder (.agents/skills/gateway in theopenco/llmgateway) into .claude/skills/gateway in your project. Claude Code loads it when a task matches its description.
Run `npx skills add theopenco/llmgateway --skill gateway -a codex`. Or copy the skill folder (.agents/skills/gateway in theopenco/llmgateway) into .agents/skills/gateway in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add theopenco/llmgateway --skill gateway -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/gateway, .gemini/skills/gateway, .github/skills/gateway and .opencode/skills/gateway in your project.
SKILL.md names no scripts, command-line tools or credentials: Gateway is instructions for the agent only.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Gateway has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.
About 736 tokens (SKILL.md is roughly 2.9k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Gateway: Caching Architecture (majiayu000/litellm-rs, 117 stars), Provider Architecture (majiayu000/litellm-rs, 117 stars), Manor Dev Stack Run Verify (manor-os/manor-ai, 162 stars) and Openrouter Caching Strategy (jeremylongshore/tons-of-skills-marketplace, 2.8k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
theopenco (a GitHub organization) maintains it in theopenco/llmgateway, which has 1,675 GitHub stars. The repository holds 19 skills in this directory. The repository was last updated on October 7, 2026.
Source: theopenco/llmgateway on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.