Qwen Mtp Gguf
R6410418/Jackrong-llm-finetuning-guide
Complete agent-ready workflow for Qwen-family MTP or nextn GGUF conversion and release.
Hardware-aware adaptive Hermes runtime using portable Turbofiles, total usable memory, owned native llama.cpp residency, stable auto/active:main/active:aux routes, and evidence-backed promotion.
$ npx skills add SouthpawIN/turbofit --skill turbofit -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install SouthpawIN/turbofit turbofit --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/SouthpawIN/turbofit.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/turbofit .claude/skills/turbofit && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "turbofit" agent skill from https://github.com/SouthpawIN/turbofit/tree/main/skills/turbofit into .claude/skills/turbofit/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "turbofit", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/SouthpawIN/turbofit/tree/main/skills/turbofitType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add SouthpawIN/turbofit --skill turbofit -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install SouthpawIN/turbofit turbofit --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/SouthpawIN/turbofit.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/turbofit .agents/skills/turbofit && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "turbofit" agent skill from https://github.com/SouthpawIN/turbofit/tree/main/skills/turbofit into .agents/skills/turbofit/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "turbofit", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add SouthpawIN/turbofit --skill turbofit -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install SouthpawIN/turbofit turbofit --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/SouthpawIN/turbofit.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/turbofit .cursor/skills/turbofit && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "turbofit" agent skill from https://github.com/SouthpawIN/turbofit/tree/main/skills/turbofit into .cursor/skills/turbofit/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "turbofit", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/SouthpawIN/turbofit.git --path skills/turbofit--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add SouthpawIN/turbofit --skill turbofit -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install SouthpawIN/turbofit turbofit --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/SouthpawIN/turbofit.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/turbofit .gemini/skills/turbofit && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "turbofit" agent skill from https://github.com/SouthpawIN/turbofit/tree/main/skills/turbofit into .gemini/skills/turbofit/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "turbofit", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install SouthpawIN/turbofit turbofitInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add SouthpawIN/turbofit --skill turbofit -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/SouthpawIN/turbofit.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/turbofit .github/skills/turbofit && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "turbofit" agent skill from https://github.com/SouthpawIN/turbofit/tree/main/skills/turbofit into .github/skills/turbofit/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "turbofit", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add SouthpawIN/turbofit --skill turbofit -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install SouthpawIN/turbofit turbofit --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/SouthpawIN/turbofit.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/turbofit .opencode/skills/turbofit && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "turbofit" agent skill from https://github.com/SouthpawIN/turbofit/tree/main/skills/turbofit into .opencode/skills/turbofit/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "turbofit", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
turbofitHardware-aware adaptive Hermes runtime using portable Turbofiles, total usable memory, owned native llama.cpp residency, stable auto/active:main/active:aux routes, and evidence-backed promotion.
Turbofit is an agent skill from SouthpawIN/turbofit. Hardware-aware adaptive Hermes runtime using portable Turbofiles, total usable memory, owned native llama.cpp residency, stable auto/active:main/active:aux routes, and evidence-backed promotion. Use for recommending, activating, inspecting, testing, or troubleshooting Turbofit runtimes.
Its SKILL.md is about 1.9k tokens, which your agent loads only when the skill is triggered. The skill folder holds 32 other files, including scripts and reference files (for example `README.md`, `distribution.yaml` and `references/SOUL.md`).
It sits in AI & LLM Engineering, covering LLM inference and serving. It works with llama.cpp and Qwen. The repository describes itself as: Adaptive local inference for Hermes — TurboFit Check, evidence-built TurboFit List, repaired discovery/benchmark campaigns, Qwen 3.8 DFlash2, Bonsai DSpark, FreeToken, and Sirvir. The licence is MIT.
7 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 42fc223. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Ships 1 file in scripts/, which the agent can run.
Shell commands in SKILL.md call:
python3curlFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use curl, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Turbofit loads about 1.9k tokens when it runs, and up to ~37k if it reads all its reference files. Until then it costs about 74 tokens; SKILL.md has 819 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.
The full file from SouthpawIN/turbofit at commit 42fc223, republished under its MIT licence (© SouthpawIN). 819 words, ~1,944 tokens.
.claude/skills/turbofit/SKILL.md (or your agent's skills folder). This skill also uses 31 other files; get the full folder from GitHub.Fit List keeps dedicated VRAM separate from integrated/RAM-only total memory. Dedicated: Maple Preview TQ2_0 at 8GB, Qwen 3.8 27B Unleashed UD-IQ3_XXS at 16GB, UD-Q3_K_XL at 24–95GB, and Qwen 3.8 27B 16-bit at 96GB+ until an Unleashed FP16 GGUF is published. Shared total memory: Maple at 8–15GB, Ornith 1.5 35A3B at 16–23GB, and Unleashed UD-Q3_K_XL at 24GB+. An 8GB GPU may also use Ornith when host RAM can hold offloaded experts. Maple remains Auto on dedicated 8GB at native 64K/128K. Auxiliary is Ornith, optional Carwin Nano, or auto.
Work from the Git repository, not an installed copy.
scripts/turbofit-runtime list
scripts/turbofit-runtime set auto
scripts/turbofit-runtime set <profile-id>
scripts/turbofit-runtime status
scripts/turbofit-controller --once
curl -fsS http://127.0.0.1:8091/v1/modelsset auto chooses a canonical profile from immutable physical topology. set <profile-id> validates a measured, natively resolvable manual combination.
Both begin at API safety and use the same adaptive controller to contract and
heal; manual selection changes only the healing ceiling.
Use only stable provider IDs: auto, active:main, and active:aux.
FreeToken 0.1.2 at revision 0ab982f10905fa775962a4eddcb44caa50065251 is an optional NVIDIA/CUDA-13 text-only MoE candidate. Install or probe with scripts/install-freetoken-runtime; never expose it as an Auto rung, inherit its published TPS, or replace active Qwen 3.8/Ornith authority until an exact supported model recipe passes the full physical and intelligence campaigns.
Legacy serve, direct launchers, and scaling watcher are compatibility tools, not adaptive authorities.
Hardware fingerprints classify memory as dedicated, unified, or cpu. Turbofit reserves 5% of host RAM, bounded to 1–8 GiB, and never double-counts unified memory. Dedicated systems can combine VRAM and host RAM through llama.cpp offload; contexts beyond the model's native window move KV cache pressure to host RAM when at least 32 GiB is usable. Unified-memory systems suppress discrete split flags. CPU-only systems use pinned CPU runtimes with both model and draft GPU layers set to zero.
Backend order is CUDA → ROCm → Vulkan → CPU on Linux/Windows and Metal on macOS. Build or verify the current machine's pinned backend with scripts/install-native-runtimes --backend cuda|rocm|metal|vulkan|cpu.
PYTHONPATH=src python3 scripts/turbofit-runtime-recommend --fit-only --json
PYTHONPATH=src:. python3 -m pytest tests/test_runtime_profile.py tests/test_profile_io.py tests/test_hardware.py tests/test_recommend.py -q -o 'addopts='Topology matters: 1x48 and 2x24 are different classes. Unmeasured classes keep API as the Auto safety rung while setup may expose separately labeled portable-fit local candidates for on-box validation.
TurboFit Check means the system scan-to-configuration process. TurboFit List means only the exact physical hardware-level winners generated by scripts/turbofit-list. Intelligence campaigns run only the current tier's tournament candidates; zero-call/token DeepSWE trials are invalid, and suite composites are rebuilt from real hash-bound pass counts rather than stale stored zeros.
Qwen 3.8 DFlash2 is a separate candidate using the pinned Inco Q4_K_M drafter and pinned z-lab llama.cpp PR runtime. Never reuse it for Bonsai. Bonsai keeps its own Prism DSpark sidecar/runtime until a dedicated Bonsai DFlash checkpoint exists.
PYTHONPATH=src:. python3 -m pytest tests/test_pressure.py tests/test_pressure_probe.py tests/test_policy.py tests/test_reconciler.py tests/test_controller.py tests/test_runtime_service.py tests/integration -q -o 'addopts='Expected contraction:
dedicated aux → shared-main → smaller context/model → terminal APIExpected recovery walks one rung at a time toward the recommendation after margin and dwell.
scripts/release-check
scripts/release-check --realThe first command validates syntax, tests, profiles, links, and simulated transitions. The second additionally requires working accelerator telemetry, stable live routes, and controlled real pressure/recovery evidence. Do not claim release readiness if --real is blocked.
Acceptance evidence: references/results/adaptive-runtime-acceptance.json.
Collectors write only research/candidates.json:
PYTHONPATH=. python3 research/discover_huggingface.py
PYTHONPATH=. python3 research/discover_model_news.py --url <public-feed>
PYTHONPATH=. python3 research/discover_api_models.py --provider <name> --url <public-model-list>No collector may modify runtime profiles, routes, or credentials. Live cron schedules/delivery require explicit user approval.
scripts/turbofit-runtime status and the hardware fingerprint in Dashboard/Desktop/health, /v1/models, and /metrics/v1/modelsscripts/release-checkIf http://127.0.0.1:8091/v1/models is connection-refused, the Turbofit provider gateway is not running. That is setup missing. Do not restart the Hermes messaging gateway, do not start with a firewall hunt when nothing listens, and do not invoke Sirvir until the endpoint answers.
If the platform reports a driver/runtime mismatch, stop the real pressure test. Do not attempt blind driver reloads or disruptive accelerator work.
Full architecture and schema: README.md.
© SouthpawIN, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 31 other files (scripts, references) in skills/turbofit of SouthpawIN/turbofit.
Open the folder on GitHubat commit 42fc223
Turbofit next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Turbofit this skillSouthpawIN/turbofit | 107 | — | ~1.9k | Automated safety check: Pass | MIT | |
| Qwen Mtp GgufR6410418/Jackrong-llm-finetuning-guide | 1.7k | — | ~1.7k | Automated safety check: Pass | MIT | |
| Add Modelguoqingbao/xinfer | 334 | — | ~4.2k | Automated safety check: Notes | MIT | |
| Resolvealexziskind1/model-shelf | 130 | — | ~792 | Automated safety check: Pass | MIT | |
| Test Modelguoqingbao/xinfer | 334 | — | ~2.6k | Automated safety check: Pass | MIT | |
| Add New ModelJakeATX/llamAmpere | 166 | — | ~4.1k | Automated safety check: Pass | MIT |
R6410418/Jackrong-llm-finetuning-guide
Complete agent-ready workflow for Qwen-family MTP or nextn GGUF conversion and release.
guoqingbao/xinfer
Adapt and port new LLM model architectures to this xinfer project.
alexziskind1/model-shelf
Always resolve Hugging Face models via model-shelf before any download.
guoqingbao/xinfer
Test LLM models served by xinfer for correctness, output quality, and performance.
JakeATX/llamAmpere
Guided workflow for adding a new model architecture to llama.cpp.
JakeATX/llamAmpere
Review llama.cpp changes against project conventions and common reviewer pitfalls before a PR.
SouthpawIN/turbofit
Operate the Turbofit adaptive local inference plugin. An agent skill from SouthpawIN/turbofit.
Categories
Hardware-aware adaptive Hermes runtime using portable Turbofiles, total usable memory, owned native llama.cpp residency, stable auto/active:main/active:aux routes, and evidence-backed promotion. Turbofit is an agent skill from SouthpawIN/turbofit.cpp residency, stable auto/active:main/active:aux routes, and evidence-backed promotion.
Turbofit fits situations like: troubleshooting Turbofit runtimes; tasks that involve LLM inference and serving.
Run `npx skills add SouthpawIN/turbofit --skill turbofit -a claude-code`. Or copy the skill folder (skills/turbofit in SouthpawIN/turbofit) into .claude/skills/turbofit in your project. Claude Code loads it when a task matches its description.
Run `npx skills add SouthpawIN/turbofit --skill turbofit -a codex`. Or copy the skill folder (skills/turbofit in SouthpawIN/turbofit) into .agents/skills/turbofit in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add SouthpawIN/turbofit --skill turbofit -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/turbofit, .gemini/skills/turbofit, .github/skills/turbofit and .opencode/skills/turbofit in your project.
Going by SKILL.md and its folder, Turbofit needs the command-line tools its instructions call (python3 and curl). Our summary lists: Python 3.
SKILL.md contains no URLs. Its commands use curl, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.
Turbofit is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.9k tokens (SKILL.md is roughly 7.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 35k tokens, read only when the agent opens those files.
Skills that share tags, products or a category with Turbofit: Qwen Mtp Gguf (R6410418/Jackrong-llm-finetuning-guide, 1.7k stars), Add Model (guoqingbao/xinfer, 334 stars), Resolve (alexziskind1/model-shelf, 130 stars) and Test Model (guoqingbao/xinfer, 334 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
SouthpawIN (a GitHub user) maintains it in SouthpawIN/turbofit, which has 107 GitHub stars. The repository holds 2 skills in this directory. The repository was last updated on October 8, 2026.
Source: SouthpawIN/turbofit on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.