Hands On Test
ktnyt/cclsp
Performs manual hands-on testing of a web application using playwright-cli.
A skill your agent uses when asked to validate, test, smoke-test, or run the course's notebook and code samples against a live Microsoft Foundry / Azure OpenAI configuration.
Install Testing Course Samples
$ npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install microsoft/ai-agents-for-beginners testing-course-samples --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/microsoft/ai-agents-for-beginners.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/testing-course-samples .claude/skills/testing-course-samples && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "testing-course-samples" agent skill from https://github.com/microsoft/ai-agents-for-beginners/tree/main/.agents/skills/testing-course-samples into .claude/skills/testing-course-samples/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "testing-course-samples", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/microsoft/ai-agents-for-beginners/tree/main/.agents/skills/testing-course-samplesType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install microsoft/ai-agents-for-beginners testing-course-samples --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/microsoft/ai-agents-for-beginners.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/testing-course-samples .agents/skills/testing-course-samples && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "testing-course-samples" agent skill from https://github.com/microsoft/ai-agents-for-beginners/tree/main/.agents/skills/testing-course-samples into .agents/skills/testing-course-samples/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "testing-course-samples", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install microsoft/ai-agents-for-beginners testing-course-samples --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/microsoft/ai-agents-for-beginners.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/testing-course-samples .cursor/skills/testing-course-samples && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "testing-course-samples" agent skill from https://github.com/microsoft/ai-agents-for-beginners/tree/main/.agents/skills/testing-course-samples into .cursor/skills/testing-course-samples/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "testing-course-samples", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/microsoft/ai-agents-for-beginners.git --path .agents/skills/testing-course-samples--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install microsoft/ai-agents-for-beginners testing-course-samples --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/microsoft/ai-agents-for-beginners.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/testing-course-samples .gemini/skills/testing-course-samples && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "testing-course-samples" agent skill from https://github.com/microsoft/ai-agents-for-beginners/tree/main/.agents/skills/testing-course-samples into .gemini/skills/testing-course-samples/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "testing-course-samples", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install microsoft/ai-agents-for-beginners testing-course-samplesInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/microsoft/ai-agents-for-beginners.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/testing-course-samples .github/skills/testing-course-samples && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "testing-course-samples" agent skill from https://github.com/microsoft/ai-agents-for-beginners/tree/main/.agents/skills/testing-course-samples into .github/skills/testing-course-samples/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "testing-course-samples", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install microsoft/ai-agents-for-beginners testing-course-samples --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/microsoft/ai-agents-for-beginners.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/testing-course-samples .opencode/skills/testing-course-samples && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "testing-course-samples" agent skill from https://github.com/microsoft/ai-agents-for-beginners/tree/main/.agents/skills/testing-course-samples into .opencode/skills/testing-course-samples/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "testing-course-samples", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
testing-course-samples- GitHub stars
- 77k
- Token cost
- ~1.1k tokens
- SKILL.md length
- 418 words
- Files
- 1
- Skills in repo
- 123
- Repo updated
- First seen
- Licence
- MIT
At a glance
A skill your agent uses when asked to validate, test, smoke-test, or run the course's notebook and code samples against a live Microsoft Foundry / Azure OpenAI configuration.
- Works in 4 steps: Python 3.12+ with course deps: python -m… → .env at the repo root (copy from… → az login completed — samples… → …
- Asked to validate
- SKILL.md covers When to use, Prerequisites (check first), Running the validation and Interpreting results, plus 2 more sections
- Calls pwsh, az and python
What it does
Testing Course Samples is an agent skill from microsoft/ai-agents-for-beginners, published by the product's own GitHub organization. Use when asked to validate, test, smoke-test, or run the course's notebook and code samples against a live Microsoft Foundry / Azure OpenAI configuration. Covers environment setup (.env, az login, packages), the scripts/validate-notebooks.ps1 runner, interpreting PASS/FAIL results, and which lessons need extra resources (Azure AI Search, GitHub MCP, Foundry Local, Playwright).
Its SKILL.md is about 1.1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Testing & QA, covering QA and bug reports and Browser testing. It works with Playwright, Azure OpenAI, Microsoft Azure and Azure AI Search. The repository describes itself as: 18 Lessons to Get Started Building AI Agents. The licence is MIT.
When your agent uses it
- Asked to validate
- Run the courses notebook and code samples against a live Microsoft Foundry / Azure OpenAI configuration
Example prompts
- “/testing-course-samples”
Requirements
- Python 3
Workflow steps
4 steps, taken from the first numbered list in SKILL.md.
- Python 3.12+ with course deps: python -m pip install -r requirements.txt
- .env at the repo root (copy from .env.example) with at least
- az login completed — samples authenticate with AzureCliCredential (Entra ID, keyless).
- Verify the model deployment exists
What it can do on your machine
Read from SKILL.md and the folder at commit 25b7985. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
pwshazpythonplaywright
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md. Its commands use az, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Testing Course Samples loads about 1.1k tokens when it runs. Until then it costs about 101 tokens; SKILL.md has 418 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check: notes
The automated check noted patterns worth knowing about, such as sudo or a known installer.
- NoteMentions a .env fileSKILL.md:3
configuration. Covers environment setup (.env, az login, packages), the scripts/validate-notebooks.ps1 runner, interpret - NoteMentions a .env fileSKILL.md:25
2. **`.env` at the repo root** (copy from [`.env.example`](../../../.env.example)) with at least:
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
The full file from microsoft/ai-agents-for-beginners at commit 25b7985, republished under its MIT licence (© microsoft). 418 words, ~1,114 tokens.
Download SKILL.mdSave it as
.claude/skills/testing-course-samples/SKILL.md (or your agent's skills folder).- name
- testing-course-samples
- description
- Use when asked to validate, test, smoke-test, or run the course's notebook and code samples against a live Microsoft Foundry / Azure OpenAI configuration. Covers environment setup (.env, az login, packages), the scripts/validate-notebooks.ps1 runner, interpreting PASS/FAIL results, and which lessons need extra resources (Azure AI Search, GitHub MCP, Foundry Local, Playwright).
Testing the Course Samples
Validate that the lesson notebooks and code samples run against a live
Microsoft Foundry / Azure OpenAI setup. The repo ships a runner at
scripts/validate-notebooks.ps1 that
executes every Python notebook headlessly and prints a PASS/FAIL matrix.
When to use
- "Validate all the notebooks / samples against my Azure subscription."
- "Smoke-test the course after upgrading packages or changing models."
- "Which lessons still pass / fail live?"
Do not use this for the AI Smoke Test GitHub Action (that validates deployed
hosted agents — see tests/README.md). This skill
runs the notebooks locally.
Prerequisites (check first)
- Python 3.12+ with course deps:
python -m pip install -r requirements.txtplus the executor:python -m pip install nbconvert ipykernel. .envat the repo root (copy from.env.example) with at least:AZURE_AI_PROJECT_ENDPOINT— Foundry project endpoint (https://<account>.services.ai.azure.com/api/projects/<project>)AZURE_AI_MODEL_DEPLOYMENT_NAME— a non-deprecated deployment (e.g.gpt-5-mini)AZURE_OPENAI_ENDPOINT(https://<account>.openai.azure.com) andAZURE_OPENAI_DEPLOYMENTfor lessons that call Azure OpenAI directly (Lesson 06, 02-azure-openai, 14 handoff/human-loop).
az logincompleted — samples authenticate withAzureCliCredential(Entra ID, keyless).- Verify the model deployment exists:
az cognitiveservices account deployment list -g <rg> -n <account> -o table.
Running the validation
# All Python notebooks (skips .NET, .venv, site-packages, translations, skill assets)
pwsh scripts/validate-notebooks.ps1
# A single lesson, with a longer per-cell timeout
pwsh scripts/validate-notebooks.ps1 -Filter '08-*' -Timeout 600
# Just list what would run (no execution)
pwsh scripts/validate-notebooks.ps1 -List
# Explicit interpreter (if `python` is not on PATH, e.g. Windows Store alias)
pwsh scripts/validate-notebooks.ps1 -Python "C:/path/to/python.exe"The script writes executed copies, per-notebook logs, and results.json to
$env:TEMP\aiab-nbval and exits with the number of failures.
Transient failures (shared-subscription HTTP 429 rate limits, an occasional
AzureCliCredential token hiccup, or a timeout) are retried automatically
(-Retries, default 2, with -RetryDelaySeconds backoff, default 20). If a
model deployment is regularly 429-ing, check the subscription's GlobalStandard
TPM quota (az cognitiveservices usage list -l <region>) — raising a single
deployment's capacity does not help when the subscription quota is exhausted.
Show full SKILL.md (157 more words)Show less
Interpreting results
PASS— the notebook ran end-to-end with no cell error.FAIL— the first*Error/*Exceptionline is shown; open the matchinglog_*.txtin the output dir for the full traceback.- A single notebook's failure is bounded by
-Timeout(per cell), so a hung human-in-the-loop cell surfaces asStdinNotImplementedErrorrather than hanging.
Lessons that need extra resources (expected to fail without them)
| Lesson | Extra requirement |
|---|---|
| 05 Agentic RAG | Azure AI Search (AZURE_SEARCH_SERVICE_ENDPOINT, key) — has an in-memory fallback path |
| 11 MCP / GitHub | GitHub MCP server + PAT |
| 13 memory (cognee) | cognee configured with a model provider |
| 15 browser-use | Playwright browsers installed (playwright install) + AZURE_OPENAI_CHAT_DEPLOYMENT_NAME |
| 17 local agent | Foundry Local runtime + a downloaded Qwen model (on-device, no cloud) |
*-dotnet-* notebooks | .NET Interactive kernel (excluded by default; use -IncludeDotnet) |
Reporting back
Summarise as a PASS/FAIL table grouped by lesson. Separate genuine regressions
(code/config bugs to fix) from environment gaps (missing Search/Foundry Local/PAT),
and cite the failing log_*.txt for each real failure.
© microsoft, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
Just SKILL.md in .agents/skills/testing-course-samples of microsoft/ai-agents-for-beginners.
Open the folder on GitHubat commit 25b7985
Compare with similar skills
Testing Course Samples next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Testing Course Samples this skillmicrosoft/ai-agents-for-beginners | 77k | — | ~1.1k | Automated safety check: Notes | MIT | |
| Hands On Testktnyt/cclsp | 675 | — | ~1.7k | Automated safety check: Pass | MIT | |
| Windows QA EngineerCodeAlive-AI/ai-driven-development | 155 | — | ~1.4k | Automated safety check: Pass | MIT | |
| Agentic Browser Testingpetrkindlmann/qa-skills | 163 | — | ~4.5k | Automated safety check: Pass | MIT | |
| Record E2E Giflablup/backend.ai-webui | 133 | — | ~907 | Automated safety check: Notes | LGPL-3.0 | |
| Permission ManageraAAaqwq/AGI-Super-Team | 105 | 1 repos | ~1.3k | Automated safety check: Pass | MIT |
Similar skills
Windows QA Engineer
CodeAlive-AI/ai-driven-development
A skill your agent uses when testing Windows 11 desktop apps (WinForms/WPF/UWP) via UFO UIA/Win32 automation MCP.
Agentic Browser Testing
petrkindlmann/qa-skills
Goal-driven E2E testing where a browser agent (Playwright MCP / computer-use) reads a natural-language goal and explores the app via the accessibility tree to assert outcomes — no pre-written script.
Record E2E Gif
lablup/backend.ai-webui
Record Playwright e2e tests as one GIF per test case (video → ffmpeg palette GIF) and return a markdown table for a PR description.
Permission Manager
aAAaqwq/AGI-Super-Team
管理Claude Code的全局工具权限配置，自动将MCP命令或其他工具添加到allowedTools中，避免每次使用时都需要手动批准。工作流程：确认用户需要添加的命令 - 确认添加级别(默认全局~/.claude.json) - 执行添加 - 验证并提醒重启。
LangBot Environment Setup
langbot-app/LangBot
Prepares a LangBot development and testing environment for an agent, covering service startup, proxy settings and browser access through Computer Use or Playwright MCP.
More from microsoft/ai-agents-for-beginners
All 123 skills in this repo- Official
Jupyter Notebook
microsoft/ai-agents-for-beginners
A skill your agent uses when the user asks to create, scaffold, or edit Jupyter notebooks (.ipynb) for experiments, explorations, or tutorials; prefer the bundled templates and run the helper script…
- Official
Azure Openai To Responses
microsoft/ai-agents-for-beginners
Migrate Python apps from Azure OpenAI Chat Completions to the Responses API.
- Official
Azure Openai To Responses
microsoft/ai-agents-for-beginners
Shift Python apps dem from Azure OpenAI Chat Completions go Responses API.
- Official
Jupyter Notebook
microsoft/ai-agents-for-beginners
Kasuta, kui kasutaja palub luua, üles ehitada või redigeerida Jupyteri märkmikke (.ipynb) katsetuste, uurimiste või juhendite jaoks; eelista kaasasolevaid malle ja käivita abiskript newnotebook.py…
- Official
Jupyter Notebook
microsoft/ai-agents-for-beginners
Käytetään, kun käyttäjä pyytää luomaan, alustamaan tai muokkaamaan Jupyter-muistikirjoja (.ipynb) kokeita, tutkimuksia tai opetusohjelmia varten; käytä mieluummin mukana olevia mallipohjia ja…
- Official
Jupyter Notebook
microsoft/ai-agents-for-beginners
À utiliser lorsque l'utilisateur demande de créer, structurer ou modifier des notebooks Jupyter (.ipynb) pour des expériences, explorations ou tutoriels ; privilégiez les modèles fournis et exécutez…
Related
Categories
Questions about Testing Course Samples
What does Testing Course Samples do?
A skill your agent uses when asked to validate, test, smoke-test, or run the course's notebook and code samples against a live Microsoft Foundry / Azure OpenAI configuration. Testing Course Samples is an agent skill from microsoft/ai-agents-for-beginners, published by the product's own GitHub organization. Use when asked to validate, test, smoke-test, or run the course's notebook and code samples against a live Microsoft Foundry / Azure OpenAI configuration.
When should I use Testing Course Samples?
Testing Course Samples fits situations like: asked to validate; run the courses notebook and code samples against a live Microsoft Foundry / Azure OpenAI configuration.
How do I install Testing Course Samples in Claude Code?
Run `npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a claude-code`. Or copy the skill folder (.agents/skills/testing-course-samples in microsoft/ai-agents-for-beginners) into .claude/skills/testing-course-samples in your project. Claude Code loads it when a task matches its description.
How do I install Testing Course Samples in Codex?
Run `npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a codex`. Or copy the skill folder (.agents/skills/testing-course-samples in microsoft/ai-agents-for-beginners) into .agents/skills/testing-course-samples in your project. Codex loads it when a task matches its description.
Can I use Testing Course Samples in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add microsoft/ai-agents-for-beginners --skill testing-course-samples -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/testing-course-samples, .gemini/skills/testing-course-samples, .github/skills/testing-course-samples and .opencode/skills/testing-course-samples in your project.
What does Testing Course Samples need to run?
Going by SKILL.md and its folder, Testing Course Samples needs the command-line tools its instructions call (pwsh, az, python and playwright). Our summary lists: Python 3.
Does Testing Course Samples access the network?
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Is Testing Course Samples safe to install?
Our automated static check of SKILL.md found notes only (mentions a .env file), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.
What licence does Testing Course Samples use?
Testing Course Samples is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Testing Course Samples use?
About 1.1k tokens (SKILL.md is roughly 4.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Testing Course Samples?
Skills that share tags, products or a category with Testing Course Samples: Hands On Test (ktnyt/cclsp, 675 stars), Windows QA Engineer (CodeAlive-AI/ai-driven-development, 155 stars), Agentic Browser Testing (petrkindlmann/qa-skills, 163 stars) and Record E2E Gif (lablup/backend.ai-webui, 133 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Testing Course Samples?
microsoft (a GitHub organization, an official publisher) maintains it in microsoft/ai-agents-for-beginners, which has 76,567 GitHub stars. The repository holds 123 skills in this directory. The repository was last updated on September 19, 2026.
Source: microsoft/ai-agents-for-beginners on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.