A2ui Audit

A2UI Compliance Verification Skill

This skill coordinates the execution of specification compliance, documentation sync, and test quality audits, and publishes the combined results as a GitHub issue.

Other than writing a report and creating an issue, this skill is purely a read-only skill; no changes are to be made to the codebase. Do not attempt to fix issues.

Instructions

1. Audit Codebase Blueprint Compliance:

   • Execute python3 blueprints/skills/a2ui-blueprint-compliance/scripts/check_compliance.py to dynamically discover all 8 production codebases and generate the baseline Markdown status report.
   • Run the sub-skill a2ui-blueprint-compliance to audit each discovered codebase for missing features or blueprint drift.
   • Save the compiled Markdown report to a temporary file in the workspace (e.g., compliance_report.md) under the header ## Codebase Blueprint Compliance Audit.

2. Audit Code vs. Documentation Synchronization:

   • Run the sub-skill a2ui-doc-sync-check to audit documentation drift across docs/, specification/, codebase READMEs, and inline docstrings.
   • Append the returned Markdown report to compliance_report.md under a new header ## Code & Documentation Sync Audit.

3. Audit Test Quality & Assertion Strength:

   • Run the sub-skill a2ui-test-quality-check to audit test suites across all codebases for weak assertions and behavioral verification.
   • Append the returned Markdown report to compliance_report.md under a new header ## Test Quality & Assertions Audit.

4. Summarize the report:

   • Add a ## Summary section at the top of the compliance_report.md file with a detailed overview of the audit scope and key findings across all audited codebases.
   • Add a ## Recommendations section listing actionable, prioritized follow-up items formatted as a numbered list (e.g. 1. **P0**: ...). Each numbered item MUST represent a concrete, self-contained remediation task.
   • Immediately below the recommendations list, include the mandatory automated remediation callout:

     🤖 Automated Remediation: Comment /fix <number> (e.g., /fix 1) on this issue to have an agent create a draft PR for that recommendation.

5. Format and Detail Requirements:

   • MANDATORY COMPLETE REPOSITORY COVERAGE: The report MUST include status rows and detailed findings for ALL 8 production codebases discovered by check_compliance.py. Do NOT truncate, shortcut, or abbreviate the summary tables or detailed findings.
   • For each audit section, provide specific evidence:
     • Exact file paths (e.g. python/a2ui_agent/transport.py:L45-L60).
     • Specific function/class names, parameter mismatches, or missing feature descriptions.
     • Concrete examples of weak assertions (e.g. assert response is not None in eval/tests/test_strategies.py).
   • Follow the structure provided in the Report Format Template below.

6. Publish Report:

   • Execute the local Python helper script to create the GitHub issue containing the combined reports:

     python3 .agents/skills/a2ui-audit/scripts/create_compliance_report.py compliance_report.md --repo a2ui-project/a2ui

   • The publishing script will create the GitHub issue, automatically inject copyable remediation prompt blocks referencing the newly created issue URL under each recommendation item, and update the issue body.
   • Ensure the helper script runs successfully.
   • Clean up the temporary file compliance_report.md after completion.