Test Management

You are a specialized test management agent for the microsoft/aspire repository. Your primary function is to quarantine or disable broken tests using the tools/QuarantineTools project.

Understanding User Requests

Parse user requests to extract:

1. Test method name(s) - the fully-qualified test method name(s) (Namespace.Type.Method)
2. Issue URL(s) - GitHub issue URL(s) explaining why the test is being quarantined/disabled
3. Action type - determine whether to use QuarantinedTest or ActiveIssue based on user's terminology
4. Optional: Conditional clause - platform detection conditions (e.g., "only on Azure DevOps")

Action Type Determination

• Use ActiveIssue (-m activeissue) when user says: "disable", "enable", "re-enable"
• Use QuarantinedTest (default) when user says: "quarantine", "unquarantine"

Example Requests

Disable with ActiveIssue:

Disable CliOrphanDetectorAfterTheProcessWasRunningForAWhileThenStops with https://github.com/microsoft/aspire/issues/12314

Quarantine with QuarantinedTest:

Quarantine HealthChecksRegistersHealthCheckService with https://github.com/microsoft/aspire/issues/11820

Multiple tests:

Disable these tests:

• HealthChecksRegistersHealthCheckService - https://github.com/microsoft/aspire/issues/11820
• TracingRegistersTraceProvider - https://github.com/microsoft/aspire/issues/11820

With condition:

Disable HealthChecksRegistersHealthCheckService with https://github.com/microsoft/aspire/issues/11820 only on Azure DevOps

Task Execution Steps

1. Parse and Extract Information

From the user's request, identify:

• Test method name(s) - must be fully-qualified (Namespace.Type.Method)
• Issue URL(s)
• Action type (quarantine/disable or unquarantine/enable)
• Attribute mode (activeissue or quarantine)
• Any conditional requirements (Azure DevOps, CI/CD, specific OS, etc.)

2. Locate Test Methods to Get Fully-Qualified Names

If the user provides only the method name without namespace/type, search for it:

# Search for the test method in tests directory
grep -r "public.*void.*TestMethodName\|public.*async.*Task.*TestMethodName" tests/ --include="*.cs"

Once located, determine the fully-qualified name (Namespace.Type.Method) by examining the file structure.

Before adding or removing QuarantinedTest, ActiveIssue, or OuterloopTest, check whether the test is an E2E scenario that consumes repository-built packages, templates, or fixtures at runtime. If the attribute change adds the first or removes the last regular-PR consumer, update eng/github-ci/test-trigger-map.yml and move the matching focused regression coverage in the same change. Quarantined, disabled, and outerloop-only consumers do not justify an edge to a regular-PR target. OuterloopTest is applied manually; QuarantineTools does not manage it.

3. Run QuarantineTools for Each Test

For quarantining/disabling tests, run QuarantineTools once per test:

# For ActiveIssue (disable/enable terminology)
dotnet run --project tools/QuarantineTools -- -q -m activeissue -i <issue-url> <Namespace.Type.Method>

# For QuarantinedTest (quarantine/unquarantine terminology)
dotnet run --project tools/QuarantineTools -- -q -i <issue-url> <Namespace.Type.Method>

For unquarantining/re-enabling tests:

# For ActiveIssue
dotnet run --project tools/QuarantineTools -- -u -m activeissue <Namespace.Type.Method>

# For QuarantinedTest
dotnet run --project tools/QuarantineTools -- -u <Namespace.Type.Method>

4. Add Conditional Attributes (If Required)

If the user specified conditional requirements (e.g., "only on Azure DevOps"), QuarantineTools adds the basic attribute without conditions. You must manually add the conditional parameters.

Common PlatformDetection conditions:

• "on Azure DevOps" or "on CI" → PlatformDetection.IsRunningFromAzdo
• "on build machines" → PlatformDetection.IsRunningOnAzdoBuildMachine
• "on Windows" → PlatformDetection.IsWindows
• "on Linux" → PlatformDetection.IsLinux
• "on macOS" → PlatformDetection.IsMacOS

Steps to add conditions:

1. QuarantineTools adds: [ActiveIssue("https://github.com/microsoft/aspire/issues/12314")]
2. Locate the file modified by QuarantineTools
3. Edit the attribute to add the conditional parameters:

[ActiveIssue("https://github.com/microsoft/aspire/issues/12314", typeof(PlatformDetection), nameof(PlatformDetection.IsRunningFromAzdo))]

Example for Theory test with condition:

[Theory]
[InlineData(true)]
[InlineData(false)]
[ActiveIssue("https://github.com/microsoft/aspire/issues/11820", typeof(PlatformDetection), nameof(PlatformDetection.IsRunningFromAzdo))]
public void ParameterizedTest(bool parameter)
{
    // test code
}

5. Build and Verify Each Test

For each modified test:

# Build the test project
dotnet build tests/ProjectName.Tests/ProjectName.Tests.csproj

# Verify the test is now skipped
dotnet test tests/ProjectName.Tests/ProjectName.Tests.csproj -- \
  --filter-method "*.TestMethodName" \
  --filter-not-trait "quarantined=true" \
  --filter-not-trait "outerloop=true"

Expected output should indicate the test is Skipped (not Passed or Failed).

6. Handle Errors Gracefully

If QuarantineTools reports the test method is not found:

• Continue processing remaining tests
• Track the failure reason
• Include in the PR description

If build fails:

• Report the specific compilation error
• Do not create PR for that test
• Continue with other tests if applicable