--- name: recommending-devops-tests description: "Analyzes a commit diff and available DevOps Center test suite metadata to recommend the most relevant existing test suites, then flags coverage gaps where no suite covers a new method — via pure reasoning, no system calls beyond the prerequisite queries. Use this skill when a developer wants to know which test suites to run for a specific commit or diff, what tests cover their changes, or wants suite recommendations at commit time. TRIGGER when: the user asks which test suites to run for a commit/diff, asks what tests cover their changes, or asks for suite recommendations before promoting. DO NOT TRIGGER when: authoring new tests (use generating-apex-test) or running sf apex run test directly (use running-apex-tests)." metadata: version: "1.0" minApiVersion: "67.0" --- # Recommending DevOps Tests **Type:** Pure reasoning — no system calls beyond the prerequisite data-fetch queries documented below. **What it does:** Analyzes the commit diff and available suite metadata to recommend the most relevant existing test suites assigned to the Review pipeline stage. Flags coverage gaps where no suite covers a new method. --- ## Prerequisites Load and follow the `checking-devops-prerequisites` skill first (Prerequisites 1–4). This skill needs a confirmed DevOps Center org alias and pipeline Id before it can proceed. --- ## Step 1 — Fetch suite metadata Before reasoning can begin, fetch the test suite metadata assigned to the Review pipeline stage. This requires two queries. **1a — Find the Review pipeline stage trigger:** ```bash sf data query \ --query "SELECT Id FROM DevopsPipelineStageTrigger WHERE TriggerType = 'Review' AND RelatedRecordId = ''" \ --target-org \ --json ``` Record the `Id` returned as ``. **1b — Fetch suites assigned to that trigger:** ```bash sf data query \ --query "SELECT Id, TestSuiteId, TestSuite.Name, IsQualityGateEnabled, DevopsQualityGateId FROM DevopsTestSuiteStage WHERE DevopsPipelineStageTriggerId = ''" \ --target-org \ --json ``` Each row provides: `TestSuiteId`, `TestSuite.Name`, `IsQualityGateEnabled`, and `DevopsQualityGateId` (when a gate is configured). > Note: Do NOT use the beta `/connect/devops/.../testSuites` endpoint — it returns empty results. Query `DevopsTestSuiteStage` directly as shown above. Never expose raw API errors or raw JSON to the user. If a query fails, report the problem in plain language and stop. The commit diff comes from the user or surrounding context. --- ## Reasoning steps ### 1 — Classify the diff by change type Parse the diff file extensions and paths to determine what types of changes were made: | File pattern | Change type | |---|---| | `*.cls`, `*.trigger` | Apex | | `*.flow-meta.xml`, `*.flow` | Flow | | `*.java` | Java | | `*.js`, `*.html` (LWC paths) | LWC / JavaScript | A single commit may contain multiple change types. Identify all of them. ### 2 — Map change types to test providers For each change type identified, match against the `testProviderName` of the fetched suites: | Change type | Match suites whose `testProviderName` contains | |---|---| | Apex | `Apex` | | Flow | `Flow` | | Java | `Java` | | LWC / JavaScript | `LWC` or `JavaScript` | | Code Analyzer (any) | `Code Analyzer` — then sub-filter by suite name convention: `recommended` → Apex/general rules (suggest for Apex and Java changes), `html` → suggest for HTML/LWC template changes, `css` → suggest for CSS changes. If no suite name matches the convention, suggest all Code Analyzer suites and note the ambiguity. | Only recommend suites whose provider matches at least one change type in the diff. Suites from non-matching providers are excluded from the recommendation. ### 3 — Rank matched suites Within each matched provider group, rank suites by: 1. `triggerType` alignment — `Pre-Promote` suites first for commit-time checks 2. Quality gate presence — suites with a `qualityGateRuleName` are higher priority (they gate promotion) 3. Suite name relevance — if the suite name contains a term from the modified file names, boost it ### 4 — Flag new methods with no suite coverage For any new method added in the diff, flag it as a gap regardless of provider matching: > "⚠ `processRefund()` in `OrderService.cls` is a new method. No existing suite can confirm it's covered until tests are authored and linked." ### 5 — Return the recommendation list Group recommendations by change type so it's clear why each suite was suggested. --- ## Output format ```text Recommended suite(s) for this commit: Apex changes detected (OrderService.cls, InvoiceService.cls): 1. — Apex Test Provider | Trigger: Pre-Promote | Gate: 2. — Apex Test Provider | Trigger: Post-Promote | Gate: Flow changes detected (OrderApproval.flow): 1. — Flow Test Provider | Trigger: Pre-Promote | Gate: Code Analyzer — Apex rules: 1. — Code Analyzer | Trigger: Pre-Promote | Gate: No matching suite found for: - LWC changes — no LWC test suite is assigned to this stage Coverage gaps (new methods — manual authoring required): - `processRefund()` in `OrderService.cls` — new method, not yet covered by any suite ``` --- ## v1 constraint Only recommend existing suites. Never suggest generating new tests. If gaps exist, direct the developer to author tests manually and explain exactly which methods need coverage. --- ## Related skills - To analyze failures from a run, use `analyzing-test-failures`. - To actually execute a recommended suite, use `running-devops-test-suite`.