A high mutation score can still miss the business rule that matters. A surviving mutant is useful only when the changed behavior has a reason to be observable.

Why this Skill is needed

Mutation Testing Analysis interprets code changes introduced by mutation tools and connects surviving meaningful mutants to missing tests or weak oracles.

What the Skill does

The Mutation Testing Analysis Skill is useful when a team needs a structured review of mutant meaning, killed or survived result, equivalent change, oracle strength, and risk.

Awesome QA Skills organizes Skills by language and testing stage. The series overview explains the shared installation model; this guide stays with Mutation Testing Analysis.

A practical standard for this Skill is simple: A useful analysis reads the mutant diff before reading the score. It asks whether the changed branch affects a user decision, then checks whether an existing test should have observed it.

Use it when the team needs a repeatable review of mutant meaning, killed or survived result, equivalent change, oracle strength, and risk—especially when several evidence sources disagree or a handoff must explain what remains unverified.

What it does not do

The Mutation Testing Analysis Skill can organize material, evidence, and next actions for Mutant classification. It does not replace:

  • Confirmation of rules, scope, and risk by the accountable domain owner.
  • A real environment, account, dataset, log, or run record; static analysis does not become runtime evidence by itself.
  • Authorization for release, compliance, production actions, or residual-risk acceptance.
  • A Human decision when supplied sources conflict.

What it checks

The value of this Skill is not another keyword list. It connects each focus area to an observable input, a judgment, and a way to close the loop. Start with a small matrix based on the source Skill’s output contract:

FocusQuestion before analysisHandoff output
Mutant classificationMeaningful, equivalent, untestable, or infrastructure-limitedBasis
Coverage gapRule or oracle not detected by the suiteRisk and test
ActionAdd assertion, case, invariant, or retain documented exclusionOwner and retest

If a row has only a conventional expectation and no source or validation method, keep it open instead of turning it into a pass.

Audit inputs before you start

Before analyzing Mutant classification, classify the input into six evidence states. A gap is not automatically a failure, but it must not disappear inside the conclusion.

StateMeaningHow this Skill should handle it
knownDirectly supported by the supplied materialKeep the source, version, and time with the judgment
missingNeeded for this pass but not suppliedName the smallest evidence action and limit the conclusion
conflictingSources disagreeShow both sources and route the conflict to an owner
stalePresent but outside the relevant version or time windowMark freshness; old evidence is not current proof
out_of_scopeRelated but excluded from this passKeep the boundary explicit
assumptionsTemporarily adopted to continue analysisState how and when the assumption will be checked

Keep the input version, scope, environment, evidence locations, and accountable owner together. Without a run record, deliver analysis, design, or a validation plan—not an execution pass.

From problem to structured Finding

Connect the source, scope, evidence state, analysis, owner, action, close condition, and validation before writing the conclusion. The case below keeps this Skill’s identifier and domain context.

Keep the decision layers separate

For Mutant classification, do not compress four different kinds of language into “recommended to pass”:

LayerHow to write itApplication here
FactWhat the supplied material directly showsCite the source, version, input, or run record for the focus
Evidence-backed InferenceWhat several facts support togetherShow the inference chain and retain uncertainty
RecommendationThe smallest next actionName the evidence, review, execution, or regression path
Human DecisionWhat an accountable person must decideLeave scope, risk acceptance, resources, and release meaning to the owner

A complete case

This case follows Input, Analysis, Finding, Decision, and Validation. When material is incomplete, keep missing, conflicting, or assumptions visible instead of turning them into a pass.

Input

MaterialWhat to provideWhat to do when it is missing
Mutation runTool, version, scope, mutant diff, result, and timeoutKeep environment and exclusions
Business rulesDiscount thresholds, exclusions, rounding, and priorityConnect mutants to rules
Test oracleAssertions, invariants, and expected business resultWeak assertions create false confidence

Use a request like this:

Use the mutation-testing-analysis Skill.

Task: analyze surviving mutants in a discount calculation module after a test suite reports 82 percent mutation score
Inputs: [requirements, versions, links, logs, reports, or data paths]
Scope: [included and excluded objects]
Unknowns: [missing environment, accounts, data, or permissions]
Expected output: [risk-ordered findings, evidence status, and next actions]

Audit the inputs first. Separate facts, assumptions, and open questions. Do not claim execution without a run record.

Analysis

Start with a bounded pass—analyze surviving mutants in a discount calculation module after a test suite reports 82 percent mutation score. A mutant changes a discount comparison from >= to >. Map it to the threshold rule, add the exact boundary amount, and verify the test asserts the final price—not merely that the calculation returns a number.

The handoff should preserve the input version, time window, evidence index, owner, and next validation action. The Skill can organize uncertainty; it cannot manufacture the missing artifact.

Finding

Example finding: turn one problem into a handoff

The field example below shows the recording pattern; it is not an execution result.

If the supplied material cannot prove that Mutant classification meets its contract, write the finding like this. It does not invent the missing rule or turn missing evidence into a failure.

FieldExample wording
Source and scopeRecord the requirement, version, environment, and the concrete object for Mutant classification
FindingThe condition or result for Mutant classification is not yet traceable to evidence
Evidence statemissing / assumptions; use conflicting when sources disagree
Impact and priorityName the affected user, journey, or delivery decision without inflating severity
Owner and Human decisionAsk the product, engineering, security, or test owner to confirm the rule and trade-off
Action and close conditionAdd the smallest missing evidence; close only when source, judgment, and owner can be reviewed
ValidationName one repeatable check, query, or run and retain the raw artifact

The point is to let the next person walk from the finding back to the source and run an action that can change the decision.

Decision

The accountable owner confirms the decision question and risk trade-off; the Skill does not make that choice.

Validation

Before closing the finding, run the stated validation and retain the raw artifact. Without an execution record, the status remains unverified.

How a Finding enters the next stage

Handoff output

Output fieldWhy it existsExample status
Mutant classificationMeaningful, equivalent, untestable, or infrastructure-limitedBasis
Coverage gapRule or oracle not detected by the suiteRisk and test
ActionAdd assertion, case, invariant, or retain documented exclusionOwner and retest

Do not write “passed” without a run record, query result, or source artifact. A useful analysis reads the mutant diff before reading the score. It asks whether the changed branch affects a user decision, then checks whether an existing test should have observed it.

Next-stage route

At minimum, hand off the source, evidence state, owner, close condition, and validation action; the next-stage conclusion remains bounded by the evidence state.

How to prepare better input

If the first request contains only a one-line goal, keep the output limited. Add the source version, affected objects, environment, known defects, and decision owner to move from a plausible checklist to a useful review.

A richer input changes the answer here because mutant meaning, killed or survived result, equivalent change, oracle strength, and risk must be tied to evidence rather than inferred from a familiar pattern.

Working with other Skills

Common traps

  1. Optimizing the score by killing irrelevant mutants.
  2. Calling every survivor a test gap.
  3. Ignoring timeouts and excluded files in the score.

Install and invoke

Install the individual Skill. The series overview carries the longer installation explanation.

npx skills add https://github.com/naodeng/awesome-qa-skills/tree/main/skills/en/testing-types/mutation-testing-analysis -g

After installation, invoke it with the mutation-testing-analysis Skill and attach the real project material.

FAQ

Is mutation score a release gate by itself?

No. It is evidence about test sensitivity and must be interpreted with risk, exclusions, and runtime evidence.

What should happen to an equivalent mutant?

Document why it cannot change observable behavior instead of adding a meaningless test.

The example above is a design and review pattern, not an execution result. Keep static analysis, runtime evidence, human approval, and release acceptance separate.

References

Source Skill and execution contract

The complete execution contract lives in the Mutation Testing Analysis prompt. Read it before invoking the Skill; the prompt defines the detailed workflow and output contract. The source directory contains the entry point and supporting assets where they exist.

The entry point centers mutant meaning, killed or survived result, equivalent change, oracle strength, and risk. Keep its decision boundary visible and do not turn a static design into an execution claim.

ACP (Agent Client Protocol)Active MemoryAgent EvalsAgentic WorkflowAI Agent
Share