Puppeteer UI Automation Testing: Build reliable regression with stable locators and controlled data
Browser automation can easily become a slow, brittle collection of screenshots and fixed waits. Puppeteer earns its place when browser behavior is tied to observable evidence.
The Puppeteer UI Testing Skill centers navigation states, DOM evidence, and controlled browser context, so headless checks answer a real product question.
This guide uses reproducible scenarios to show how to apply it: define the risk and evidence first, then organize the checks and results into a defensible next step.
Awesome QA Skills organizes Skills by language and testing stage. The series overview covers repository structure and shared installation options; this guide stays with Puppeteer UI Testing.
Read the source Skill first
The main prompt covers Quality Bar, Output Format Options, How to Use, Reference Files, Common Pitfalls. Those headings are navigation; the project artifacts still provide the facts.
The source directory contains 1 example files, 2 references, 1 script entries. Start with Test scenario context example, Framework guide, Test execution script.
From artifacts to a runnable entry point
The task is concrete: Automate the checkout journey with Puppeteer, including stable locators, waits, isolated data, and failure evidence
The input can stay short, but it needs facts.
Journey: sign in → create order → pay → read result
Environment: staging
Available artifacts: interface definition, test account, CI command
Deliverable: tests/e2e/checkout.puppeteer.test.ts, plus the local command and failure evidence
The Skill should confirm versions, authentication, and data cleanup before generating files. This output fragment demonstrates structure; it does not claim a run occurred.
tool: Puppeteer
entry: tests/e2e/checkout.puppeteer.test.ts
checks: user-facing locators, isolated data, trace or screenshot evidence
run_evidence: pending
Keep run_evidence pending until a command, report, or trace exists. The source prompt also calls out Quality Bar, Output Format Options, How to Use.
Turn the fragment into a project skeleton
A code fragment becomes useful when its path, command, and artifacts are explicit. Start with one journey.
tests/e2e/checkout.puppeteer.test.ts
├── scenario and assertions
├── data or feeder
├── environment configuration
└── failure artifacts written to artifacts/
Use one reproducible local and CI command.
npm test -- checkout.puppeteer.test.ts
Wrap page setup and cleanup explicitly because Puppeteer supplies browser control, not a full test contract.
Definition of integrated
| Check | Minimum bar | If it fails |
|---|---|---|
| Repeatability | A run does not depend on leftover data | Rework setup and cleanup |
| Diagnosis | runner output, console logs, and failure screenshots identifies the same run | Add a run ID and build ID |
| CI decision | Process exit status matches the quality gate | Fix reporter or threshold configuration |
| Maintenance | Shared authentication and setup have one edit point | Extract a fixture, specification, or user action |
Expand into errors, boundaries, and concurrency only after this journey behaves the same locally and in CI.
A prompt you can adapt
Replace the bracketed fields with project facts. Specific material leaves less room for guessing.
Use the ui-test-puppeteer Skill.
Task: Automate the checkout journey with Puppeteer, including stable locators, waits, isolated data, and failure evidence
Version and environment: [requirement / build / environment]
Inputs: [file paths or links]
Scope: [included and excluded journeys]
Constraints: [accounts, data, time, compliance]
Check framework version, paths, and authentication first. Generate the smallest runnable entry, command, and artifact list. Mark unexecuted code as not verified.
Finish with open questions. Do not invent missing facts.
Use the first pass to inspect structure and gaps. Supply missing material before asking for the handoff-ready artifact.
Advanced use, from one call to a maintained flow
Puppeteer does not choose the runner, concurrency, or report format. Create a browser context per worker and centralize console, network, and screenshot capture.
Keep a baseline for duration, pass rate, flaky cases, failure classes, and evidence completeness. Pass rate alone hides too much.
A three-Skill chain
requirements-analysis → ui-test-puppeteer → test-reporting
| Handoff | Payload | Receiver check |
|---|---|---|
| Upstream to ui-test-puppeteer | Source versions, scope, risks, open questions | Puppeteer UI Testing staleness and conflicts |
| ui-test-puppeteer to downstream | Primary artifact, evidence index, unfinished work | Puppeteer UI Testing executability and owners |
| Feedback to ui-test-puppeteer | Runs, defects, new risks | Puppeteer UI Testing baseline and regression update |
Do not paste three complete outputs into one large prompt. Give Puppeteer UI Testing a structured summary and accessible source artifacts. It saves context and makes defects traceable.
Team gates
| Gate | Check | Failure action |
|---|---|---|
| ui-test-puppeteer input | Version, environment, owner, accessible sources | Stop Puppeteer UI Testing and list gaps |
| ui-test-puppeteer artifact | Material claims carry basis and status | Return Puppeteer UI Testing for evidence |
| ui-test-puppeteer execution | Command, exit status, report are reproducible | Classify infrastructure or test failure |
| ui-test-puppeteer decision | Residual risks have accepter and date | Do not enter the next stage |
Review Puppeteer UI Testing adoption, human edit rate, unsupported claims, and failure-to-diagnosis time each sprint. Record a baseline for several cycles before setting targets.
Common failure modes for this tool family
- Code is generated without a run command, leaving the next person unable to verify it.
- Versions and dependencies are omitted even though Puppeteer configuration and reporters change.
- Tests share dirty data. API, UI, and performance suites all suffer from leftovers.
- One green run is described as long-term stability. Keep reports, logs, and retry evidence.
Install and invoke
Install the individual Skill. The series overview carries the longer installation explanation.
npx skills add https://github.com/naodeng/awesome-qa-skills/tree/main/skills/en/testing-types/ui-test-puppeteer -g
Invoke it with “Use the ui-test-puppeteer Skill,” then attach the real artifacts.
Two practical questions
Will Puppeteer UI Testing hand me a runnable project?
With complete definitions, versions, paths, and dependencies, it can generate a strong starting point. You still need to install dependencies, run it in your repository, and fix environment differences.
When should generation stop?
Stop when authentication, test data, or the target version is unknown. More generation would only produce a polished guess.
What should be checked first after generation?
Confirm that the entry command discovers the target file and writes failure artifacts to the agreed path. Expand coverage after that works.
Can it enter a release gate immediately?
Wait until local and CI runs use the same command, data resets cleanly, and evidence is traceable.
Run Puppeteer UI Testing against one real artifact and keep the input, output, and review notes. The fragments here establish structure; project evidence must still come from the project.
References
- Awesome QA Skills project:https://github.com/naodeng/awesome-qa-skills
- Awesome QA Skills series overview:https://inaodeng.com/en/blog/ai-testing/introduction_of_awesome_qa_skills/
- Test scenario context example:https://github.com/naodeng/awesome-qa-skills/tree/main/skills/en/testing-types/ui-test-puppeteer/examples/sample-context.md
- Puppeteer UI Testing (EN) supporting references:https://github.com/naodeng/awesome-qa-skills/tree/main/skills/en/testing-types/ui-test-puppeteer/references/framework-spec.md
- Puppeteer UI Testing (EN) helper script: run-tests.sh:https://github.com/naodeng/awesome-qa-skills/tree/main/skills/en/testing-types/ui-test-puppeteer/scripts/run-tests.sh
- Awesome QA Skills: Puppeteer UI Testing (EN) Skill source:https://github.com/naodeng/awesome-qa-skills/tree/main/skills/en/testing-types/ui-test-puppeteer
- Puppeteer UI Testing Skill details:https://inaodeng.com/en/qaskills/ui-test-puppeteer/