Skip to content
testcritic

End-to-End & UI Test Automation

Drive a real browser through real user journeys, on every commit.

21 specialist tools7 free or open source10 self-hostable12 usable without code

What this category is really about

End-to-end tools open a browser, click through your product the way a person would, and tell you whether the journey still works. They are the only tests that exercise your front end, your API and your database in one pass, which makes them the most valuable and the most expensive tests you own.

The category split in two around 2020. Classic WebDriver tools (Selenium and its descendants) talk to the browser over an external protocol and support every language and browser under the sun. Newer in-process runners (Playwright, Cypress) run inside or alongside the browser, which buys them automatic waiting, time-travel debugging and dramatically lower flake — at the cost of a narrower browser matrix and a JavaScript-first world.

A third group sells you out of writing code at all: record-and-playback and AI-authored suites aimed at QA teams without a dedicated automation engineer. They shorten time-to-first-test enormously and cost more per seat, and the honest trade is that you own less of what breaks.

What to evaluate

01

Flake resistance

Auto-waiting, retry semantics and network stubbing matter more than raw speed. A suite that fails 3% of the time at random gets ignored within a month.

02

Language fit

A suite your developers can read is a suite developers will fix. If your app is TypeScript, a TypeScript runner removes a whole context switch.

03

Parallelism and CI cost

Wall-clock time on CI is the real constraint. Check whether parallel shards are free, self-hosted, or billed per minute.

04

Debuggability of a failed run

Traces, videos, DOM snapshots and step-level screenshots turn a 45-minute triage into a 3-minute one.

05

Browser and device matrix

Chromium-only is fine for an internal tool and not fine for consumer e-commerce. Check Safari/WebKit support specifically.

Common mistakes

  • Automating everything. E2E belongs at the top of the pyramid — a few dozen critical journeys, not a thousand form-field assertions.
  • Testing through the UI what an API test could answer in 40ms.
  • Choosing a codeless tool to avoid hiring, then discovering nobody owns the suite when it goes red.
  • Ignoring test data setup. Most E2E flake traces back to shared, mutable state rather than the runner.

21 tools built for this

Sorted by how widely adopted they are, not by preference. Tick the compare boxes to put two or more side by side.

Filter these

Cypress

Developer-first browser testing with an interactive runner developers actually enjoy.

from $75Open sourceSelf-host

Playwright

Microsoft's cross-browser automation library with tracing and auto-waiting built in.

Open sourceSelf-host

Selenium WebDriver

The W3C standard for browser automation. Every language, every browser, twenty years of it.

Open sourceSelf-host

Cucumber

Behaviour-driven development with Gherkin scenarios shared by business and engineering.

Free tierOpen sourceSelf-host

Katalon Studio

All-in-one low-code platform covering web, API, mobile and desktop.

from $175No-code

Puppeteer

Chrome automation library from the Chrome team. Great for scraping, thin for testing.

Open sourceSelf-host

Robot Framework

Keyword-driven acceptance testing that reads like structured English.

Open sourceNo-codeSelf-host

Tricentis Tosca

Model-based enterprise test automation for SAP, mainframe and packaged applications.

Talk to salesNo-code

WebdriverIO

A batteries-included JavaScript framework over WebDriver and Chrome DevTools.

Open sourceSelf-host

mabl

Low-code, AI-assisted test automation with self-healing locators.

Talk to salesNo-code

Nightwatch.js

Integrated W3C WebDriver framework with a readable, chainable API.

Open sourceSelf-host

Ranorex Studio

Windows-centric automation for desktop, web and mobile from one IDE.

from €4kNo-code

TestCafe

Node.js E2E testing with no WebDriver, no plugins and no browser binaries to manage.

Open sourceSelf-host

Testim

AI-assisted authoring with smart locators, now part of Tricentis.

Talk to salesNo-code

Testsigma

Write tests in plain English, run them on web, mobile and APIs.

from $349Open sourceNo-codeSelf-host

Autify

AI-maintained web and mobile tests aimed at teams with no automation engineers.

Talk to salesNo-code

Leapwork

Visual flowchart automation designed for business users, not engineers.

Talk to salesNo-code

QA Wolf

Outsourced E2E coverage: they write and maintain your Playwright suite.

Talk to sales

Rainforest QA

No-code test automation with an on-demand human tester fallback.

Talk to salesNo-code

Reflect

No-code browser testing recorded in the cloud, with visual and API assertions.

from $99No-code

Virtuoso QA

Natural-language authoring with self-healing, aimed at enterprise QA teams.

Talk to salesNo-code

Tools that also cover this

These are built primarily for something else but handle this category as part of a broader platform — often a way to consolidate two subscriptions into one.

Appium

Mobile Testing

The cross-platform standard for native, hybrid and mobile-web automation.

Open sourceSelf-host

axe-core

Accessibility

The open-source accessibility rules engine almost every other tool is built on.

Open sourceSelf-host

BrowserStack

Device Cloud

The largest browser and real-device cloud, with 3,500+ device/browser combinations.

from $29

Datadog Synthetic Monitoring

Monitoring

Synthetic checks correlated with APM traces, logs and infrastructure metrics.

from $5No-code

Checkly

Monitoring

Monitoring as code: your Playwright scripts, running against production on a schedule.

from $40

Detox

Mobile Testing

Grey-box E2E testing built specifically for React Native.

Open sourceSelf-host

Karate

API Testing

API testing, mocks, performance and UI automation in one Gherkin-based DSL.

Free tierOpen sourceNo-codeSelf-host

LambdaTest

Device Cloud

Cost-competitive device cloud with an AI-assisted test-orchestration layer.

from $15

Maestro

Mobile Testing

Mobile UI testing in a few lines of YAML, with tolerance for flakiness built in.

Free tierOpen sourceNo-codeSelf-host

Sauce Labs

Device Cloud

Enterprise-grade device cloud with deep analytics and strong security posture.

from $39

Selenium Grid

Device Cloud

Run your own browser grid on your own infrastructure, for free.

Open sourceSelf-host

TestNG

Unit & Component

Java test framework built for suite configuration, grouping and data providers.

Open sourceSelf-host

Waldo

Mobile Testing

No-code mobile testing recorded in a browser-based device session.

Talk to salesNo-code