A/B Testing & Feature Flags
Ship behind a flag, measure the difference, roll back in seconds.
What this category is really about
Feature flags and experimentation are the same primitive used for two goals. A flag decouples deploy from release so you can ship dark and roll back instantly. An experiment takes the same split and attaches a statistical test to it.
The distinction that costs money is client-side versus server-side. Client-side tools inject a variant in the browser — trivial to install, visible flicker, and increasingly blocked. Server-side flags are evaluated in your own code, work anywhere, and require engineering to instrument.
Statistics deserve real scrutiny. Fixed-horizon tests stopped early produce false positives at rates far above the advertised 5%. If a vendor lets you watch a live p-value and stop when it dips, ask which sequential-testing correction they apply.
What to evaluate
Evaluation model
Server-side SDK, edge, or client script. This decides flicker, bot exposure and what you can experiment on.
Statistics engine
Sequential testing or CUPED beat a raw p-value. Ask how peeking is handled.
Flag hygiene
Stale-flag detection and code references. A codebase with 400 dead flags is a real maintenance tax.
Pricing metric
MTU, events, or seats. The same traffic can differ 10x in cost between vendors.
Common mistakes
- Calling a test after two days because the numbers look good.
- Running six overlapping experiments on the same funnel and not modelling the interaction.
- Measuring a proxy metric (clicks) that moved while the real metric (revenue) did not.
- Never removing flags, so every code path has four historical branches.
13 tools built for this
Sorted by how widely adopted they are, not by preference. Tick the compare boxes to put two or more side by side.
LaunchDarkly
The enterprise feature-flag platform, with experimentation layered on top.
GrowthBook
Open-source feature flags and experimentation that runs on your data warehouse.
Optimizely
The original web experimentation platform, now a full digital experience suite.
Statsig
Feature flags, experimentation and product analytics in one warehouse-friendly platform.
Unleash
Open-source feature management with a privacy-first, self-hosted architecture.
VWO
Experimentation plus heatmaps, replay and surveys in one conversion-optimisation suite.
AB Tasty
European experimentation and personalisation platform with strong GDPR positioning.
ConfigCat
Simple, cheap feature flags with unlimited team members on every plan.
Eppo
Warehouse-native experimentation with a serious statistics engine.
Flagsmith
Open-source feature flags and remote config with straightforward self-hosting.
Kameleoon
Experimentation and personalisation with a strong hybrid client/server model.
Split
Feature delivery with automatic impact measurement on every flag.
Convert Experiences
Privacy-focused A/B testing with unlimited experiments and no data selling.
Tools that also cover this
These are built primarily for something else but handle this category as part of a broader platform — often a way to consolidate two subscriptions into one.
Amplitude
Session Replay
Behavioural product analytics with strong cohort and retention analysis.
Heap
Session Replay
Autocapture analytics: every interaction is tracked, so you never miss an event again.
Matomo
Session Replay
Self-hosted web analytics with 100% data ownership and no sampling.
Maze
User Research
Rapid unmoderated testing on live products and Figma prototypes, with quantitative output.
PostHog
Session Replay
Open-source product analytics, replay, flags and experiments in one self-hostable platform.