Testsigma vs Cucumber

From $349 per month (indicative, cloud pro)

Free tier available

Cloud plans priced by parallel runs and users; the self-hosted community edition is free but you operate it.

Open source core. SmartBear sells CucumberStudio for collaborative scenario authoring, priced per user on request.

Open-source community edition, self-hosted.

The Cucumber libraries are open source and free.

Established

Testsigma Inc. · since 2019

Widely used

Smartbear · since 2008

• An open-source edition is unusual in the low-code segment and removes lock-in anxiety.
• Natural-language steps are readable by product owners.
• Web, mobile and API in one authoring model.

• Shared vocabulary between product, QA and engineering when the practice is actually followed.
• Scenarios double as living documentation that stays honest because it executes.
• Available in every major language.

• Natural-language authoring is only approximately natural; you still learn a grammar.
• Smaller community than the established low-code vendors, so troubleshooting is slower.
• The self-hosted edition trails the cloud on features.

• Almost always adopted as a syntax rather than a collaboration practice, at which point it is pure overhead on top of your real tests.
• The step-definition layer is a second codebase to maintain and refactor.
• Gherkin obscures technical detail that developers need when a test fails.

Teams that want low-code authoring but refuse to put their entire suite in a proprietary cloud.

Teams genuinely practising BDD with three-amigos sessions, not teams who just want prettier test names.