Experimentation
Experimentation helps you build a data-informed and test-driven culture, with an intuitive UI, a comprehensive experiment builder, and secure guardrails for testing in production.
Key Features
Run experiments for all platforms
Fostering an environment of testing, Experimentation supports running experiments across mobile and web applications, so a single experiment can cover every surface your product runs on.
A/B testing
Set up two or more versions of a website or mobile app against each other to determine which version leaves the maximum impact and drives business metrics.
Synergise with feature flags
After identifying a winning feature, roll it out with one click. You no longer need any extra engineering work to graduate an experiment into the product.
How it works
An experiment splits your users into variants and measures how each group behaves.
- Define the variants — the control, plus one or more alternatives.
- Choose who is included — everyone, or a segment of your users.
- Pick the metric that decides the winner — the behavior the experiment is trying to move.
- Run it until you have enough data to tell the variants apart.
- Roll out the winner as a feature flag, without a code change.
Because variant assignment is served through the DashX SDKs, the same experiment applies consistently across web, mobile, and backend.
Working with other apps
- Analytics supplies the event data experiments measure against.
- Account Center supplies the segments you target.
Getting Started
- Install the Experimentation app in your workspace.
- Install a DashX SDK in your application.
- Make sure the events you want to measure are being tracked by Analytics.
- Create your first experiment.
Decide the metric that defines success before you start the experiment. Choosing it afterwards, once you can see the results, is how teams talk themselves into a variant that did not actually win.