Skip to content
~/reflective_data

analytics-dictionary / term / experimentation

Statistics

Statistics is the science of collecting, analysing and interpreting data, and quantifying uncertainty.

Written by Reflective Data experts · updated Oct 5, 2026

In experimentation it gives you the tools to tell real effects from random noise. The two main schools are frequentist and Bayesian statistics.

Understanding the basics prevents costly mistakes, like calling a test early or trusting a result that is only noise.

related

Bayesian statisticsFrequentist statisticsP-valueStatistical significance

// how we can help

We set up, audit and run experimentation programs on any tool. A/B testing services → · Audits

more in experimentation

kill-switch.md

Kill switch

A kill switch is a feature flag that can instantly turn a feature off in production.
win-rate.md

Win rate

Win rate is the percentage of experiments that produce a significant improvement.
multi-armed-bandit.md

Multi-armed bandit

A multi-armed bandit shifts traffic towards better-performing variants while a test is still running.
adobe-target.md

Adobe Target

Adobe Target is Adobe testing and personalisation tool, part of Adobe Experience Cloud.
server-side-testing.md

Server-side testing

Server-side testing runs experiments in your backend, so users get the assigned variant before the page…
ab-test.md

A/B test

An A/B test compares two versions of something by showing each to a random group of…

← full analytics dictionary