analytics-dictionary / term / experimentation

Kill switch

A kill switch is a feature flag that can instantly turn a feature off in production.

Written by Reflective Data experts · updated Oct 5, 2026

It is a safety net for risky launches or third-party failures. Because it is a configuration change, no new release is needed.

Test the kill switch before you need it.

// how we can help

We set up, audit and run experimentation programs on any tool. A/B testing services → · Audits

A multivariate test changes several elements at once and measures the effect of every combination.

Statsig is a product experimentation platform with feature gates, experiments and analytics.

A guardrail metric is a measure you monitor during a test to make sure the change…

An A/A test splits users into two groups that get the same experience, to check that…

Effect size is the magnitude of a difference between variants, not just whether it exists.

CUPED reduces variance in experiments by using pre-experiment data about each user, so tests reach conclusions…