Chapters 11-12: Applied Statistics and A/B Experiments
Statistical reminders and A/B calculator
Make decisions based on statistical rigor. Don't confuse chance with actual performance change.
Enter your digital data separated by commas or line breaks to calculate central tendency indicators (Mean, Median, Mode), range (Min, Max), and isolate outliers.
Mean
27.70
Median (Median)
15.00
Mode
15
Minimum (Min)
12
Maximum (Max)
130
Sample size (N)
10
Detection of aberrant values (Interquartile Range IQR)
Thresholds: [Q1 - 1.5*IQR, Q3 + 1.5*IQR]
No outliers detected.
Distribution and central tendency visualization
Enter value pairs (X and Y), one per line, separated by a comma. Ex: Load time (X) vs Bounce rate (Y).
Pearson correlation coefficient (r)
0.985
Coefficient of Determination (R²)
0.970
Regression Equation
y = 14.5x - 7.1
Correlation diagnosis
Strong positive correlation.
Extrapolation and prediction of a new value X
[IC 95%] Prediction Ŷ
—
Scatter plot and regression line visualization
Enter the sample size (exposure) and observed result (events/successes) for both groups.
Variant A (control group)
Variant B (test group)
Loading...
Observed Rate A
3.00%
Observed Rate B
3.43%
Absolute lift
+0.43 pt
Relative lift
+14,38%
IC of the difference B − A
[-0.05; +0.91] pt
Z-Score value
1.75
P-Value
0.0801
Targeted power
80%
A vs B comparison visualization (rates and confidence intervals)
Key concepts
References and academic sources
Hamel, Stéphane. 2026. The art of digital analytics: Transforming imperfect data into better decisions. Montreal. (Chapters 11-12).
Kohavi, Ron, Diane Tang et Ya Xu. 2020. Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing. Cambridge: Cambridge University Press.
Spiegel, Murray R. et Larry J. Stephens. 2017. Statistics. 5th ed. Paris: Schaum's.