Personalisation is reported against a control group that never sees it. In the first month you receive the consent audit naming which signals your privacy policy allows and which it does not, the holdout design with its size and assignment written down, and the baseline for the metrics you chose. Each rule is then read against the control, by segment, and a rule that does not beat it is retired.
- 01Consent audit: the signals you may use, the ones you may not, and the boundary written down
- 02Holdout design: the control group, how it is assigned, and what it never sees
- 03Baseline: the metrics you chose, measured before any rule goes live
- 04Lift by segment: each rule against the control, with the confidence stated
- 05Retirement log: the rules that did not beat the control, and when they came out
















