Experiment Health Check provides a series of diagnostics and checks to improve the probability of conclusive experiment results when you create a new app uplift experiment.
This article explains what issues Health Check may surface and ways to fix those issues. We recommend that you fix severe issues (in red) such as using an iOS app (currently not supported) and try to fix moderate issues with best effort (in yellow) such as Budget too low.
|
Issues that Health Check surfaces |
Reasons |
Ways to fix (Read best practices) |
|---|---|---|
|
App OS |
App uplift experiment currently only supports Android apps |
Choose an Android app |
|
Limited by budget |
If your campaign is limited by budget, it's unlikely that your testing assets will be able to get sufficient traffic in order to have conclusive experiment results. |
Raise your budget |
|
Bid too low |
If your campaign is limited by your bids, it's unlikely that your testing assets will be able to get sufficient traffic in order to have conclusive experiment results. |
Raise your target CPA or ROAS |
|
Budget too low |
If your campaign budget is too low, it's likely that your testing assets will get a low number of conversions, which can limit how well our models can optimise your experiment. |
Raise your budget |
|
Confidence level |
The confidence level that you chose may be too high relative to the campaign’s budget, which could cause your experiment to run longer than it should |
Lower the confidence level |
|
Experiment duration |
The duration that you set for your experiment is probably too short relative to the selected base campaign budget and the confidence level selected. This could prevent your experiment from delivering statistically significant results. |
Increase your experiment duration or lower the confidence level |
