Estimating your test completion date and making changes

Leanplum provides an estimated length of time that will be required for your experiment to reach statistically significant results.

Screen_Shot_2017-08-09_at_3.15.56_PM.png

Three inputs determine the length of time estimate:

  • the experiment goals
  • the experiment targets
  • the number and size of variants

Modifying any of these three inputs could shorten or lengthen the test time estimate.

Changing goals:

This will likely have the most substantial impact on reducing the estimated time until significant results. Click the details button next to Time in your A/B test to reveal the estimated time calculation specific to each selected goal.

These details give insight into which goals are affecting the time estimate most. You may choose to add or remove new goals to achieve an acceptable amount of time until completion. 

Changing the targets:

Sometimes the target audience is too small to reach statistically significant results fast. If you can include a larger portion of your total audience in the test, you can modify the targets to speed up the time estimate.

Changing the number of variants:

The more variants you have, less users will fall into each group. A smaller sample size means it will take longer for your test to reach significant results. Click the X in the variant table to delete a variant, or click the Add ( + ) Variant button to add one.

Screen_Shot_2017-08-09_at_3.20.36_PM.png

Contact support@leanplum.com with any other questions. 


Was this article helpful?
Have more questions? Submit a request