Estimating Your Test Completion Date and Making Changes

Leanplum provides an estimated length of time that will be required for your experiment to reach statistically significant results. Three inputs determine the length of time estimate:

  • the experiment goals
  • the experiment targets
  • the number and size of variants

Modifying any of these three inputs could shorten or lengthen the estimated time until results.

Changing goals: this will likely have the most substantial impact on reducing the estimated time until results. Click on the details button next to Time in your A/B test to reveal the estimated time calculation specific to each selected goal.

This provides insight into which goals are impacting the time estimate. You may choose to add or remove new goals to achieve an acceptable time until completion. 

Changing the targets:

If you decide it is acceptable to include a larger portion of your total audience in a particular test, you can modify the targets as you wish.

Changing the number of variants:

The more variants you have, the fewer number of users will fall into each group - thus extending the time required for completion. Click the ‘Add’ Variant button [screenshot] to add or remove.

Contact support@leanplum.com with any other questions. 


Was this article helpful?
Have more questions? Submit a request