Evaluate experiment

Your test is now running and you want to evaluate the results. In the setup process you have committed to a test duration, and while it is tempting to peek at the results, it is important to wait until the test is completed - more on that in the following section.

Avoid peeking 👀

When doing AB testing, you are trying to improve the product with statistical concepts. For the statistical concepts to work, you need to commit to a test duration. If you peek at the results too early, you will bias the results and potentially end up with a false positive. False positive is when you conclude that your variant is statistically significantly better, when it is actually not. Check out this article by Ewan Miller -- How not to run an AB test -- for more information.

We automatically conclude your experiment

After the test has reached the desired session count, Sevensix will automatically conclude the experiment and evaluate the results. When you visit the experiment dashboard, you will see the results of the experiment, with an overview of the data, calculations and data visualizations. In some cases, you might want to extent the test and keep collecting data, in which case, we have an option to Extend results where you can see the the experiment with all collected data points.