What should the sample size really be to get an accurate

Reference no: EM13241094

I run various A/B Split tests online. I always set all my tests for 10,000 visitors so page A and B are each equally rotated 5,000 times. My problem is that 10,000 is just an arbitrary number and doesn't really give me the true sample size that I should run, so in some tests I may have a good sample at 2,000 and in other tests I may need to go up to 20,000 pages to get an accurate result, but I have no idea. Is there a formula that I can use to determine the sample size in real-time so that as data is collected, the approximate sample size is calculated? Here's a real example based on data from two real-life tests that I'm running right now as I write this...

Test 1: A and B both have 4616 page views each. A has 82 conversions for a 1.78% conversion rate, and B has 76 conversions for a 1.65% conversion rate. This test is almost about to end, but should it? What should the sample size really be to get an accurate answer?

Test 2: A and B both have 1532 page views each. A has 50 conversions for a 3.26% conversion rate, and B has 36 conversions for a 2.35% conversion rate. Based on my 10,000 page limit, This test still has a while to go, but A already has a large 38.89% lead over B. What should the sample size really be to get an accurate answer?

Reference no: EM13241094

Questions Cloud

The equestrian portrait is an important subject : The Equestrian portrait is an important subject. What meanings does this subject convey? Identify several equestrian portraits, describe them carefully and discuss how they are interrelated.

Cultures of mesoamerica-south america and egypt : Speculate on the similarities in the monuments to the Sun god in cultures of Mesoamerica, South America, and Egypt.

Please explain how to work backward on a normal : Given a mean score of 70, standard deviation of 15,percentile of 23.Find the Z score,T score and raw score.

Differing business practices and fur trading styles : Compare and contrast the differing business practices and fur trading styles of the Hudson’s Bay Company and the Northwest Company down to the merger of the two in 1821.

What should the sample size really be to get an accurate : I run various A/B Split tests online. I always set all my tests for 10,000 visitors so page A and B are each equally rotated 5,000 times.

Assess the impact of an event on a population : Assess the impact of an event on a population. I ran a survey before the event and then I ran the survey after the event. The collected responses matched between prior to the event and after. I used paired t-test to determine if the event had a posit..

Nature of industrial relationship between workers-employers : How did the process of industrialization affect the nature of the industrial relationship between workers and their employers?

Do you have an opinion on this question : I want to know whether the StdError of the fitted score (SEYhat) can be legitimately interpreted normally for N=1 subject, with only one plotted Y score for each X value.

When estimating the mean of a population how large must the : When estimating the mean of a population, how large must the sample be in order that the 95% error margin is 1/8 the standard deviation?

User Account

All Pages