I told a guy that a wide variance in data essentially means that results were random then he proceeded to explain p values and I’m like “yeah I’m sure the random values values came from nature”.
You can the issue with A-B comparison is that is kinda expected for one group to be higher on average simple based on the data points you selected.
If the averages are kinda similar and variance are high in both group A and B then I’d say both groups are statistically the same even if the statistical values are different
I told a guy that a wide variance in data essentially means that results were random then he proceeded to explain p values and I’m like “yeah I’m sure the random values values came from nature”.
Moral is p values kinda worth less than variance
Are you saying you can’t determine a difference in aggregate statistics by performing more trials if the variance is high?
You can the issue with A-B comparison is that is kinda expected for one group to be higher on average simple based on the data points you selected.
If the averages are kinda similar and variance are high in both group A and B then I’d say both groups are statistically the same even if the statistical values are different