186
Say no to BAYES
(mander.xyz)
A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.

Rules
This is a science community. We use the Dawkins definition of meme.
You can the issue with A-B comparison is that is kinda expected for one group to be higher on average simple based on the data points you selected.
If the averages are kinda similar and variance are high in both group A and B then I'd say both groups are statistically the same even if the statistical values are different
So you have two groups of ten experiments, mean if group A is 100, mean of group B is 105, variance is 25 (for both groups). Obviously we are not confident that these groups differ.
Now suppose we repeat the experiment two billion times. The group A average is now 99, and the group B average is now 103. The variance is still 25. Are you still not confident that the groups are different?