With great power comes great confidence – statistically

Appeal for a higher power

Grant me the strength to accept that I cannot change the p-value, the power to distinguish between absence of evidence and evidence of absence and the wisdom to know the difference.

Vertical black traces represent confidence intervals, the horizontal blue line represents effect size = 0. At low power (2 left CIs), we don’t have much confidence about the effect size, regardless of statistical significance (2nd CI) or not (1st CI), limiting theoretical utility.
At high power (2 right CIs), the results are meaningfully interpretable, regardless of statistical significance.

This entry was posted in Uncategorized. Bookmark the permalink.

Leave a Reply

Your email address will not be published.


8 + three =