The abuse of power: The pervasive fallacy of power calculations for data analysis

Citation
Jm. Hoenig et Dm. Heisey, The abuse of power: The pervasive fallacy of power calculations for data analysis, AM STATISTN, 55(1), 2001, pp. 19-24
Citations number
41
Categorie Soggetti
Mathematics
Journal title
AMERICAN STATISTICIAN
ISSN journal
00031305 → ACNP
Volume
55
Issue
1
Year of publication
2001
Pages
19 - 24
Database
ISI
SICI code
0003-1305(200102)55:1<19:TAOPTP>2.0.ZU;2-P
Abstract
It is well known that statistical power calculations can be valuable in pla nning an experiment. There is also a large literature advocating that power calculations be made whenever one performs a statistical test of a hypothe sis and one obtains a statistically nonsignificant result. Advocates of suc h post-experiment power calculations claim the calculations should be used to aid in the interpretation of the experimental results. This approach, wh ich appears in various forms, is fundamentally flawed. We document that the problem is extensive and present arguments to demonstrate the flaw in the logic.