“The Power of Bias in Economics Research”, John Ioannidis, T. D. Stanley, Hristos Doucouliagos2017-10-24 (economics, scientific bias, power analysis)⁠:

We investigate 2 critical dimensions of the credibility of empirical economics research: statistical power and bias.

We survey 159 empirical economics literatures that draw upon 64,076 estimates of economic parameters reported in more than 6,700 empirical studies.

Half of the research areas have nearly 90% of their results under-powered. The median statistical power is 18%, or less. A simple weighted average of those reported results that are adequately powered (power ≥ 80%) reveals that nearly 80% of the reported effects in these empirical economics literatures are exaggerated; typically, by a factor of 2 and with 1⁄3^rd inflated by a factor of 4 or more.

See Also:

• Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature

• On the reliability of published findings using the regression discontinuity design in political science

• Publication Bias in Empirical Sociological Research: Do Arbitrary Statistical-Significance Levels Distort Published Results?

• A peculiar prevalence of p values just below 0.05

• How to Make More Published Research True

• Contradicted and Initially Stronger Effects in Highly Cited Clinical Research

• On Attenuated Interactions, Measurement Error, and Statistical Power: Guidelines for Social and Personality Psychologists