Bibliography (556):

  1. Against NHST

  2. Why Most Published Research Findings Are False

  3. 2005-ioannidis-table4-positivepredictivevalueofpublicationsforpowervsbaseratevsbias.png

  4. Empirical estimates suggest most published medical research is true

  5. Estimating the reproducibility of psychological science

  6. Replication Studies: Bad Copy: In the Wake of High-Profile Controversies, Psychologists Are Facing up to Problems With Replication

  7. Full publication of results initially presented in abstracts

  8. Excess Statistical-Significance Bias in the Literature on Brain Volume Abnormalities

  9. 2007-kyzas.pdf

  10. The ‘File Drawer Problem’ of Non-Significant Results: Does It Apply to Biological Research?

  11. C:/ncn/bre587

  12. The Rules of the Game Called Psychological Science

  13. Publication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa

  14. A peculiar prevalence of p values just below 0.05

  15. A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null

  16. Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size

  17. A Meta-Analysis of the Export Growth Hypothesis

  18. Star Wars: The Empirics Strike Back

  19. Publication Bias in Empirical Sociological Research: Do Arbitrary Statistical-Significance Levels Distort Published Results?

  20. 2001-ioannidis-2.pdf

  21. Do Pressures to Publish Increase Scientists’ Bias? An Empirical Support from US States Data

  22. Negative results are disappearing from most disciplines and countries

  23. How Many Scientific Papers Should Be Retracted?

  24. https://journals.asm.org/doi/10.1128/iai.05661-11

  25. Persistence of Contradicted Claims in the Literature Dementia and Cognitive Impairment

  26. Do Rebuttals Affect Future Science?

  27. Incongruence between Test Statistics and _p_-Values in Medical Papers

  28. Erroneous Analyses of Interactions in Neuroscience: a Problem of Statistical-Significance

  29. Dr. John Ioannidis Exposes the Bad Science of Colleagues

  30. https://www3.nd.edu/~ghaeffel/Overblown_Pashler.pdf

  31. Drug Development: Raise Standards for Preclinical Cancer Research

  32. Scientific Reproducibility: Begley's Six Rules

  33. Further Confirmation Needed: A New Mechanism for Independently Replicating Research Findings Is One of Several Changes Required to Improve the Quality of the Biomedical Literature

  34. Editorial Note

  35. Health Care Myth Busters: Is There a High Degree of Scientific Certainty in Modern Medicine?

  36. Deming, Data and Observational Studies

  37. The Mouse Trap: The Dangers of Using One Lab Animal to Study Every Disease

  38. Genomic Responses in Mouse Models Poorly Mimic Human Inflammatory Diseases

  39. Large-Scale Assessment of the Effect of Popularity on the Reliability of Research

  40. Popularity versus Reliability in Medical Research

  41. Comparison of Effect Sizes Associated With Biomarkers Reported in Highly Cited Individual Articles and in Subsequent Meta-Analyses Breast Cancer

  42. Most reported genetic associations with general intelligence are probably false positives

  43. https://files.givewell.org/files/conversations/Stanley%20Young%20slides%20on%20multiple%20testing.pdf

  44. Controlling the False Discovery Rate: a Practical and Powerful Approach to Multiple Testing

  45. 1990-rothman.pdf

  46. Observational Research, Randomized Trials, and Two Views of Medical Science

  47. What’s Wrong With Bonferroni Adjustments

  48. 1985-godfrey.pdf

  49. 1987-pocock.pdf

  50. 1987-smith.pdf

  51. The Efficacy of Psychological, Educational, and Behavioral Treatment: Confirmation from Meta-Analysis

  52. Research in the Psychological Laboratory: Truth or Triviality?

  53. 2012-mitchell.pdf

  54. Empirical Evidence of Bias in Treatment Effect Estimates in Controlled Trials With Different Interventions and Outcomes: Meta-Epidemiological Study

  55. https://jenni.uchicago.edu/Spencer_Conference/Representative%20Papers/Richard%20et%20al,%202003.pdf

  56. At What Sample Size Do Correlations Stabilize?

  57. https://web-archive.southampton.ac.uk/cogprints.org/371/3/148.pdf

  58. 2011-simmons.pdf

  59. The Ironic Effect of Significant Results on the Credibility of Multiple-Study Articles

  60. 2013-button.pdf

  61. The Truth Wears Off: Is there something wrong with the scientific method?

  62. Jonah Lehrer, Scientists, and the Nature of Truth

  63. https://statmodeling.stat.columbia.edu/2010/12/13/the_truth_wears/

  64. https://www.lesswrong.com/posts/9qCN6tRBtksSyXfHu/frequentist-statistics-are-frequently-subjective

  65. Parapsychology: the Control Group for Science

  66. Using Degrees of Freedom to Change the past for Fun and Profit

  67. The Control Group Is Out Of Control

  68. The Neutral Model of Inquiry (Or, What Is the Scientific Literature, Chopped Liver?); Attention Conservation Notice: 900 Words of Wondering What the Scientific Literature Would Look like If It Were Entirely a Product of Publication Bias. Veils the Hard-Won Discoveries of Actual Empirical Scientists in Vague, Abstract, Hyper-Theoretical Doubts, without Alleging Any Concrete Errors. A Pile of Skeptical Nihilism, Best Refuted by Going back to the Lab.

  69. Open Access to Data: An Ideal Professed but Not Practised

  70. Lessons from the JMCB Archive

  71. Rewriting History

  72. What’s to know about the credibility of empirical economics?

  73. 2015-krawczyk.pdf

  74. The availability of research data declines rapidly with article age

  75. Compliance With Mandatory Reporting of Clinical Trial Results on ClinicalTrials.gov: Cross Sectional Study

  76. The Case for Open Computer Programs

  77. Computational Science: Error...why Scientific Programming Does Not Compute

  78. https://james.howison.name/pubs/HowisonHerbslebSciSoftCscw2011-all-figures.pdf

  79. The T-Experiments: Errors in Scientific Software

  80. 2009-anda.pdf

  81. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.121.5339&rep=rep1&type=pdf

  82. BCR Fall 2011_full

  83. Finance

  84. https://eusprig.org/horror-stories.htm

  85. The Importance of Excel

  86. https://norvig.com/experiment-design.html

  87. Why I Retracted My Nature Paper: A Guest Post from David Vaux about Correcting the Scientific Record

  88. Journal Rejects Studies Contradicting Precognition

  89. Notes from Two Scientific Psychologists: Failing to Replicate Bem's Ability to Get Published in a Major Journal

  90. Investigating Variation in Replicability: The `Many Labs` Replication Project

  91. A critical review of the first 10 years of candidate gene-by-environment interaction research in psychiatry

  92. Most Published Research Findings Are False—But a Little Replication Goes a Long Way

  93. https://nickbostrom.com/papers/converging.pdf

  94. The Debt Crisis and the Human Genome – Mandel on Innovation and Growth

  95. Drug Firms Face Billions in Losses As Patents End

  96. Academic Bias & Biotech Failures - LifeSciVCLifeSciVC

  97. A Survey on Data Reproducibility in Cancer Research Provides Insights into Our Limited Ability to Translate Findings from the Laboratory to the Clinic

  98. Believe It or Not: How Much Can We Rely on Published Data on Potential Drug Targets?

  99. Reliability of ‘New Drug Target’ Claims Called into Question

  100. 2011-osherovich.pdf

  101. Assessing uncertainty in physical constants

  102. Academic Overconfidence

  103. Peer-review in a world with rational scientists: Toward selection of the average

  104. Are Scientific Reputations Boosted Artificially?: Reputations Emerge in a Collective Manner. But Does This Guarantee That Fame Rests on Merit, Asks Philip Ball

  105. ‘Peer Review: a Flawed Process at the Heart of Science and Journals’, 2006

  106. Three Myths about Scientific Peer Review

  107. Effects of Editorial Peer Review: A Systematic Review

  108. Effect of Blinded Peer Review on Abstract Acceptance

  109. Science in the 21st Century: Social, Political, and Economic Issues

  110. The Philosophical Basis of Peer Review and the Suppression of Innovation

  111. Effect on the Quality of Peer Review of Blinding Reviewers and Asking Them to Sign Their Reports: A Randomized Controlled Trial

  112. How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data

  113. Measuring the Prevalence of Questionable Research Practices with Incentives for Truth-Telling

  114. https://projecteuclid.org/download/pdf_1/euclid.aoms/1177704711

  115. ​ How Should We Critique Research?

  116. https://statmodeling.stat.columbia.edu/2008/05/08/doing_the_candy/

  117. https://omega0.xyz/omega8008/ETJ-PS/cc8k.ps

  118. Probability Theory: The Logic Of Science

  119. https://omega0.xyz/omega8008/ETJ-PS/cc10i.ps

  120. 1959-schlaifer-probabilitystatisticsbusinessdecisions.pdf#page=488

  121. Statistical paradises and paradoxes in big data (1): Law of large populations, big data paradox, and the 2016 US presidential election

  122. Disentangling Bias and Variance in Election Polls

  123. The Lens That Sees Its Flaws

  124. The Relativity of Wrong

  125. ​ How Often Does Correlation=Causality?

  126. ​ Why Correlation Usually ≠ Causation

  127. ​ Littlewood’s Law and the Global Media

  128. ​ The Existential Risk of Math Errors

  129. ​ Leprechaun Hunting & Citogenesis

  130. ​ Hydrocephalus and Intelligence: The Hollow Men

  131. ​ Does Mouse Utopia Exist?

  132. ​ Dual n-Back Meta-Analysis

  133. ​ Lunar circadian rhythms

  134. ​ Open Questions § Jeanne Calment

  135. A replication and methodological critique of the study ‘Evaluating drug trafficking on the Tor Network’

  136. ​ ‘newsletter’ directory

  137. https://statmodeling.stat.columbia.edu/

  138. Replicability-Index

  139. Thinking about Evidence and vice Versa

  140. Retraction Watch – Tracking Retractions As a Window into the Scientific Process

  141. An opportunity cost model of subjective effort and task performance

  142. 2016-orquin.pdf

  143. Replicability Report #1: Is Ego-Depletion a Replicable Effect?

  144. Eyes Wide Shut or Eyes Wide Open?

  145. Ego Depletion May Disappear by 2020

  146. A Multisite Preregistered Paradigmatic Test of the Ego-Depletion Effect

  147. https://discovery.ucl.ac.uk/id/eprint/1472788/3/Shanks_Priming%20Mating%20Motives%20ms_FINAL_COMPLETE.pdf

  148. https://statmodeling.stat.columbia.edu/2013/12/17/replication-backlash/

  149. When Mice Mislead: Tackling a long-standing disconnect between animal and human studies, some charge that animal researchers need stricter safeguards and better statistics to ensure their science is solid

  150. https://www.science.org/content/blog-post/mice-studies-and-men

  151. The Dangers of Zero and One

  152. Do Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials

  153. 2003-krum.pdf

  154. Randomized Controlled Trials Commissioned by the Institute of Education Sciences Since 2002: How Many Found Positive Versus Weak or No Effects?

  155. https://www.nature.com/articles/507423a

  156. https://joshmitteldorf.scienceblog.com/2014/03/25/life-extension-supplements-a-reality-check/

  157. https://reflectivedisequilibrium.blogspot.com/2014/05/what-do-null-fields-tell-us-about-fraud.html

  158. https://statmodeling.stat.columbia.edu/2014/05/27/whole-fleet-gremlins-looking-carefully-richard-tols-twice-corrected-paper-economic-effects-climate-change/

  159. Theory-Testing in Psychology and Physics: A Methodological Paradox

  160. Nonindustry-Sponsored Preclinical Studies on Statins Yield Greater Efficacy Estimates Than Industry-Sponsored Studies: A Meta-Analysis

  161. If Correlation Doesn’t Imply Causation, Then What Does?

  162. Social Psychology Is A Flamethrower

  163. https://web.archive.org/web/20240325212821/https://www.econlib.org/archives/2011/10/teachers_and_in.html

  164. The Small Schools Myth

  165. https://www.frontiersin.org/journals/human-neuroscience/articles/10.3389/fnhum.2013.00291/full

  166. Personal Reflections on Lessons Learned from Randomized Trials Involving Newborn Infants, 1951–1967

  167. Publication bias in the social sciences: Unlocking the file drawer

  168. https://www.nature.com/articles/nature.2014.15787

  169. https://statmodeling.stat.columbia.edu/2014/08/28/publication-bias-social-sciences-unlocking-file-drawer2/

  170. On the Science and Ethics of Ebola Treatments

  171. Controlled trials: the 1948 watershed

  172. https://journals.sagepub.com/doi/full/10.1177/0306312714535679

  173. https://deepblue.lib.umich.edu/bitstream/handle/2027.42/68589/10.1177_0049124185013003002.pdf

  174. https://web.archive.org/web/20190617041250/http://www.coyneoftherealm.com/2014/09/25/critique-claims-blood-test-depression/

  175. World Values Lost in Translation

  176. http://stats.org.uk/statistical-inference/Bakan1966.pdf

  177. ​ ‘stereotype threat’ directory

  178. https://statmodeling.stat.columbia.edu/wp-content/uploads/2013/04/ganley-et-al.-stereotype-threat.pdf

  179. https://pure.uvt.nl/ws/portalfiles/portal/29125573/MTO_Flore_influence_of_gender_stereotype_CRiSP_2019.pdf#page=3

  180. Stereotype threat effects in settings with features likely versus unlikely in operational test settings: A meta-analysis

  181. Use of Placebo Controls in the Evaluation of Surgery: Systematic Review

  182. The Placebo Effect Doesn’t Apply Just to Pills

  183. How to Make More Published Research True

  184. https://statmodeling.stat.columbia.edu/2013/05/06/against-optimism-about-social-science/

  185. Deliberate practice: Is that all it takes to become an expert?

  186. 2014-horowitz.pdf

  187. Liberals Deny Science, Too

  188. Bayesian Data Analysis

  189. https://statmodeling.stat.columbia.edu/wp-content/uploads/2013/03/1154-Hauer-The-harm-done-by-tests-of-significance.pdf

  190. Unreliable Neuroscience? Why Power Matters

  191. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.138.3468&rep=rep1&type=pdf

  192. Social Psychology as History

  193. https://scottlilienfeld.com/wp-content/uploads/2021/01/lilienfeld2015-3.pdf

  194. Implications of ideological bias in social psychology on clinical practice

  195. Contradicted and Initially Stronger Effects in Highly Cited Clinical Research

  196. Non-replicable publications are cited more than replicable ones

  197. A ‘Sham Procedure’ Leads to Disappointing M.S. News

  198. Lysergic Acid Diethylamide (LSD-25): Xv. the Effects Produced By Substitution of a Tap Water Placebo

  199. https://kilthub.cmu.edu/articles/What_Went_Wrong_Reflections_on_Science_by_Observation_and_The_Bell_Curve/6493139/files/11937863.pdf#page=2

  200. Prisons Are Built With Bricks Of Law And Brothels With Bricks Of Religion, But That Doesn’t Prove A Causal Relationship

  201. Effects of remote, retroactive intercessory prayer on outcomes in patients with bloodstream infection: randomized controlled trial

  202. Evaluating Extraordinary Claims: Mind Over Matter? Or Mind Over Mind?

  203. Daniel Simons: What Effect Size Would You Expect?

  204. Scholarly Context Not Found: One in Five Articles Suffers from Reference Rot

  205. Should Psychological Neuroscience Research Be Funded?

  206. Should Psychological Neuroscience Research Be Funded?

  207. https://www.dcscience.net/Schuemie-Madigan-2012.pdf

  208. https://www.nejm.org/doi/full/10.1056/NEJMsa1409364

  209. Estimating the reproducibility of psychological science

  210. https://osf.io/ct89g/

  211. An Open Review of Many Labs 3: Much to Learn

  212. https://www.uv.es/sestio/TechRep/tr14-03.pdf

  213. Health Testing on Mice Is Found Misleading in Some Cases

  214. https://talyarkoni.org/blog/2011/01/10/the-psychology-of-parapsychology-or-why-good-researchers-publishing-good-articles-in-good-journals-can-still-get-it-totally-wrong/

  215. Columbia Data Science Course, Week 12: Predictive Modeling, Data Leakage, Model Evaluation

  216. https://journals.sagepub.com/doi/full/10.1177/1745691612459519

  217. Flat Priors and Other Improbable Tales

  218. The Economics of Reproducibility in Preclinical Research

  219. An alternative to null-hypothesis statistical-significance tests

  220. Effect of Monthly Vitamin D3 Supplementation in Healthy Adults on Adverse Effects of Earthquakes: Randomized Controlled Trial

  221. The Case of the Amazing Gay-Marriage Data: How a Graduate Student Reluctantly Uncovered a Huge Scientific Fraud

  222. https://www.science.org/content/article/does-ocean-acidification-alter-fish-behavior-fraud-allegations-create-sea-doubt

  223. https://web.archive.org/web/20190813183307/https://www.pbs.org/how-we-got-to-now/blogs/howwegottonext/how-one-man-poisoned-a-citys-water-supply-and-saved-millions-of-childrens-lives-in-the-process/

  224. Reanalyses of Randomized Clinical Trial Data Research, Methods, Statistics

  225. https://library.mpib-berlin.mpg.de/ft/gg/GG_Null_2004.pdf

  226. Should Anyone Be Given a Blood Transfusion?

  227. The Bayesian Reproducibility Project

  228. Statistical Methods for Replicability Assessment

  229. https://assets.press.princeton.edu/chapters/s8863.pdf

  230. Correlation, Causation, and Confusion

  231. The Perilous Plight of the (Non)-Replicator

  232. A New, Life-Or-Death Approach to Funding Heart Research

  233. When Quality Beats Quantity: Decision Theory, Drug Discovery, and the Reproducibility Crisis

  234. Artificial intelligence in drug discovery: what is realistic, what are illusions? Part 1: Ways to make an impact, and why we are not there yet: Quality is more important than speed and cost in drug discovery

  235. https://www.exp-platform.com/Documents/2012-09%20ACMRecSysNR.pdf

  236. https://web.archive.org/web/20121017235504/http://www.scilogs.com/the_gene_gym/my-published-negative-result

  237. SPP598377 1..5

  238. Is There a Publication Bias in Behavioral Intranasal Oxytocin Research on Humans? Opening the File Drawer of One Lab

  239. The Scientific Impact of Positive and Negative Phase 3 Cancer Clinical Trials

  240. The Stem-Cell Scandal

  241. Correlation and Causation in the Study of Personality

  242. https://www.newyorker.com/science/maria-konnikova/bilingual-advantage-aging-brain

  243. For Decades, Some Psychologists Have Claimed That Bilinguals Have Better Mental Control. Their Work Is Now Being Called into Question.

  244. https://www.psychologytoday.com/us/blog/life-bilingual/201906/the-bilingual-advantage-three-years-later

  245. 2017-mukadam.pdf

  246. https://addi.ehu.es/bitstream/handle/10810/26594/Is%20Bilingualism%20Associated2018.pdf?sequence=1&isAllowed=y

  247. No evidence for a bilingual executive function advantage in the nationally representative ABCD study

  248. The Advantages of Bilingualism Debate

  249. Bilingualism Affords No General Cognitive Advantages: A Population Study of Executive Function in 11,000 People

  250. Foreign language learning in older age does not improve memory or intelligence: Evidence from a randomized controlled study

  251. https://psmag.com/news/why-the-national-institutes-of-health-should-replace-peer-review-with-a-lottery/

  252. The Importance of "Gold Standard" Studies for Consumers of Research

  253. https://scholar.harvard.edu/files/fryer/files/handbook_fryer_03.25.2016.pdf

  254. Seven Pervasive Statistical Flaws in Cognitive Training Interventions

  255. Could a Neuroscientist Understand a Microprocessor?

  256. 2002-lazebnik.pdf

  257. Statistically Controlling for Confounding Constructs Is Harder than You Think

  258. Evaluating the Effect of Inadequately Measured Variables in Partial Correlation Analysis

  259. Regression Fallacies in the Matched Groups Experiment

  260. Control of Spurious Association and the Reliability of the Controlled Variable

  261. 11292_2015_9244_Article 1..31

  262. Why the ‘Psychoticism’ Error Took Years to Fix

  263. Can Results-Free Review Reduce Publication Bias? The Results and Implications of a Pilot Study

  264. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.372.6457&rep=rep1&type=pdf

  265. 2015-cofnas.pdf

  266. How Multiple Imputation Makes a Difference

  267. ​ The Iron Law Of Evaluation And Other Metallic Rules

  268. Saving Science

  269. Probing the Improbable: Methodological Challenges for Risks with Low Probabilities and High Stakes

  270. https://eml.berkeley.edu/~sdellavi/wp/expertsJul16.pdf

  271. Evaluating the replicability of social science experiments in Nature and Science 2010–2015

  272. Predicting replication outcomes in the Many Labs 2 study

  273. Laypeople Can Predict Which Social-Science Studies Will Be Replicated Successfully

  274. Does Reading a Single Passage of Literary Fiction Really Improve Theory of Mind? An Attempt at Replication

  275. We Gave Four Good Pollsters the Same Raw Data. They Had Four Different Results.

  276. https://www.nature.com/articles/nature.2016.20781

  277. https://www.nature.com/articles/533452a

  278. Stereotype (In)Accuracy in Perceptions of Groups and Individuals

  279. What Does Any of This Have To Do with Physics? Einstein and Feynman ushered me into grad school, reality ushered me out

  280. https://libstore.ugent.be/fulltxt/RUG01/002/304/385/RUG01-002304385_2016_0001_AC.pdf

  281. https://www.science.org/doi/10.1126/blog-post.12136

  282. Cancer Studies Are Fatally Flawed. Meet the Young Billionaire [John Arnold] Who’s Exposing the Truth About Bad Science

  283. Reconstruction of a Train Wreck: How Priming Research Went off the Rails

  284. Reporting Bias Inflates the Reputation of Medical Treatments: A Comparison of Outcomes in Clinical Trials and Online Product Reviews

  285. Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results

  286. Secondhand Smoke Isn’t As Bad As We Thought

  287. Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature

  288. Meta-assessment of bias in science

  289. When Evidence Says No, But Doctors Say Yes

  290. A Failure of Intelligence: Part I

  291. Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of ‘Far Transfer’: Evidence From a Meta-Analytic Review

  292. 2017-adams.pdf

  293. Proceeding From Observed Correlation to Causal Inference: The Use of Natural Experiments

  294. Daryl Bem Proved ESP Is Real. Which Means Science Is Broken.

  295. ​ One Man’s Modus Ponens

  296. Does High Self-Esteem Cause Better Performance, Interpersonal Success, Happiness, Or Healthier Lifestyles?

  297. 2014-02-25-matter-themanwhodestroyedamericasego.html

  298. https://www.theguardian.com/lifeandstyle/2017/jun/03/quasi-religious-great-self-esteem-con

  299. Computational Analysis of Lifespan Experiment Reproducibility

  300. Discontinuation and Nonpublication of Randomized Clinical Trials Conducted in Children

  301. The prior can generally only be understood in the context of the likelihood

  302. My IRB Nightmare

  303. The High Cost of Not Doing Experiments

  304. Very Large Treatment Effects in Randomized Trials As an Empirical Marker to Indicate Whether Subsequent Trials Are Necessary: Meta-Epidemiological Assessment

  305. https://amstat.tandfonline.com/doi/full/10.1080/01621459.2016.1240079

  306. Disappointing Findings on Conditional Cash Transfers As a Tool to Break the Poverty Cycle in the United States

  307. 2017-kjaer.pdf

  308. Sapping Attention: "Peer Review" Is Younger Than You Think. Does That Mean It Can Go Away?

  309. https://www.the-tls.co.uk/literature/reference/alternative-to-peer-review-essay-timothy-gowers

  310. The Lab @ DC - Body Worn Cameras

  311. A Big Test of Police Body Cameras Defies Expectations

  312. ‘Unbelievable’: Heart Stents Fail to Ease Chest Pain

  313. Percutaneous coronary intervention in stable angina (ORBITA): a double-blind, randomized controlled trial

  314. https://www.amazon.com/Ending-Medical-Reversal-Improving-Outcomes/dp/1421417723

  315. When the music’s over. Does music skill transfer to children’s and young adolescents’ cognitive and academic skills? A meta-analysis

  316. Does Far Transfer Exist? Negative Evidence From Chess, Music, and Working Memory Training

  317. Practice Does Not Make Perfect: No Causal Effect of Music Practice on Music Ability

  318. Cognitive and academic benefits of music training with children: A multilevel meta-analysis

  319. What’s College Good For?

  320. https://docs.iza.org/dp11110.pdf

  321. The Elusive Backfire Effect: Mass Attitudes’ Steadfast Factual Adherence

  322. The Minimal Persuasive Effects of Campaign Contact in General Elections: Evidence from 49 Field Experiments

  323. https://www.nber.org/system/files/working_papers/w24278/w24278.pdf

  324. Does Teaching Children How to Play Cognitively Demanding Games Improve Their Educational Attainment? Evidence from a Randomized Controlled Trial of Chess Instruction in England

  325. Evaluation of Evidence of Statistical Support and Corroboration of Subgroup Claims in Randomized Clinical Trials

  326. Inventing the Randomized Double-Blind Trial: The NĂŒrnberg Salt Test of 1835

  327. Questioning the Evidence on Hookworm Eradication in the American South

  328. Homogenous: The Political Affiliations of Elite Liberal Arts College Faculty

  329. https://users.cs.northwestern.edu/~robby/courses/322-2013-spring/mytkowicz-wrong-data.pdf

  330. Revisiting the Marshmallow Test: A Conceptual Replication Investigating Links Between Early Delay of Gratification and Later Outcomes

  331. https://ctlj.colorado.edu/wp-content/uploads/2015/08/Meyer-final.pdf

  332. The Impostor Cell Line That Set Back Breast Cancer Research.

  333. https://academic.oup.com/brain/article/140/5/1231/2951052

  334. P-Hacking and False Discovery in A/B Testing

  335. https://www.fda.gov/media/102332/download

  336. Effects of the Tennessee Prekindergarten Program on children’s achievement and behavior through third grade

  337. https://www.science.org/content/article/plan-replicate-50-high-impact-cancer-papers-shrinks-just-18

  338. https://www.science.org/content/article/researcher-center-epic-fraud-remains-enigma-those-who-exposed-him

  339. The prehistory of biology preprints: A forgotten experiment from the 1960s

  340. https://www.the-scientist.com/replication-failures-highlight-biases-in-ecology-and-evolution-science-64475

  341. The cumulative effect of reporting and citation biases on the apparent efficacy of treatments: the case of depression

  342. https://static.cambridge.org/binary/version/id/urn:cambridge.org:id:binary-alt:20181009171208-81978-mediumThumb-S0033291718001873_fig1g.jpg?pub-status=live

  343. https://www.science.org/doi/10.1126/science.aaf0918

  344. https://www.science.org/content/article/about-40-economics-experiments-fail-replication-survey-rev2

  345. https://ecommons.cornell.edu/server/api/core/bitstreams/1ea8a5a0-76f9-46ed-bf60-f6aa7b3413ca/content

  346. https://journals.sagepub.com/doi/10.1177/2515245917747646

  347. Logging Hypotheses and Protocols Before Performing Research Seems to Work As Intended: to Reduce Publication Bias for Positive Results

  348. The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases

  349. Why Do Humans Reason? Arguments for an Argumentative Theory

  350. https://www.pnas.org/doi/10.1073/pnas.1617102114

  351. The Wax and Wane of Ovulating-Woman Science: Evolutionary Psychology Has Long Been Mocked for Its Weird Obsession With the Menstrual Cycle, but at Least a Sliver of That Work Has Held up to Scrutiny

  352. Many Labs 2: Investigating Variation in Replicability Across Sample and Setting

  353. Generalizability of heterogeneous treatment effect estimates across samples

  354. Heterogeneity in direct replications in psychology and its association with effect size

  355. Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

  356. Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity

  357. Comparing meta-analyses and preregistered multiple-laboratory replication projects

  358. https://upworthyscience.com/a-star-surgeon-left-a-trail-of-dead-patients-and-his-whistleblowers-were-punished/

  359. Participants in Medical Research Are More Empowered Than Ever to Influence the Design and Outcomes of Experiments. Now, Researchers Are Trying to Keep Up

  360. 2018-salminen.pdf

  361. After Century of Removing Appendixes, Docs Find Antibiotics Can Be Enough: In a Five-Year Follow-Up, Nearly Two-Thirds of Patients Never Needed Surgery

  362. Causal language and strength of inference in academic and media articles shared in social media (CLAIMS): A systematic review

  363. The War over Supercooled Water

  364. ​ leprechaun#spinach

    [Transclude the forward-link's context]

  365. What’s Wrong With Psychology Anyway?

  366. Notes on a New Philosophy of Empirical Science

  367. Statistical Inference Through Data Compression

  368. A Machine Learning Perspective on Predictive Coding With PAQ8 and New Applications

  369. https://code.google.com/archive/p/paqclass

  370. The Association between Adolescent Well-Being and Digital Technology Use

  371. Rigorous Large-Scale Educational RCTs Are Often Uninformative: Should We Be Concerned?

  372. How Replicable Are Links Between Personality Traits and Consequential Life Outcomes? The Life Outcomes of Personality Replication Project

  373. Beware the Pitfalls of Short-Term Program Effects: They Often Fade

  374. Behavior Genetic Research Methods: Testing Quasi-Causal Hypotheses Using Multivariate Twin Data

  375. How Genome-Wide Association Studies (GWAS) Made Traditional Candidate Gene Studies Obsolete

  376. 5-HTTLPR: A Pointed Review

  377. No Support for Historical Candidate Gene or Candidate Gene-by-Interaction Hypotheses for Major Depression Across Multiple Large Samples

  378. https://www.pnas.org/doi/10.1073/pnas.1820701116

  379. The Hype Cycle of Working Memory Training

  380. Meta-Research: A comprehensive review of randomized clinical trials in three medical journals reveals 396 medical reversals

  381. The Big Crunch

  382. Supercentenarian and remarkable age records exhibit patterns indicative of clerical errors and pension fraud

  383. How Gullible are We? A Review of the Evidence from Psychology and Social Science

  384. Registered reports: an early example and analysis

  385. Models of Control and Control of Bias

  386. Editorial [EJP editorial on registered reports]

  387. On Publication Policy Regarding Non-Statistically-Significant Results: Some comments on Dr. J. B. Rhine’s article in the comments section of the J.P., 39, No 2, 135–142

  388. Fads, fashions, and folderol in psychology

  389. Responsibility for Raw Data

  390. Anthropology’s Science Wars: Insights from a New Survey

  391. https://public.tableau.com/app/profile/jurijfedorov#!/vizhome/AnthropologysScienceWars/Field

  392. Effect of Lower Versus Higher Red Meat Intake on Cardiometabolic and Cancer Outcomes: A Systematic Review of Randomized Trials

  393. The Obesity Research That Blew Up

  394. Reading Lies: Nonverbal Communication and Deception

  395. The small effects of political advertising are small regardless of context, message, sender, or receiver: Evidence from 59 real-time randomized experiments

  396. ​ Leprechaun Hunting & Citogenesis § Citogenesis: How Often Do Researchers Not Read The Papers They Cite?

  397. ​ movie#project-nim

    [Transclude the forward-link's context]

  398. Stanford professor who changed America with just one study was also a liar

  399. How David Rosenhan’s fraudulent Thud experiment set back psychiatry for decades: In the 1970s, a social psychologist published ‘findings’ deeply critical of American psychiatric methods. The problem was they were almost entirely fictional

  400. On being sane in insane places: A supplemental report

  401. On the troubling trail of psychiatry’s pseudopatients stunt: Susannah Cahalan’s investigation of the social-psychology experiment that saw healthy people sent to mental hospitals finds inconsistencies

  402. New Revelations About Rosenhan’s Pseudopatient Study: Scientific Integrity in Remission

  403. On Pseudoscience in Science, Logic in Remission, and Psychiatric Diagnosis: A Critique of Rosenhan’s ‘On Being Sane in Insane Places’

  404. Orchestrating false beliefs about gender discrimination

  405. Did Blind Orchestra Auditions Really Benefit Women?

  406. Debunking the Stanford Prison Experiment

  407. A real-life Lord of the Flies: the troubling legacy of the Robbers Cave experiment; In the early 1950s, the psychologist Muzafer Sherif brought together a group of boys at a US summer camp—and tried to make them fight each other. Does his work teach us anything about our age of resurgent tribalism? [an extract from The Lost Boys]

  408. https://web.archive.org/web/20160705141814/https://home.uchicago.edu/~npope/crowdsourcing_paper.pdf

  409. https://osf.io/9jzy4/

  410. 200 Researchers, 5 Hypotheses, No Consistent Answers

  411. How a Publicity Blitz Created The Myth of Subliminal Advertising

  412. The Struggles of a $40 Million Nutrition Science Crusade

  413. Why a Charity Focused on Giving Cash to East Africa Started Working near Houston.

  414. Biomedicine Facing a Worse Replication Crisis Than the One Plaguing Psychology

  415. https://blog.scienceexchange.com/2013/10/reproducibility-initiative-receives-1-3m-grant-to-validate-50-landmark-cancer-studies/

  416. Billionaires John and Laura Arnold’s Data-Driven Philanthropy

  417. The Four Most Dangerous Words? A New Study Shows

  418. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2019.02874/full

  419. Matthew Walker’s Why We Sleep Is Riddled with Scientific and Factual Errors

  420. Alexey Guzey’s homepage

  421. The maddening saga of how an Alzheimer’s ‘cabal’ thwarted progress toward a cure for decades

  422. A national experiment reveals where a growth mindset improves achievement

  423. A Meta-Analysis of Procedures to Change Implicit Measures

  424. Psychology’s Racism-Measuring Tool Isn’t Up to the Job

  425. The Implicit Association Test in Introductory Psychology Textbooks: Blind Spot for Controversy

  426. Rational Judges, Not Extraneous Factors In Decisions

  427. Impossibly Hungry Judges

  428. Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: a cohort study

  429. FDA and NIH let clinical trial sponsors keep results secret and break the law

  430. A controlled trial for reproducibility: For three years, part of DARPA has funded two teams for each project: one for research and one for reproducibility. The investment is paying off.

  431. The reproducibility of statistical results in psychological research: An investigation using unpublished raw data

  432. Producing Wrong Data Without Doing Anything Obviously Wrong!

  433. Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time

  434. On Attenuated Interactions, Measurement Error, and Statistical Power: Guidelines for Social and Personality Psychologists

  435. Variability in the analysis of a single neuroimaging dataset by many teams

  436. Towards Reproducible Brain-Wide Association Studies

  437. ​ ‘SLAM (fraud)’ directory

  438. Can Short Psychological Interventions Affect Educational Performance? Revisiting the Effect of Self-Affirmation Interventions

  439. Do police killings of unarmed persons really have spillover effects? Reanalyzing Bor et al 2018

  440. The statistical properties of RCTs and a proposal for shrinkage

  441. Off-target toxicity is a common mechanism of action of cancer drugs undergoing clinical trials

  442. How Two Researchers Paid a Price for Challenging a Retracted Study about Violent Video Games.

  443. https://www.science.org/content/article/research-linking-violent-entertainment-aggression-retracted-after-scrutiny

  444. ​ Lizardman Constant in Surveys

  445. RCTs to Scale: Comprehensive Evidence from Two Nudge Units

  446. Time to Assume That Health Research Is Fraudulent Until Proven Otherwise?

  447. The Chrysalis Effect: How Ugly Initial Results Metamorphosize Into Beautiful Articles

  448. Putting the Self in Self-Correction: Findings From the Loss-of-Confidence Project

  449. No effect of ‘watching eyes’: An attempted replication and extension investigating individual differences

  450. The Role of Human Fallibility in Psychological Research: A Survey of Mistakes in Data Management

  451. Reversals in Psychology

  452. A pre-registered, multi-lab non-replication of the action-sentence compatibility effect (ACE)

  453. Why CEA Has Stopped Using Net Promoter Score

  454. https://www.science.org/content/article/this-scientist-accused-supplement-industry-of-fraud-now-his-own-work-is-under-fire

  455. https://www.narratively.com/nick-brown-smelled-bull/

  456. Pygmalion In The Classroom: Teacher Expectation and Pupil’s Intellectual Development

  457. Experimenter Effects in Behavioral Research: Enlarged Edition

  458. Reviews: Rosenthal, Robert, and Jacobson, Lenore; ‘Pygmalion in the Classroom’ 1968

  459. But You Have to Know How to Tell Time

  460. 1969-snow.html

  461. Pygmalion Reconsidered: A Case Study in Statistical Inference: Reconsideration of the Rosenthal-Jacobson Data on Teacher Expectancy

  462. Five Decades Of Public Controversy Over Mental Testing

  463. The Self-Fulfillment of the Self-Fulfilling Prophecy: A Critical Appraisal

  464. Does Research Count in the Lives of Behavioral Scientists?

  465. Pygmalion and Intelligence?

  466. Beleaguered Pygmalion: A History of the Controversy Over Claims that Teacher Expectancy Raises Intelligence

  467. Teacher expectations and self-fulfilling prophecies: knowns and unknowns, resolved and unresolved controversies

  468. We’ve Been Here Before: The Replication Crisis over the Pygmalion Effect

  469. ​ Book Reviews § Experimenter Effects In Behavioral Research, Rosenthal1976

  470. https://www.reddit.com/r/skeptic/comments/14qbn9/rskeptic_i_was_practicing_graphpad_and_i_think_i/

  471. Chocolate Consumption, Cognitive Function, and Nobel Laureates

  472. Chocolate Consumption, Nobel Laureates, and Crappy Statistics

  473. Chocolate Consumption, Traffic Accidents and Serial Killers

  474. Spurious Correlation Bonanza to Mark Replicated Typo 2.0 Reaching 100,000 Hits

  475. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.361.4142&rep=rep1&type=pdf

  476. The Final Correlation: Bayesian Causal Graphs As an Alternative to Phylogenetics

  477. No Booze? You May Lose: Why Drinkers Earn More Money Than Nondrinkers

  478. Storks Deliver Babies (p = 0.008)

  479. New Evidence for the Theory of the Stork

  480. Correlated - Discover Surprising Correlations between Seemingly Unrelated Things

  481. Correlated: Surprising Connections Between Seemingly Unrelated Things

  482. Spurious Correlations

  483. https://www.google.com/trends/correlate/

  484. Google's New Correlation Mining Tool: It Works!

  485. Google's New Correlation Mining Tool: It Works!

  486. Google's New Correlation Mining Tool: It Works!

  487. https://slatestarcodex.com/blog_images/correlate_heart.png

  488. https://slatestarcodex.com/blog_images/correlate_booty.png

  489. https://slatestarcodex.com/blog_images/correlate_swim.png

  490. https://slatestarcodex.com/blog_images/correlate_metro.png

  491. https://www.google.com/trends/correlate/search?e=clojure&t=weekly&p=us

  492. https://www.google.com/trends/correlate/search?e=accident&t=weekly

  493. https://www.google.com/trends/correlate/search?e=migraine+headaches&t=weekly

  494. https://www.google.com/trends/correlate/search?e=Irritable+Bowel+Syndrome&t=weekly&p=us

  495. http://bit-player.org/wp-content/uploads/2011/05/interest-pills-450.png

  496. https://web.archive.org/web/20141213221339/http://sivertzendigital.tumblr.com/post/100823225645/google-correlate-correlation-for-advertising-and

  497. Obama Did Better in States Where Lots of People Search for 'Top Chef'

  498. https://www.google.com/trends/correlate/search?e=losing%20weight&e=rental%20homes&t=weekly

  499. 2011-09-slacktory-correlations-biebertonsillitis.png

  500. Obesity, Beer and Christianity: Or Correlation Does Not Equal Causation

  501. Rugby (The Religion of Wales) and Its Influence on the Catholic Church: Should Pope Benedict XVI Be Worried?

  502. Stupid Data Miner Tricks: Overfitting the S&P 500

  503. ​ Reproducibility Problems in Animal Studies in Science & Medicine

  504. Wikipedia Bibliography:

    1. replication crisis

    2. Statistical-significance

    3. Statistical power

    4. Publication bias

    5. Effect size

    6. The Atlantic

    7. John Ioannidis

    8. Reproducibility

    9. Sepsis

    10. Biomarker

    11. Single-nucleotide polymorphism

    12. Epidemiology

    13. Multiple comparisons problem

    14. Bonferroni correction

    15. Social psychology

    16. Pearson correlation coefficient

    17. Jonah Lehrer  :

      https://en.wikipedia.org/wiki/Jonah_Lehrer

    18. Legalized abortion and crime effect § Donohue and Levitt study  :

      https://en.wikipedia.org/wiki/Legalized_abortion_and_crime_effect#Donohue_and_Levitt_study

    19. Peter Norvig

    20. Daryl Bem § "Feeling the Future" controversy  :

      https://en.wikipedia.org/wiki/Daryl_Bem#%22Feeling_the_Future%22_controversy

    21. Journal of Personality and Social Psychology

    22. Nick Bostrom

    23. Anders Sandberg

    24. Venture capital § Venture capitalist  :

      https://en.wikipedia.org/wiki/Venture_capital#Venture_capitalist

    25. Bayer  :

      https://en.wikipedia.org/wiki/Bayer

    26. Scholarly peer review § Criticism  :

      https://en.wikipedia.org/wiki/Scholarly_peer_review#Criticism

    27. Halo effect

    28. Goodhart’s law

    29. Citation impact  :

      https://en.wikipedia.org/wiki/Citation_impact

    30. Michael Nielsen

    31. John Tukey

    32. Observational error § Random  :

      https://en.wikipedia.org/wiki/Observational_error#Random

    33. Observational error

    34. Edwin Thompson Jaynes

    35. Root-mean-square deviation

    36. Henri Poincaré

    37. Law of large numbers

    38. The Literary Digest § Presidential poll  :

      https://en.wikipedia.org/wiki/The_Literary_Digest#Presidential_poll

    39. Jamie Zawinski

    40. John L. Leal  :

      https://en.wikipedia.org/wiki/John_L._Leal

    41. Water chlorination  :

      https://en.wikipedia.org/wiki/Water_chlorination

    42. Phylogenetic autocorrelation

    43. Cognitive effects of bilingualism

    44. Scholarly peer review § Result-blind peer review  :

      https://en.wikipedia.org/wiki/Scholarly_peer_review#Result-blind_peer_review

    45. John D. Arnold  :

      https://en.wikipedia.org/wiki/John_D._Arnold

    46. Gompertz–Makeham law of mortality

    47. David Rosenhan

    48. Rosenhan experiment

    49. Self-esteem

    50. Parasite load  :

      https://en.wikipedia.org/wiki/Parasite_load

    51. Metronidazole  :

      https://en.wikipedia.org/wiki/Metronidazole

    52. Clojure

    53. Super Bowl indicator  :

      https://en.wikipedia.org/wiki/Super_Bowl_indicator