Against NHST
Why Most Published Research Findings Are False
2005-ioannidis-table4-positivepredictivevalueofpublicationsforpowervsbaseratevsbias.png
Empirical estimates suggest most published medical research is true
Estimating the reproducibility of psychological science
Replication Studies: Bad Copy: In the Wake of High-Profile Controversies, Psychologists Are Facing up to Problems With Replication
Full publication of results initially presented in abstracts
Excess Statistical-Significance Bias in the Literature on Brain Volume Abnormalities
2007-kyzas.pdf
The âFile Drawer Problemâ of Non-Significant Results: Does It Apply to Biological Research?
C:/ncn/bre587
The Rules of the Game Called Psychological Science
Publication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa
A peculiar prevalence of p values just below 0.05
A Vast Graveyard of Undead Theories: Publication Bias and Psychological Scienceâs Aversion to the Null
Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size
A Meta-Analysis of the Export Growth Hypothesis
Star Wars: The Empirics Strike Back
Publication Bias in Empirical Sociological Research: Do Arbitrary Statistical-Significance Levels Distort Published Results?
2001-ioannidis-2.pdf
Do Pressures to Publish Increase Scientistsâ Bias? An Empirical Support from US States Data
Negative results are disappearing from most disciplines and countries
How Many Scientific Papers Should Be Retracted?
https://journals.asm.org/doi/10.1128/iai.05661-11
Persistence of Contradicted Claims in the Literature Dementia and Cognitive Impairment
Do Rebuttals Affect Future Science?
Incongruence between Test Statistics and p-Values in Medical Papers
Erroneous Analyses of Interactions in Neuroscience: a Problem of Statistical-Significance
Dr. John Ioannidis Exposes the Bad Science of Colleagues
https://www3.nd.edu/~ghaeffel/Overblown_Pashler.pdf
Drug Development: Raise Standards for Preclinical Cancer Research
Scientific Reproducibility: Begley's Six Rules
Further Confirmation Needed: A New Mechanism for Independently Replicating Research Findings Is One of Several Changes Required to Improve the Quality of the Biomedical Literature
Editorial Note
Health Care Myth Busters: Is There a High Degree of Scientific Certainty in Modern Medicine?
Deming, Data and Observational Studies
The Mouse Trap: The Dangers of Using One Lab Animal to Study Every Disease
Genomic Responses in Mouse Models Poorly Mimic Human Inflammatory Diseases
Large-Scale Assessment of the Effect of Popularity on the Reliability of Research
Popularity versus Reliability in Medical Research
Comparison of Effect Sizes Associated With Biomarkers Reported in Highly Cited Individual Articles and in Subsequent Meta-Analyses Breast Cancer
Most reported genetic associations with general intelligence are probably false positives
https://files.givewell.org/files/conversations/Stanley%20Young%20slides%20on%20multiple%20testing.pdf
Controlling the False Discovery Rate: a Practical and Powerful Approach to Multiple Testing
1990-rothman.pdf
Observational Research, Randomized Trials, and Two Views of Medical Science
Whatâs Wrong With Bonferroni Adjustments
1985-godfrey.pdf
1987-pocock.pdf
1987-smith.pdf
The Efficacy of Psychological, Educational, and Behavioral Treatment: Confirmation from Meta-Analysis
Research in the Psychological Laboratory: Truth or Triviality?
2012-mitchell.pdf
Empirical Evidence of Bias in Treatment Effect Estimates in Controlled Trials With Different Interventions and Outcomes: Meta-Epidemiological Study
https://jenni.uchicago.edu/Spencer_Conference/Representative%20Papers/Richard%20et%20al,%202003.pdf
At What Sample Size Do Correlations Stabilize?
https://web-archive.southampton.ac.uk/cogprints.org/371/3/148.pdf
2011-simmons.pdf
The Ironic Effect of Significant Results on the Credibility of Multiple-Study Articles
2013-button.pdf
The Truth Wears Off: Is there something wrong with the scientific method?
Jonah Lehrer, Scientists, and the Nature of Truth
https://statmodeling.stat.columbia.edu/2010/12/13/the_truth_wears/
https://www.lesswrong.com/posts/9qCN6tRBtksSyXfHu/frequentist-statistics-are-frequently-subjective
Parapsychology: the Control Group for Science
Using Degrees of Freedom to Change the past for Fun and Profit
The Control Group Is Out Of Control
The Neutral Model of Inquiry (Or, What Is the Scientific Literature, Chopped Liver?); Attention Conservation Notice: 900 Words of Wondering What the Scientific Literature Would Look like If It Were Entirely a Product of Publication Bias. Veils the Hard-Won Discoveries of Actual Empirical Scientists in Vague, Abstract, Hyper-Theoretical Doubts, without Alleging Any Concrete Errors. A Pile of Skeptical Nihilism, Best Refuted by Going back to the Lab.
Open Access to Data: An Ideal Professed but Not Practised
Lessons from the JMCB Archive
Rewriting History
Whatâs to know about the credibility of empirical economics?
2015-krawczyk.pdf
The availability of research data declines rapidly with article age
Compliance With Mandatory Reporting of Clinical Trial Results on ClinicalTrials.gov: Cross Sectional Study
The Case for Open Computer Programs
Computational Science: Error...why Scientific Programming Does Not Compute
https://james.howison.name/pubs/HowisonHerbslebSciSoftCscw2011-all-figures.pdf
The T-Experiments: Errors in Scientific Software
2009-anda.pdf
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.121.5339&rep=rep1&type=pdf
BCR Fall 2011_full
Finance
https://eusprig.org/horror-stories.htm
The Importance of Excel
https://norvig.com/experiment-design.html
Why I Retracted My Nature Paper: A Guest Post from David Vaux about Correcting the Scientific Record
Journal Rejects Studies Contradicting Precognition
Notes from Two Scientific Psychologists: Failing to Replicate Bem's Ability to Get Published in a Major Journal
Investigating Variation in Replicability: The `Many Labs` Replication Project
A critical review of the first 10 years of candidate gene-by-environment interaction research in psychiatry
Most Published Research Findings Are FalseâBut a Little Replication Goes a Long Way
https://nickbostrom.com/papers/converging.pdf
The Debt Crisis and the Human Genome â Mandel on Innovation and Growth
Drug Firms Face Billions in Losses As Patents End
Academic Bias & Biotech Failures - LifeSciVCLifeSciVC
A Survey on Data Reproducibility in Cancer Research Provides Insights into Our Limited Ability to Translate Findings from the Laboratory to the Clinic
Believe It or Not: How Much Can We Rely on Published Data on Potential Drug Targets?
Reliability of âNew Drug Targetâ Claims Called into Question
2011-osherovich.pdf
Assessing uncertainty in physical constants
Academic Overconfidence
Peer-review in a world with rational scientists: Toward selection of the average
Are Scientific Reputations Boosted Artificially?: Reputations Emerge in a Collective Manner. But Does This Guarantee That Fame Rests on Merit, Asks Philip Ball
âPeer Review: a Flawed Process at the Heart of Science and Journalsâ, 2006
Three Myths about Scientific Peer Review
Effects of Editorial Peer Review: A Systematic Review
Effect of Blinded Peer Review on Abstract Acceptance
Science in the 21st Century: Social, Political, and Economic Issues
The Philosophical Basis of Peer Review and the Suppression of Innovation
Effect on the Quality of Peer Review of Blinding Reviewers and Asking Them to Sign Their Reports: A Randomized Controlled Trial
How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data
Measuring the Prevalence of Questionable Research Practices with Incentives for Truth-Telling
https://projecteuclid.org/download/pdf_1/euclid.aoms/1177704711
â How Should We Critique Research?
https://statmodeling.stat.columbia.edu/2008/05/08/doing_the_candy/
https://omega0.xyz/omega8008/ETJ-PS/cc8k.ps
Probability Theory: The Logic Of Science
https://omega0.xyz/omega8008/ETJ-PS/cc10i.ps
1959-schlaifer-probabilitystatisticsbusinessdecisions.pdf#page=488
Statistical paradises and paradoxes in big data (1): Law of large populations, big data paradox, and the 2016 US presidential election
Disentangling Bias and Variance in Election Polls
The Lens That Sees Its Flaws
The Relativity of Wrong
â How Often Does Correlation=Causality?
â Why Correlation Usually â Causation
â Littlewoodâs Law and the Global Media
â The Existential Risk of Math Errors
â Leprechaun Hunting & Citogenesis
â Hydrocephalus and Intelligence: The Hollow Men
â Does Mouse Utopia Exist?
â Dual n-Back Meta-Analysis
â Lunar circadian rhythms
â Open Questions § Jeanne Calment
A replication and methodological critique of the study âEvaluating drug trafficking on the Tor Networkâ
â ânewsletterâ directory
https://statmodeling.stat.columbia.edu/
Replicability-Index
Thinking about Evidence and vice Versa
Retraction Watch â Tracking Retractions As a Window into the Scientific Process
An opportunity cost model of subjective effort and task performance
2016-orquin.pdf
Replicability Report #1: Is Ego-Depletion a Replicable Effect?
Eyes Wide Shut or Eyes Wide Open?
Ego Depletion May Disappear by 2020
A Multisite Preregistered Paradigmatic Test of the Ego-Depletion Effect
https://discovery.ucl.ac.uk/id/eprint/1472788/3/Shanks_Priming%20Mating%20Motives%20ms_FINAL_COMPLETE.pdf
https://statmodeling.stat.columbia.edu/2013/12/17/replication-backlash/
When Mice Mislead: Tackling a long-standing disconnect between animal and human studies, some charge that animal researchers need stricter safeguards and better statistics to ensure their science is solid
https://www.science.org/content/blog-post/mice-studies-and-men
The Dangers of Zero and One
Do Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials
2003-krum.pdf
Randomized Controlled Trials Commissioned by the Institute of Education Sciences Since 2002: How Many Found Positive Versus Weak or No Effects?
https://www.nature.com/articles/507423a
https://joshmitteldorf.scienceblog.com/2014/03/25/life-extension-supplements-a-reality-check/
https://reflectivedisequilibrium.blogspot.com/2014/05/what-do-null-fields-tell-us-about-fraud.html
https://statmodeling.stat.columbia.edu/2014/05/27/whole-fleet-gremlins-looking-carefully-richard-tols-twice-corrected-paper-economic-effects-climate-change/
Theory-Testing in Psychology and Physics: A Methodological Paradox
Nonindustry-Sponsored Preclinical Studies on Statins Yield Greater Efficacy Estimates Than Industry-Sponsored Studies: A Meta-Analysis
If Correlation Doesnât Imply Causation, Then What Does?
Social Psychology Is A Flamethrower
https://web.archive.org/web/20240325212821/https://www.econlib.org/archives/2011/10/teachers_and_in.html
The Small Schools Myth
https://www.frontiersin.org/journals/human-neuroscience/articles/10.3389/fnhum.2013.00291/full
Personal Reflections on Lessons Learned from Randomized Trials Involving Newborn Infants, 1951â1967
Publication bias in the social sciences: Unlocking the file drawer
https://www.nature.com/articles/nature.2014.15787
https://statmodeling.stat.columbia.edu/2014/08/28/publication-bias-social-sciences-unlocking-file-drawer2/
On the Science and Ethics of Ebola Treatments
Controlled trials: the 1948 watershed
https://journals.sagepub.com/doi/full/10.1177/0306312714535679
https://deepblue.lib.umich.edu/bitstream/handle/2027.42/68589/10.1177_0049124185013003002.pdf
https://web.archive.org/web/20190617041250/http://www.coyneoftherealm.com/2014/09/25/critique-claims-blood-test-depression/
World Values Lost in Translation
http://stats.org.uk/statistical-inference/Bakan1966.pdf
â âstereotype threatâ directory
https://statmodeling.stat.columbia.edu/wp-content/uploads/2013/04/ganley-et-al.-stereotype-threat.pdf
https://pure.uvt.nl/ws/portalfiles/portal/29125573/MTO_Flore_influence_of_gender_stereotype_CRiSP_2019.pdf#page=3
Stereotype threat effects in settings with features likely versus unlikely in operational test settings: A meta-analysis
Use of Placebo Controls in the Evaluation of Surgery: Systematic Review
The Placebo Effect Doesnât Apply Just to Pills
How to Make More Published Research True
https://statmodeling.stat.columbia.edu/2013/05/06/against-optimism-about-social-science/
Deliberate practice: Is that all it takes to become an expert?
2014-horowitz.pdf
Liberals Deny Science, Too
Bayesian Data Analysis
https://statmodeling.stat.columbia.edu/wp-content/uploads/2013/03/1154-Hauer-The-harm-done-by-tests-of-significance.pdf
Unreliable Neuroscience? Why Power Matters
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.138.3468&rep=rep1&type=pdf
Social Psychology as History
https://scottlilienfeld.com/wp-content/uploads/2021/01/lilienfeld2015-3.pdf
Implications of ideological bias in social psychology on clinical practice
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Non-replicable publications are cited more than replicable ones
A âSham Procedureâ Leads to Disappointing M.S. News
Lysergic Acid Diethylamide (LSD-25): Xv. the Effects Produced By Substitution of a Tap Water Placebo
https://kilthub.cmu.edu/articles/What_Went_Wrong_Reflections_on_Science_by_Observation_and_The_Bell_Curve/6493139/files/11937863.pdf#page=2
Prisons Are Built With Bricks Of Law And Brothels With Bricks Of Religion, But That Doesnât Prove A Causal Relationship
Effects of remote, retroactive intercessory prayer on outcomes in patients with bloodstream infection: randomized controlled trial
Evaluating Extraordinary Claims: Mind Over Matter? Or Mind Over Mind?
Daniel Simons: What Effect Size Would You Expect?
Scholarly Context Not Found: One in Five Articles Suffers from Reference Rot
Should Psychological Neuroscience Research Be Funded?
Should Psychological Neuroscience Research Be Funded?
https://www.dcscience.net/Schuemie-Madigan-2012.pdf
https://www.nejm.org/doi/full/10.1056/NEJMsa1409364
Estimating the reproducibility of psychological science
https://osf.io/ct89g/
An Open Review of Many Labs 3: Much to Learn
https://www.uv.es/sestio/TechRep/tr14-03.pdf
Health Testing on Mice Is Found Misleading in Some Cases
https://talyarkoni.org/blog/2011/01/10/the-psychology-of-parapsychology-or-why-good-researchers-publishing-good-articles-in-good-journals-can-still-get-it-totally-wrong/
Columbia Data Science Course, Week 12: Predictive Modeling, Data Leakage, Model Evaluation
https://journals.sagepub.com/doi/full/10.1177/1745691612459519
Flat Priors and Other Improbable Tales
The Economics of Reproducibility in Preclinical Research
An alternative to null-hypothesis statistical-significance tests
Effect of Monthly Vitamin D3 Supplementation in Healthy Adults on Adverse Effects of Earthquakes: Randomized Controlled Trial
The Case of the Amazing Gay-Marriage Data: How a Graduate Student Reluctantly Uncovered a Huge Scientific Fraud
https://www.science.org/content/article/does-ocean-acidification-alter-fish-behavior-fraud-allegations-create-sea-doubt
https://web.archive.org/web/20190813183307/https://www.pbs.org/how-we-got-to-now/blogs/howwegottonext/how-one-man-poisoned-a-citys-water-supply-and-saved-millions-of-childrens-lives-in-the-process/
Reanalyses of Randomized Clinical Trial Data Research, Methods, Statistics
https://library.mpib-berlin.mpg.de/ft/gg/GG_Null_2004.pdf
Should Anyone Be Given a Blood Transfusion?
The Bayesian Reproducibility Project
Statistical Methods for Replicability Assessment
https://assets.press.princeton.edu/chapters/s8863.pdf
Correlation, Causation, and Confusion
The Perilous Plight of the (Non)-Replicator
A New, Life-Or-Death Approach to Funding Heart Research
When Quality Beats Quantity: Decision Theory, Drug Discovery, and the Reproducibility Crisis
Artificial intelligence in drug discovery: what is realistic, what are illusions? Part 1: Ways to make an impact, and why we are not there yet: Quality is more important than speed and cost in drug discovery
https://www.exp-platform.com/Documents/2012-09%20ACMRecSysNR.pdf
https://web.archive.org/web/20121017235504/http://www.scilogs.com/the_gene_gym/my-published-negative-result
SPP598377 1..5
Is There a Publication Bias in Behavioral Intranasal Oxytocin Research on Humans? Opening the File Drawer of One Lab
The Scientific Impact of Positive and Negative Phase 3 Cancer Clinical Trials
The Stem-Cell Scandal
Correlation and Causation in the Study of Personality
https://www.newyorker.com/science/maria-konnikova/bilingual-advantage-aging-brain
For Decades, Some Psychologists Have Claimed That Bilinguals Have Better Mental Control. Their Work Is Now Being Called into Question.
https://www.psychologytoday.com/us/blog/life-bilingual/201906/the-bilingual-advantage-three-years-later
2017-mukadam.pdf
https://addi.ehu.es/bitstream/handle/10810/26594/Is%20Bilingualism%20Associated2018.pdf?sequence=1&isAllowed=y
No evidence for a bilingual executive function advantage in the nationally representative ABCD study
The Advantages of Bilingualism Debate
Bilingualism Affords No General Cognitive Advantages: A Population Study of Executive Function in 11,000 People
Foreign language learning in older age does not improve memory or intelligence: Evidence from a randomized controlled study
https://psmag.com/news/why-the-national-institutes-of-health-should-replace-peer-review-with-a-lottery/
The Importance of "Gold Standard" Studies for Consumers of Research
https://scholar.harvard.edu/files/fryer/files/handbook_fryer_03.25.2016.pdf
Seven Pervasive Statistical Flaws in Cognitive Training Interventions
Could a Neuroscientist Understand a Microprocessor?
2002-lazebnik.pdf
Statistically Controlling for Confounding Constructs Is Harder than You Think
Evaluating the Effect of Inadequately Measured Variables in Partial Correlation Analysis
Regression Fallacies in the Matched Groups Experiment
Control of Spurious Association and the Reliability of the Controlled Variable
11292_2015_9244_Article 1..31
Why the âPsychoticismâ Error Took Years to Fix
Can Results-Free Review Reduce Publication Bias? The Results and Implications of a Pilot Study
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.372.6457&rep=rep1&type=pdf
2015-cofnas.pdf
How Multiple Imputation Makes a Difference
â The Iron Law Of Evaluation And Other Metallic Rules
Saving Science
Probing the Improbable: Methodological Challenges for Risks with Low Probabilities and High Stakes
https://eml.berkeley.edu/~sdellavi/wp/expertsJul16.pdf
Evaluating the replicability of social science experiments in Nature and Science 2010â2015
Predicting replication outcomes in the Many Labs 2 study
Laypeople Can Predict Which Social-Science Studies Will Be Replicated Successfully
Does Reading a Single Passage of Literary Fiction Really Improve Theory of Mind? An Attempt at Replication
We Gave Four Good Pollsters the Same Raw Data. They Had Four Different Results.
https://www.nature.com/articles/nature.2016.20781
https://www.nature.com/articles/533452a
Stereotype (In)Accuracy in Perceptions of Groups and Individuals
What Does Any of This Have To Do with Physics? Einstein and Feynman ushered me into grad school, reality ushered me out
https://libstore.ugent.be/fulltxt/RUG01/002/304/385/RUG01-002304385_2016_0001_AC.pdf
https://www.science.org/doi/10.1126/blog-post.12136
Cancer Studies Are Fatally Flawed. Meet the Young Billionaire [John Arnold] Whoâs Exposing the Truth About Bad Science
Reconstruction of a Train Wreck: How Priming Research Went off the Rails
Reporting Bias Inflates the Reputation of Medical Treatments: A Comparison of Outcomes in Clinical Trials and Online Product Reviews
Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
Secondhand Smoke Isnât As Bad As We Thought
Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature
Meta-assessment of bias in science
When Evidence Says No, But Doctors Say Yes
A Failure of Intelligence: Part I
Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of âFar Transferâ: Evidence From a Meta-Analytic Review
2017-adams.pdf
Proceeding From Observed Correlation to Causal Inference: The Use of Natural Experiments
Daryl Bem Proved ESP Is Real. Which Means Science Is Broken.
â One Manâs Modus Ponens
Does High Self-Esteem Cause Better Performance, Interpersonal Success, Happiness, Or Healthier Lifestyles?
2014-02-25-matter-themanwhodestroyedamericasego.html
https://www.theguardian.com/lifeandstyle/2017/jun/03/quasi-religious-great-self-esteem-con
Computational Analysis of Lifespan Experiment Reproducibility
Discontinuation and Nonpublication of Randomized Clinical Trials Conducted in Children
The prior can generally only be understood in the context of the likelihood
My IRB Nightmare
The High Cost of Not Doing Experiments
Very Large Treatment Effects in Randomized Trials As an Empirical Marker to Indicate Whether Subsequent Trials Are Necessary: Meta-Epidemiological Assessment
https://amstat.tandfonline.com/doi/full/10.1080/01621459.2016.1240079
Disappointing Findings on Conditional Cash Transfers As a Tool to Break the Poverty Cycle in the United States
2017-kjaer.pdf
Sapping Attention: "Peer Review" Is Younger Than You Think. Does That Mean It Can Go Away?
https://www.the-tls.co.uk/literature/reference/alternative-to-peer-review-essay-timothy-gowers
The Lab @ DC - Body Worn Cameras
A Big Test of Police Body Cameras Defies Expectations
âUnbelievableâ: Heart Stents Fail to Ease Chest Pain
Percutaneous coronary intervention in stable angina (ORBITA): a double-blind, randomized controlled trial
https://www.amazon.com/Ending-Medical-Reversal-Improving-Outcomes/dp/1421417723
When the musicâs over. Does music skill transfer to childrenâs and young adolescentsâ cognitive and academic skills? A meta-analysis
Does Far Transfer Exist? Negative Evidence From Chess, Music, and Working Memory Training
Practice Does Not Make Perfect: No Causal Effect of Music Practice on Music Ability
Cognitive and academic benefits of music training with children: A multilevel meta-analysis
Whatâs College Good For?
https://docs.iza.org/dp11110.pdf
The Elusive Backfire Effect: Mass Attitudesâ Steadfast Factual Adherence
The Minimal Persuasive Effects of Campaign Contact in General Elections: Evidence from 49 Field Experiments
https://www.nber.org/system/files/working_papers/w24278/w24278.pdf
Does Teaching Children How to Play Cognitively Demanding Games Improve Their Educational Attainment? Evidence from a Randomized Controlled Trial of Chess Instruction in England
Evaluation of Evidence of Statistical Support and Corroboration of Subgroup Claims in Randomized Clinical Trials
Inventing the Randomized Double-Blind Trial: The NĂŒrnberg Salt Test of 1835
Questioning the Evidence on Hookworm Eradication in the American South
Homogenous: The Political Affiliations of Elite Liberal Arts College Faculty
https://users.cs.northwestern.edu/~robby/courses/322-2013-spring/mytkowicz-wrong-data.pdf
Revisiting the Marshmallow Test: A Conceptual Replication Investigating Links Between Early Delay of Gratification and Later Outcomes
https://ctlj.colorado.edu/wp-content/uploads/2015/08/Meyer-final.pdf
The Impostor Cell Line That Set Back Breast Cancer Research.
https://academic.oup.com/brain/article/140/5/1231/2951052
P-Hacking and False Discovery in A/B Testing
https://www.fda.gov/media/102332/download
Effects of the Tennessee Prekindergarten Program on childrenâs achievement and behavior through third grade
https://www.science.org/content/article/plan-replicate-50-high-impact-cancer-papers-shrinks-just-18
https://www.science.org/content/article/researcher-center-epic-fraud-remains-enigma-those-who-exposed-him
The prehistory of biology preprints: A forgotten experiment from the 1960s
https://www.the-scientist.com/replication-failures-highlight-biases-in-ecology-and-evolution-science-64475
The cumulative effect of reporting and citation biases on the apparent efficacy of treatments: the case of depression
https://static.cambridge.org/binary/version/id/urn:cambridge.org:id:binary-alt:20181009171208-81978-mediumThumb-S0033291718001873_fig1g.jpg?pub-status=live
https://www.science.org/doi/10.1126/science.aaf0918
https://www.science.org/content/article/about-40-economics-experiments-fail-replication-survey-rev2
https://ecommons.cornell.edu/server/api/core/bitstreams/1ea8a5a0-76f9-46ed-bf60-f6aa7b3413ca/content
https://journals.sagepub.com/doi/10.1177/2515245917747646
Logging Hypotheses and Protocols Before Performing Research Seems to Work As Intended: to Reduce Publication Bias for Positive Results
The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases
Why Do Humans Reason? Arguments for an Argumentative Theory
https://www.pnas.org/doi/10.1073/pnas.1617102114
The Wax and Wane of Ovulating-Woman Science: Evolutionary Psychology Has Long Been Mocked for Its Weird Obsession With the Menstrual Cycle, but at Least a Sliver of That Work Has Held up to Scrutiny
Many Labs 2: Investigating Variation in Replicability Across Sample and Setting
Generalizability of heterogeneous treatment effect estimates across samples
Heterogeneity in direct replications in psychology and its association with effect size
Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability
Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity
Comparing meta-analyses and preregistered multiple-laboratory replication projects
https://upworthyscience.com/a-star-surgeon-left-a-trail-of-dead-patients-and-his-whistleblowers-were-punished/
Participants in Medical Research Are More Empowered Than Ever to Influence the Design and Outcomes of Experiments. Now, Researchers Are Trying to Keep Up
2018-salminen.pdf
After Century of Removing Appendixes, Docs Find Antibiotics Can Be Enough: In a Five-Year Follow-Up, Nearly Two-Thirds of Patients Never Needed Surgery
Causal language and strength of inference in academic and media articles shared in social media (CLAIMS): A systematic review
The War over Supercooled Water
â leprechaun#spinach
[Transclude the forward-link's
context]
Whatâs Wrong With Psychology Anyway?
Notes on a New Philosophy of Empirical Science
Statistical Inference Through Data Compression
A Machine Learning Perspective on Predictive Coding With PAQ8 and New Applications
https://code.google.com/archive/p/paqclass
The Association between Adolescent Well-Being and Digital Technology Use
Rigorous Large-Scale Educational RCTs Are Often Uninformative: Should We Be Concerned?
How Replicable Are Links Between Personality Traits and Consequential Life Outcomes? The Life Outcomes of Personality Replication Project
Beware the Pitfalls of Short-Term Program Effects: They Often Fade
Behavior Genetic Research Methods: Testing Quasi-Causal Hypotheses Using Multivariate Twin Data
How Genome-Wide Association Studies (GWAS) Made Traditional Candidate Gene Studies Obsolete
5-HTTLPR: A Pointed Review
No Support for Historical Candidate Gene or Candidate Gene-by-Interaction Hypotheses for Major Depression Across Multiple Large Samples
https://www.pnas.org/doi/10.1073/pnas.1820701116
The Hype Cycle of Working Memory Training
Meta-Research: A comprehensive review of randomized clinical trials in three medical journals reveals 396 medical reversals
The Big Crunch
Supercentenarian and remarkable age records exhibit patterns indicative of clerical errors and pension fraud
How Gullible are We? A Review of the Evidence from Psychology and Social Science
Registered reports: an early example and analysis
Models of Control and Control of Bias
Editorial [EJP editorial on registered reports]
On Publication Policy Regarding Non-Statistically-Significant Results: Some comments on Dr. J. B. Rhineâs article in the comments section of the J.P., 39, No 2, 135â142
Fads, fashions, and folderol in psychology
Responsibility for Raw Data
Anthropologyâs Science Wars: Insights from a New Survey
https://public.tableau.com/app/profile/jurijfedorov#!/vizhome/AnthropologysScienceWars/Field
Effect of Lower Versus Higher Red Meat Intake on Cardiometabolic and Cancer Outcomes: A Systematic Review of Randomized Trials
The Obesity Research That Blew Up
Reading Lies: Nonverbal Communication and Deception
The small effects of political advertising are small regardless of context, message, sender, or receiver: Evidence from 59 real-time randomized experiments
â Leprechaun Hunting & Citogenesis § Citogenesis: How Often Do Researchers Not Read The Papers They Cite?
â movie#project-nim
[Transclude the forward-link's
context]
Stanford professor who changed America with just one study was also a liar
How David Rosenhanâs fraudulent Thud experiment set back psychiatry for decades: In the 1970s, a social psychologist published âfindingsâ deeply critical of American psychiatric methods. The problem was they were almost entirely fictional
On being sane in insane places: A supplemental report
On the troubling trail of psychiatryâs pseudopatients stunt: Susannah Cahalanâs investigation of the social-psychology experiment that saw healthy people sent to mental hospitals finds inconsistencies
New Revelations About Rosenhanâs Pseudopatient Study: Scientific Integrity in Remission
On Pseudoscience in Science, Logic in Remission, and Psychiatric Diagnosis: A Critique of Rosenhanâs âOn Being Sane in Insane Placesâ
Orchestrating false beliefs about gender discrimination
Did Blind Orchestra Auditions Really Benefit Women?
Debunking the Stanford Prison Experiment
A real-life Lord of the Flies: the troubling legacy of the Robbers Cave experiment; In the early 1950s, the psychologist Muzafer Sherif brought together a group of boys at a US summer campâand tried to make them fight each other. Does his work teach us anything about our age of resurgent tribalism? [an extract from The Lost Boys]
https://web.archive.org/web/20160705141814/https://home.uchicago.edu/~npope/crowdsourcing_paper.pdf
https://osf.io/9jzy4/
200 Researchers, 5 Hypotheses, No Consistent Answers
How a Publicity Blitz Created The Myth of Subliminal Advertising
The Struggles of a $40 Million Nutrition Science Crusade
Why a Charity Focused on Giving Cash to East Africa Started Working near Houston.
Biomedicine Facing a Worse Replication Crisis Than the One Plaguing Psychology
https://blog.scienceexchange.com/2013/10/reproducibility-initiative-receives-1-3m-grant-to-validate-50-landmark-cancer-studies/
Billionaires John and Laura Arnoldâs Data-Driven Philanthropy
The Four Most Dangerous Words? A New Study Shows
https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2019.02874/full
Matthew Walkerâs Why We Sleep Is Riddled with Scientific and Factual Errors
Alexey Guzeyâs homepage
The maddening saga of how an Alzheimerâs âcabalâ thwarted progress toward a cure for decades
A national experiment reveals where a growth mindset improves achievement
A Meta-Analysis of Procedures to Change Implicit Measures
Psychologyâs Racism-Measuring Tool Isnât Up to the Job
The Implicit Association Test in Introductory Psychology Textbooks: Blind Spot for Controversy
Rational Judges, Not Extraneous Factors In Decisions
Impossibly Hungry Judges
Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: a cohort study
FDA and NIH let clinical trial sponsors keep results secret and break the law
A controlled trial for reproducibility: For three years, part of DARPA has funded two teams for each project: one for research and one for reproducibility. The investment is paying off.
The reproducibility of statistical results in psychological research: An investigation using unpublished raw data
Producing Wrong Data Without Doing Anything Obviously Wrong!
Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time
On Attenuated Interactions, Measurement Error, and Statistical Power: Guidelines for Social and Personality Psychologists
Variability in the analysis of a single neuroimaging dataset by many teams
Towards Reproducible Brain-Wide Association Studies
â âSLAM (fraud)â directory
Can Short Psychological Interventions Affect Educational Performance? Revisiting the Effect of Self-Affirmation Interventions
Do police killings of unarmed persons really have spillover effects? Reanalyzing Bor et al 2018
The statistical properties of RCTs and a proposal for shrinkage
Off-target toxicity is a common mechanism of action of cancer drugs undergoing clinical trials
How Two Researchers Paid a Price for Challenging a Retracted Study about Violent Video Games.
https://www.science.org/content/article/research-linking-violent-entertainment-aggression-retracted-after-scrutiny
â âLizardman survey constantâ directory
RCTs to Scale: Comprehensive Evidence from Two Nudge Units
Time to Assume That Health Research Is Fraudulent Until Proven Otherwise?
The Chrysalis Effect: How Ugly Initial Results Metamorphosize Into Beautiful Articles
Putting the Self in Self-Correction: Findings From the Loss-of-Confidence Project
No effect of âwatching eyesâ: An attempted replication and extension investigating individual differences
The Role of Human Fallibility in Psychological Research: A Survey of Mistakes in Data Management
Reversals in Psychology
A pre-registered, multi-lab non-replication of the action-sentence compatibility effect (ACE)
Why CEA Has Stopped Using Net Promoter Score
https://www.science.org/content/article/this-scientist-accused-supplement-industry-of-fraud-now-his-own-work-is-under-fire
https://www.narratively.com/nick-brown-smelled-bull/
Pygmalion In The Classroom: Teacher Expectation and Pupilâs Intellectual Development
Experimenter Effects in Behavioral Research: Enlarged Edition
Reviews: Rosenthal, Robert, and Jacobson, Lenore; âPygmalion in the Classroomâ 1968
But You Have to Know How to Tell Time
1969-snow.html
Pygmalion Reconsidered: A Case Study in Statistical Inference: Reconsideration of the Rosenthal-Jacobson Data on Teacher Expectancy
Five Decades Of Public Controversy Over Mental Testing
The Self-Fulfillment of the Self-Fulfilling Prophecy: A Critical Appraisal
Does Research Count in the Lives of Behavioral Scientists?
Pygmalion and Intelligence?
Beleaguered Pygmalion: A History of the Controversy Over Claims that Teacher Expectancy Raises Intelligence
Teacher expectations and self-fulfilling prophecies: knowns and unknowns, resolved and unresolved controversies
Weâve Been Here Before: The Replication Crisis over the Pygmalion Effect
â Book Reviews § Experimenter Effects In Behavioral Research, Rosenthal1976
https://www.reddit.com/r/skeptic/comments/14qbn9/rskeptic_i_was_practicing_graphpad_and_i_think_i/
Chocolate Consumption, Cognitive Function, and Nobel Laureates
Chocolate Consumption, Nobel Laureates, and Crappy Statistics
Chocolate Consumption, Traffic Accidents and Serial Killers
Spurious Correlation Bonanza to Mark Replicated Typo 2.0 Reaching 100,000 Hits
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.361.4142&rep=rep1&type=pdf
The Final Correlation: Bayesian Causal Graphs As an Alternative to Phylogenetics
No Booze? You May Lose: Why Drinkers Earn More Money Than Nondrinkers
Storks Deliver Babies (p = 0.008)
New Evidence for the Theory of the Stork
Correlated - Discover Surprising Correlations between Seemingly Unrelated Things
Correlated: Surprising Connections Between Seemingly Unrelated Things
Spurious Correlations
https://www.google.com/trends/correlate/
Google's New Correlation Mining Tool: It Works!
Google's New Correlation Mining Tool: It Works!
Google's New Correlation Mining Tool: It Works!
https://slatestarcodex.com/blog_images/correlate_heart.png
https://slatestarcodex.com/blog_images/correlate_booty.png
https://slatestarcodex.com/blog_images/correlate_swim.png
https://slatestarcodex.com/blog_images/correlate_metro.png
https://www.google.com/trends/correlate/search?e=clojure&t=weekly&p=us
https://www.google.com/trends/correlate/search?e=accident&t=weekly
https://www.google.com/trends/correlate/search?e=migraine+headaches&t=weekly
https://www.google.com/trends/correlate/search?e=Irritable+Bowel+Syndrome&t=weekly&p=us
http://bit-player.org/wp-content/uploads/2011/05/interest-pills-450.png
https://web.archive.org/web/20141213221339/http://sivertzendigital.tumblr.com/post/100823225645/google-correlate-correlation-for-advertising-and
Obama Did Better in States Where Lots of People Search for 'Top Chef'
https://www.google.com/trends/correlate/search?e=losing%20weight&e=rental%20homes&t=weekly
2011-09-slacktory-correlations-biebertonsillitis.png
Obesity, Beer and Christianity: Or Correlation Does Not Equal Causation
Rugby (The Religion of Wales) and Its Influence on the Catholic Church: Should Pope Benedict XVI Be Worried?
Stupid Data Miner Tricks: Overfitting the S&P 500
â âanimal study methodologyâ directory
