publication bias tag

Gwern Branwen

See Also
Gwern
- “The Replication Crisis: Flaws in Mainstream Science”, Gwern 2010
Links
Miscellaneous
Link Bibliography

[Warning: JavaScript Disabled!]

[For support of key website features (link annotation popups/popovers & transclusions, collapsible sections, backlinks, tablesorting, image zooming, sidenotes etc), you must enable JavaScript.]

Gwern

“The Replication Crisis: Flaws in Mainstream Science”, Gwern 2010

The Replication Crisis: Flaws in Mainstream Science

Links

“Footprint of Publication Selection Bias on Meta-Analyses in Medicine, Environmental Sciences, Psychology, and Economics”, Bartoš et al 2024

Footprint of publication selection bias on meta-analyses in medicine, environmental sciences, psychology, and economics

“Drab and Distant Birds Are Studied Less Than Their Fancy-Feathered Friends”, Fischer et al 2023

Drab and distant birds are studied less than their fancy-feathered friends

“Robust Bayesian Meta-Analysis: Addressing Publication Bias With Model-Averaging”, Maier et al 2023

Robust Bayesian meta-analysis: Addressing publication bias with model-averaging

“Robust Bayesian Meta-Analysis: Model-Averaging across Complementary Publication Bias Adjustment Methods”, Bartoš et al 2023

Robust Bayesian meta-analysis: Model-averaging across complementary publication bias adjustment methods

“Do Growth Mindset Interventions Impact Students’ Academic Achievement? A Systematic Review and Meta-Analysis With Recommendations for Best Practices”, Macnamara & Burgoyne 2022

Do growth mindset interventions impact students’ academic achievement? A systematic review and meta-analysis with recommendations for best practices

“On the Predicted Replicability of Two Decades of Experimental Research on System Justification: A z-Curve Analysis”, Sotola & Credé 2022

On the predicted replicability of two decades of experimental research on system justification: A z-curve analysis

“Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?”, Brodeur et al 2022

Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?

“The Null Result Penalty”, Chopra et al 2022 (page 3)

The Null Result Penalty

“Do Meta-Analyses Oversell the Longer-Term Effects of Programs? (Part 1): Detecting Follow-Up Selection Bias in Studies of Postsecondary Education Programs”, Bailey & Weiss 2022

Do Meta-Analyses Oversell the Longer-Term Effects of Programs? (Part 1): Detecting Follow-Up Selection Bias in Studies of Postsecondary Education Programs

“Which Findings Should Be Published?”, Frankel & Kasy 2022

Which Findings Should Be Published?

“Dream Interpretation from a Cognitive and Cultural Evolutionary Perspective: The Case of Oneiromancy in Traditional China”, Hong 2022

Dream Interpretation from a Cognitive and Cultural Evolutionary Perspective: The Case of Oneiromancy in Traditional China

“Selective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy: Updated Comparisons and Meta-Analyses of Newer versus Older Trials”, Turner et al 2021

Selective publication of antidepressant trials and its influence on apparent efficacy: Updated comparisons and meta-analyses of newer versus older trials

“‘He Who Pays the Piper Calls the Tune’: Researcher Experiences of Funder Suppression of Health Behavior Intervention Trial Findings”, McCrabb et al 2021

‘He who pays the piper calls the tune’: Researcher experiences of funder suppression of health behavior intervention trial findings

“No Need to Choose: Robust Bayesian Meta-Analysis With Competing Publication Bias Adjustment Methods”, Bartoš et al 2021

No Need to Choose: Robust Bayesian Meta-Analysis with Competing Publication Bias Adjustment Methods

“Of Forking Paths and Tied Hands: Selective Publication of Findings, and What Economists Should Do about It”, Kasy 2021

Of Forking Paths and Tied Hands: Selective Publication of Findings, and What Economists Should Do about It

“An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports”, Scheel et al 2021

An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports

“Sorting the File Drawer: A Typology for Describing Unpublished Studies”, Lishner 2021

Sorting the File Drawer: A Typology for Describing Unpublished Studies

“Non-Replicable Publications Are Cited More Than Replicable Ones”, Serra-Garcia & Gneezy 2021

Non-replicable publications are cited more than replicable ones

“Effectiveness of Psychological Interventions in Prison to Reduce Recidivism: a Systematic Review and Meta-Analysis of Randomized Controlled Trials”, Beaudry et al 2021

Effectiveness of psychological interventions in prison to reduce recidivism: a systematic review and meta-analysis of randomized controlled trials

“Millions of Animals May Be Missing from Scientific Studies”, Chawla 2020

Millions of animals may be missing from scientific studies

“Assessing Treatment Effects and Publication Bias across Different Specialties in Medicine: a Large Empirical Study of the Cochrane Database of Systematic Reviews”, Schwab et al 2020

Assessing treatment effects and publication bias across different specialties in medicine: a large empirical study of the Cochrane Database of Systematic Reviews

“Publication Rate in Preclinical Research: a Plea for Preregistration”, Naald et al 2020

Publication rate in preclinical research: a plea for preregistration

“RCTs to Scale: Comprehensive Evidence from Two Nudge Units”, DellaVigna & Linos 2020

RCTs to Scale: Comprehensive Evidence from Two Nudge Units

“Estimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance”, Brunner & Schimmack 2020

Estimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance

“Backlash Over Meat Dietary Recommendations Raises Questions About Corporate Ties to Nutrition Scientists”, Rubin 2020

Backlash Over Meat Dietary Recommendations Raises Questions About Corporate Ties to Nutrition Scientists

“FDA and NIH Let Clinical Trial Sponsors Keep Results Secret and Break the Law”, Piller 2020

FDA and NIH let clinical trial sponsors keep results secret and break the law

“Limited Evidence for the Effect of Red Color on Cognitive Performance: A Meta-Analysis”, Gnambs 2020

Limited evidence for the effect of red color on cognitive performance: A meta-analysis

“The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases”, Schäfer & Schwarz 2019

The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases

“Registered Reports: an Early Example and Analysis”, Wiseman et al 2019

Registered reports: an early example and analysis

“Stereotype Threat Effects in Settings With Features Likely versus Unlikely in Operational Test Settings: A Meta-Analysis”, Shewach et al 2019

Stereotype threat effects in settings with features likely versus unlikely in operational test settings: A meta-analysis

“The Cumulative Effect of Reporting and Citation Biases on the Apparent Efficacy of Treatments: the Case of Depression”, Vries et al 2018

The cumulative effect of reporting and citation biases on the apparent efficacy of treatments: the case of depression

“Is There a Publication Bias in Behavioral Intranasal Oxytocin Research on Humans? Opening the File Drawer of One Lab”, Lane et al 2016

Is there a publication bias in behavioral intranasal oxytocin research on humans? Opening the file drawer of one lab

“Discontinuation and Nonpublication of Randomized Clinical Trials Conducted in Children”

Discontinuation and Nonpublication of Randomized Clinical Trials Conducted in Children

“Can Results-Free Review Reduce Publication Bias? The Results and Implications of a Pilot Study”

Can Results-Free Review Reduce Publication Bias? The Results and Implications of a Pilot Study

“Publication and Reporting of Clinical Trial Results: Cross Sectional Analysis across Academic Medical Centers”, Chen et al 2016

Publication and reporting of clinical trial results: cross sectional analysis across academic medical centers

“Re-Evaluation of the Traditional Diet-Heart Hypothesis: Analysis of Recovered Data from Minnesota Coronary Experiment (1968-73)”, Ramsden et al 2016

Re-evaluation of the traditional diet-heart hypothesis: analysis of recovered data from Minnesota Coronary Experiment (1968-73)

“The Use and Abuse of Transcranial Magnetic Stimulation to Modulate Corticospinal Excitability in Humans”, Héroux et al 2015

The Use and Abuse of Transcranial Magnetic Stimulation to Modulate Corticospinal Excitability in Humans

“Does Publication Bias Inflate the Apparent Efficacy of Psychological Treatment for Major Depressive Disorder? A Systematic Review and Meta-Analysis of US National Institutes of Health-Funded Trials”, Driessen et al 2015

Does Publication Bias Inflate the Apparent Efficacy of Psychological Treatment for Major Depressive Disorder? A Systematic Review and Meta-Analysis of US National Institutes of Health-Funded Trials

“Meta-Analysis Using Effect Size Distributions of Only Statistically-Significant Studies”, Assen et al 2014

Meta-analysis using effect size distributions of only statistically-significant studies

“Extent of Non-Publication in Cohorts of Studies Approved by Research Ethics Committees or Included in Trial Registries”, Schmucker et al 2014

Extent of Non-Publication in Cohorts of Studies Approved by Research Ethics Committees or Included in Trial Registries

“Publication Bias in the Social Sciences: Unlocking the File Drawer”, Franco et al 2014

Publication bias in the social sciences: Unlocking the file drawer

“Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size”, Kühberger et al 2014

Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size

“Lunar Cycle Effects on Sleep and the File Drawer Problem”, Cordi et al 2014

Lunar cycle effects on sleep and the file drawer problem

“The Association between Exaggeration in Health Related Science News and Academic Press Releases: Retrospective Observational Study”, Sumner et al 2014

The association between exaggeration in health related science news and academic press releases: retrospective observational study

“Nonindustry-Sponsored Preclinical Studies on Statins Yield Greater Efficacy Estimates Than Industry-Sponsored Studies: A Meta-Analysis”, Krauth et al 2013

Nonindustry-Sponsored Preclinical Studies on Statins Yield Greater Efficacy Estimates Than Industry-Sponsored Studies: A Meta-Analysis

“Clusters of Individual Experiences Form a Continuum of Persistent Non-Symbolic Experiences [PNSE] in Adults”, Martin 2013

Clusters of Individual Experiences form a Continuum of Persistent Non-Symbolic Experiences [PNSE] in Adults

“Publication Bias in Laboratory Animal Research: A Survey on Magnitude, Drivers, Consequences and Potential Solutions”, Riet et al 2012

Publication Bias in Laboratory Animal Research: A Survey on Magnitude, Drivers, Consequences and Potential Solutions

“A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null”, Ferguson & Heene 2012

A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null

“A Critical Review of the First 10 Years of Candidate Gene-By-Environment Interaction Research in Psychiatry”, Duncan & Keller 2011

A critical review of the first 10 years of candidate gene-by-environment interaction research in psychiatry

“The Truth Wears Off: Is There Something Wrong With the Scientific Method?”, Lehrer 2010

The Truth Wears Off: Is there something wrong with the scientific method?

“Publication Bias in Two Political Behavior Literatures”, Gerber et al 2010

Publication Bias in Two Political Behavior Literatures

“Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data”, Fanelli 2010

Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data

“Publication Bias in Reports of Animal Stroke Studies Leads to Major Overstatement of Efficacy”, Sena et al 2010

Publication Bias in Reports of Animal Stroke Studies Leads to Major Overstatement of Efficacy

“Trial Publication After Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis”, Ross et al 2009

Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis

“Publication Bias in Empirical Sociological Research: Do Arbitrary Significance Levels Distort Published Results?”, Gerber & Malhotra 2008

Publication Bias in Empirical Sociological Research: Do Arbitrary Significance Levels Distort Published Results?

“An Exploratory Test for an Excess of Statistically-Significant Findings”, Ioannidis & Trikalinos 2007

An exploratory test for an excess of statistically-significant findings

“Full Publication of Results Initially Presented in Abstracts”, Scherer et al 2007

Full publication of results initially presented in abstracts

“Local Literature Bias in Genetic Epidemiology: An Empirical Evaluation of the Chinese Literature”, Pan et al 2005

Local Literature Bias in Genetic Epidemiology: An Empirical Evaluation of the Chinese Literature

“Molecular Insights into Human Brain Evolution”, Bradbury 2005

Molecular Insights into Human Brain Evolution

“Teacher Expectations and Self-Fulfilling Prophecies: Knowns and Unknowns, Resolved and Unresolved Controversies”, Jussim & Harber 2005

Teacher expectations and self-fulfilling prophecies: knowns and unknowns, resolved and unresolved controversies

“Do Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials”, Vickers et al 1998

Do Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials

“Bias in Meta-Analysis Detected by a Simple, Graphical Test”, Egger et al 1997

Bias in meta-analysis detected by a simple, graphical test

“Publication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa”

Publication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa

“On Publishing Controversy: Norman R. F. Maier and the Genesis of Seizures”, Dewsbury 1993

On publishing controversy: Norman R. F. Maier and the genesis of seizures

“A Meta-Analysis of Infant Habituation and Recognition Memory Performance As Predictors of Later IQ”, McCall & Carriger 1993

A Meta-Analysis of Infant Habituation and Recognition Memory Performance as Predictors of Later IQ

“Reviewer Bias”, Ernst et al 1992

Reviewer Bias

“The Philosophical Basis of Peer Review and the Suppression of Innovation”, Horrobin 1990

The Philosophical Basis of Peer Review and the Suppression of Innovation

“On Publication Policy Regarding Non-Statistically-Significant Results: Some Comments on Dr. J. B. Rhine’s Article in the Comments Section of the J.P., 39, No 2, 135–142”, Johnson 1976

On Publication Policy Regarding Non-Statistically-Significant Results: Some comments on Dr. J. B. Rhine’s article in the comments section of the J.P., 39, No 2, 135–142

“Fads, Fashions, and Folderol in Psychology”, Dunnette 1966

Fads, fashions, and folderol in psychology

“Publication Decisions and Their Possible Effects on Inferences Drawn from Tests of Statistical-Significance-Or Vice Versa”, Sterling 1959

Publication Decisions and their Possible Effects on Inferences Drawn from Tests of Statistical-Significance-or Vice Versa

“Is ‘Evidence-Based Development’ Writing a Cheque Its Methodology Can’t Cash?”

Is ‘evidence-based development’ writing a cheque its methodology can’t cash?⁠:

View External Link:

https://80000hours.org/podcast/episodes/eva-vivalt-social-science-generalizability/

“Logging Hypotheses and Protocols Before Performing Research Seems to Work As Intended: to Reduce Publication Bias for Positive Results”

Logging hypotheses and protocols before performing research seems to work as intended: to reduce publication bias for positive results

“For Decades, Some Psychologists Have Claimed That Bilinguals Have Better Mental Control. Their Work Is Now Being Called into Question.”

For decades, some psychologists have claimed that bilinguals have better mental control. Their work is now being called into question.

Annotations sorted by machine learning into inferred 'tags'. This provides an alternative way to browse: instead of by date order, one can browse in topic order. The 'sorted' list has been automatically clustered into multiple sections & auto-labeled for easier browsing.

Beginning with the newest annotation, it uses the embedding of each annotation to attempt to create a list of nearest-neighbor annotations, creating a progression of topics. For more details, see the link.