Bibliography:

  1. ‘statistics’ tag

  2. ‘publication bias’ tag

  3. The Early Days of Peer Review: 5 Insights from Historic Reports

  4. Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews

  5. Can large language models provide useful feedback on research papers? A large-scale empirical analysis

  6. ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews

  7. Saving time and money in biomedical publishing: the case for free-format submissions with minimal requirements

  8. Comparing Analysis Blinding With Preregistration in the Many-Analysts Religion Project

  9. Nobel and Novice: Author Prominence Affects Peer Review

  10. Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

  11. An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports

  12. Honest signaling in academic publishing

  13. Peer Review as an Evolving Response to Organizational Constraint: Evidence from Sociology Journals, 1952–2018

  14. Expert Consensus Procedure (ECO): Facilitating Robust Scientific Outputs

  15. Are peer-reviews of grant proposals reliable? An analysis of Economic and Social Research Council (ESRC) funding applications

  16. Is Scholarly Refereeing Productive (at the Margin)?

  17. The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases

  18. Registered reports: an early example and analysis

  19. The sociology of scientific validity: How professional networks shape judgement in peer review

  20. Scientific Autonomy, Public Accountability, and the Rise of ‘Peer Review’ in the Cold War United States

  21. Low agreement among reviewers evaluating the same NIH grant applications

  22. Uncertainty and Individual Discretion in Allocating Research Funds

  23. Can Results-Free Review Reduce Publication Bias? The Results and Implications of a Pilot Study

  24. To Apply or Not to Apply: A Survey Analysis of Grant Writing Costs and Benefits

  25. Protocol Review at The Lancet: 1997–2015

  26. Converting rejections into positive stimuli

  27. A Two-Step Manuscript Submission Process Can Reduce Publication Bias

  28. On the time spent preparing grant proposals: an observational study of Australian researchers

  29. A Reliability-Generalization Study of Journal Peer Reviews: A Multilevel Meta-Analysis of Inter-Rater Reliability and Its Determinants

  30. Peer-review in a world with rational scientists: Toward selection of the average

  31. Telescope Time Without Tears: A Distributed Approach to Peer Review

  32. Science in the 21st Century: Social, Political, and Economic Issues

  33. Is tenure justified? An experimental study of faculty beliefs about tenure, promotion, and academic freedom

  34. Effect of Blinded Peer Review on Abstract Acceptance

  35. Effects of Editorial Peer Review: A Systematic Review

  36. A Letter from the Frustrated Author of a Journal Paper

  37. Effect on the Quality of Peer Review of Blinding Reviewers and Asking Them to Sign Their Reports: A Randomized Controlled Trial

  38. Peer Review for Journals: Evidence on Quality Control, Fairness, and Innovation

  39. Reflections After Refereeing Papers for NIPS

  40. How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists

  41. The Influence of Prior Beliefs on Scientific Judgments of Evidence Quality

  42. Reviewer Bias

  43. The Philosophical Basis of Peer Review and the Suppression of Innovation

  44. The Story of the NIH Grants Programs

  45. Publication Prejudices: An Experimental Study of Confirmatory Bias in the Peer Review System

  46. Editorial [EJP editorial on registered reports]

  47. Models of Control and Control of Bias

  48. A Proposal for a New Editorial Policy in the Social Sciences

  49. Alexey Guzey’s homepage

  50. Statistical Modeling: The Two Cultures

  51. Real Peer Review Has Never Been Tried

  52. design#future-tag-features

    [Transclude the forward-link's context]

  53. 2021-scheel-figure2-positiveresultspublishedbyregularvsregisteredreportspyschologyresearch.jpg

  54. 2015-nyhan.pdf

  55. 2005-glymour.pdf

  56. 1989-weiss.pdf

  57. 1988-kupfersmid.pdf

  58. 1976-rosenthal-experimenterexpectancyeffects-ch3.pdf

  59. https://english.elpais.com/science-tech/2023-04-02/one-of-the-worlds-most-cited-scientists-rafael-luque-suspended-without-pay-for-13-years.html

  60. https://mattsclancy.substack.com/p/biases-against-risky-research

  61. https://mattsclancy.substack.com/p/can-taste-beat-peer-review

  62. https://mattsclancy.substack.com/p/what-does-peer-review-know

  63. https://theoryclass.wordpress.com/2013/06/06/a-mechanism-design-approach-to-peer-review/

  64. https://www.cs.ucr.edu/~eamonn/Keogh_SIGKDD09_tutorial.pdf#page=8

  65. 92be24787295f961bd8ae828c5bb726a15c605be.pdf#page=8

  66. https://www.experimental-history.com/p/the-rise-and-fall-of-peer-review

  67. https://www.nature.com/articles/d41586-020-01392-8

  68. https://www.nature.com/articles/d41586-023-00506-2

  69. https://www.nature.com/articles/d41586-023-00831-6

  70. https://www.noahpinion.blog/p/why-paul-ehrlich-got-everything-wrong

  71. https://www.statnews.com/2016/09/01/optogenetics/

  72. https://x.com/ryancbriggs/status/1630183763320684547

  73. ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews

  74. https%253A%252F%252Farxiv.org%252Fabs%252F2306.12587.html

  75. Saving time and money in biomedical publishing: the case for free-format submissions with minimal requirements

  76. https%253A%252F%252Fbmcmedicine.biomedcentral.com%252Farticles%252F10.1186%252Fs12916-023-02882-y.html

  77. Comparing Analysis Blinding With Preregistration in the Many-Analysts Religion Project

  78. https%253A%252F%252Fjournals.sagepub.com%252Fdoi%252Ffull%252F10.1177%252F25152459221128319.html

  79. An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports

  80. https%253A%252F%252Fjournals.sagepub.com%252Fdoi%252Ffull%252F10.1177%252F25152459211007467.html

  81. To Apply or Not to Apply: A Survey Analysis of Grant Writing Costs and Benefits

  82. https%253A%252F%252Fjournals.plos.org%252Fplosone%252Farticle%253Fid%253D10.1371%252Fjournal.pone.0118494.html

  83. Alexey Guzey’s homepage

  84. Alexey Guzey’s homepage

  85. https%253A%252F%252Fguzey.com%252F.html