We chat about two new studies that took different approaches for evaluating the impact of paying reviewers on peer review speed and quality.
Links
* James' 450 movement proposal (https://jamesheathers.medium.com/the-450-movement-1f86132a29bd)
* The paper (https://journals.lww.com/ccmjournal/fulltext/9900/effect_of_monetary_incentives_on_peer_review.488.aspx) from Critical Care Medicine
* The preprint (https://www.biorxiv.org/content/10.1101/2025.03.18.644032v1) from Biology Open
Other links
- Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social)
- James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social)
- Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social)
Citation
Quintana, D. S., & Heathers, J. (2025, April 2). 190: What happens when you pay reviewers?, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/PHQ2K
--------
44:25
189: Crit me baby, one more time
Dan and James discuss a recent piece that proposes a post-publication review process, which is triggered by citation counts. They also cover how an almetrics trigger could be alternatively used for a more immediate post-publication critique.
Links
* The Chonicle piece (https://www.chronicle.com/article/social-science-is-broken-heres-how-to-fix-it?sra=true) by Andrew Gelman and Andrew King [Free to read with email registration]
* The paper (https://psycnet.apa.org/fulltext/2022-14587-001.html) by Peder Isager and collegues on how to decide what papers we should replicate. Here is the preprint (https://files.de-1.osf.io/v1/resources/2gurz/providers/osfstorage/5f4f4314a392b9002f1d9576?action=download&direct&version=2).
* The ERROR project (https://error.reviews/about/)
Other links
Everything Hertz on Bluesky
- Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social)
- James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social)
- Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social)
Citation
Quintana, D. S., & Heathers, J. (2025, Mar 2). 189: Crit me baby, one more time, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/3X5UR
--------
53:40
188: Double-blind peer review vs. scientific integrity
Dan and James discuss a recent editorial which argues that double-blind peer review is detrimental to scientific integrity.
Links
* The editorial from Christopher Mebane: https://doi.org/10.1093/etojnl/vgae046
Other links
Everything Hertz on Bluesky
- Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social)
- James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social)
- Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social)
Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff!
$1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show
$5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month
Citation
Quintana, D. S., & Heathers, J. (2025, Jan 30). Double-blind peer review vs. scientific integrity, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/6XS29
--------
54:56
187: What started the replication crisis era?
We chat about the events that started the replication crisis in psychology and Dorothy Bishop's recent resignation from the Royal Society
Links
* The resignation blogpost (http://deevybee.blogspot.com/2024/11/why-i-have-resigned-from-royal-society.html) from Dorothy Bishop
* The bluesky post (https://bsky.app/profile/sarahwieten.bsky.social/post/3lbtsqc6jcs2z) from Sarah Weiten that asked the question, "If you had to cite an event that opened the "replication crisis" era, what would you point to?"
* The "Year of Horrors" paper (https://www.ejwagenmakers.com/2012/Wagenmakers2012Horrors.pdf) from Eric-Jan Wagenmakers
Other links
Everything Hertz on Bluesky
- Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social)
- James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social)
- Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social)
Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff!
$1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show
$5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month
Citation
Quintana, D. S., & Heathers, J. (2024, Dec 3). 187: What started the replication crisis era?, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/EC7QH
--------
55:08
186: Evaluating journal quality
In this episode we chat about a Nordic approach for evaluating the journal quality and how we should be teaching undergraduates to evaluate journal and article quality
Links
* The Norwegian journal register (https://kanalregister.hkdir.no/en/informasjonsartikler/about-the-norwegian-register)
* The Finnish journal register (https://julkaisufoorumi.fi/en/publication-forum)
* Episode 22 (https://everythinghertz.com/22), where we played "Pokemon or Cholesterol medication?"
Other links
Everything Hertz on social media
- Dan on twitter (https://www.twitter.com/dsquintana)
- James on twitter (https://www.twitter.com/jamesheathers)
- Everything Hertz on twitter (https://www.twitter.com/hertzpodcast)
- Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/)
Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff!
$1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show
$5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month
Citation
Quintana, D. S., & Heathers, J. (2024, Nov 13). 186: Evaluating journal quality, Everything Hertz [Audio podcast], https://doi.org/10.17605/OSF.IO/KB37U
New Zealand