Dan and James discuss a recent piece that proposes a post-publication review process, which is triggered by citation counts. They also cover how an almetrics trigger could be alternatively used for a more immediate post-publication critique.
Links
* The Chonicle piece (https://www.chronicle.com/article/social-science-is-broken-heres-how-to-fix-it?sra=true) by Andrew Gelman and Andrew King [Free to read with email registration]
* The paper (https://psycnet.apa.org/fulltext/2022-14587-001.html) by Peder Isager and collegues on how to decide what papers we should replicate. Here is the preprint (https://files.de-1.osf.io/v1/resources/2gurz/providers/osfstorage/5f4f4314a392b9002f1d9576?action=download&direct&version=2).
* The ERROR project (https://error.reviews/about/)
Other links
Everything Hertz on Bluesky
- Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social)
- James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social)
- Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social)
Citation
Quintana, D. S., & Heathers, J. (2025, Mar 2). 189: Crit me baby, one more time, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/3X5UR
--------
53:40
188: Double-blind peer review vs. scientific integrity
Dan and James discuss a recent editorial which argues that double-blind peer review is detrimental to scientific integrity.
Links
* The editorial from Christopher Mebane: https://doi.org/10.1093/etojnl/vgae046
Other links
Everything Hertz on Bluesky
- Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social)
- James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social)
- Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social)
Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff!
$1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show
$5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month
Citation
Quintana, D. S., & Heathers, J. (2025, Jan 30). Double-blind peer review vs. scientific integrity, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/6XS29
--------
54:56
187: What started the replication crisis era?
We chat about the events that started the replication crisis in psychology and Dorothy Bishop's recent resignation from the Royal Society
Links
* The resignation blogpost (http://deevybee.blogspot.com/2024/11/why-i-have-resigned-from-royal-society.html) from Dorothy Bishop
* The bluesky post (https://bsky.app/profile/sarahwieten.bsky.social/post/3lbtsqc6jcs2z) from Sarah Weiten that asked the question, "If you had to cite an event that opened the "replication crisis" era, what would you point to?"
* The "Year of Horrors" paper (https://www.ejwagenmakers.com/2012/Wagenmakers2012Horrors.pdf) from Eric-Jan Wagenmakers
Other links
Everything Hertz on Bluesky
- Dan on Bluesky (https://bsky.app/profile/dsquintana.bsky.social)
- James on Bluesky (https://bsky.app/profile/jamesheathers.bsky.social)
- Everything Hertz on Bluesky (https://bsky.app/profile/hertzpodcast.bsky.social)
Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff!
$1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show
$5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month
Citation
Quintana, D. S., & Heathers, J. (2024, Dec 3). 187: What started the replication crisis era?, Everything Hertz [Audio podcast], DOI: 10.17605/OSF.IO/EC7QH
--------
55:08
186: Evaluating journal quality
In this episode we chat about a Nordic approach for evaluating the journal quality and how we should be teaching undergraduates to evaluate journal and article quality
Links
* The Norwegian journal register (https://kanalregister.hkdir.no/en/informasjonsartikler/about-the-norwegian-register)
* The Finnish journal register (https://julkaisufoorumi.fi/en/publication-forum)
* Episode 22 (https://everythinghertz.com/22), where we played "Pokemon or Cholesterol medication?"
Other links
Everything Hertz on social media
- Dan on twitter (https://www.twitter.com/dsquintana)
- James on twitter (https://www.twitter.com/jamesheathers)
- Everything Hertz on twitter (https://www.twitter.com/hertzpodcast)
- Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/)
Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff!
$1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show
$5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month
Citation
Quintana, D. S., & Heathers, J. (2024, Nov 13). 186: Evaluating journal quality, Everything Hertz [Audio podcast], https://doi.org/10.17605/OSF.IO/KB37U
--------
43:11
185: The Retraction
We discuss the recent retraction of a paper that reported the effects of rigour-enhancing practices on replicability. We also cover James' new estimate that 1 out of 7 scientific papers are fake.
Links
* The story (https://www.nature.com/articles/d41586-024-02907-3) about data integrity concerns in 130 women’s health papers
* James' new preprint (https://osf.io/23zcr) with the estimate that 1 out of 7 scientific papers are fake
* The retracted paper in Nature Human Behavior (https://www.nature.com/articles/s41562-023-01749-9) by Protzko and coworkers
* The Matters Arising article (https://rdcu.be/dVXN8) from Bak-Coleman and Devezer, who initially raised concerns about the paper from Protzko and coworkers.
* The Everything Hertz merch store (https://everything-hertz-podcast.creator-spring.com)
* The paper (https://journals.sagepub.com/doi/10.1177/0165551507086261) about puns/jokes in paper titles
* The "Everything Hertz" paper (https://www.frontiersin.org/journals/physiology/articles/10.3389/fphys.2014.00177/full) from James
* Dan's only paper (https://www.biologicalpsychiatryjournal.com/article/S0006-3223(15)00528-4/abstract) with a pun in the title
Other links
Everything Hertz on social media
- Dan on twitter (https://www.twitter.com/dsquintana)
- James on twitter (https://www.twitter.com/jamesheathers)
- Everything Hertz on twitter (https://www.twitter.com/hertzpodcast)
- Everything Hertz on Facebook (https://www.facebook.com/everythinghertzpodcast/)
Support us on Patreon (https://www.patreon.com/hertzpodcast) and get bonus stuff!
$1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the the warm feeling you're supporting the show
$5 per month or more: All the stuff you get in the one dollar tier PLUS a bonus episode every month
Citation
Quintana, D. S., & Heathers, J. (2024, Oct 4). 185: The Retraction, Everything Hertz [Audio podcast], https://doi.org/10.17605/OSF.IO/528SF
New Zealand