92. Tom Hardwicke: Meta-research, reproducibility, and post-publication critique

 Tom Hardwicke is a Research Fellow at the University of Melbourne. We talk about meta-science, incuding Tom's work on post-publication critique and registered reports, what his new role as editor at Psychological Science entails, and much more.BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith.Support the show: https://geni.us/bjks-patreonTimestamps0:00:00: What is meta-science/meta-research?0:03:15: How Tom got involved in meta-science0:21:51: Post-publication critique in journals0:39:30: How Tom's work (registered reports) led to policy changes at journals0:44:08: Tom is now the STAR (statistics, transparency, and rigor) editor at Psychological Science0:48:17: How to best share data that can be used by people with different backgrounds0:54:51: A book or paper more people should read0:56:36: Something Tom wishes he'd learnt sooner1:00:13: Jobs in meta-science1:03:29: Advice for PhD students/postdocsPodcast linksWebsite: https://geni.us/bjks-podTwitter: https://geni.us/bjks-pod-twtTom's linksWebsite: https://geni.us/hardwicke-webGoogle Scholar: https://geni.us/hardwicke-scholarTwitter: https://geni.us/hardwicke-twtBen's linksWebsite: https://geni.us/bjks-webGoogle Scholar: https://geni.us/bjks-scholarTwitter: https://geni.us/bjks-twtReferences & linksEpisodes w/ Nosek, Vazire, & Chambers: https://geni.us/bjks-nosekhttps://geni.us/bjks-vazirehttps://geni.us/bjks-chambersFoamhenge: https://en.wikipedia.org/wiki/FoamhengeMETRICS: https://metrics.stanford.edu/AIMOS: https://www.youtube.com/@aimosinc4164Chambers & Mellor (2018). Protocol transparency is vital for registered reports. Nature Human Behaviour.Hardwicke, Jameel, Jones, Walczak & Weinberg (2014). Only human: Scientists, systems, and suspect statistics. Opticon1826.Hardwicke & Ioannidis (2018). Mapping the universe of registered reports. Nature Human Behaviour.Hardwicke, Serghiou, Janiaud, Danchev, Crüwell, Goodman & Ioannidis (2020). Calibrating the scientific ecosystem through meta-research. Annual Review of Statistics and Its Application.Hardwicke, Thibault, Kosie, Tzavella, Bendixen, Handcock, ... & Ioannidis (2022). Post-publication critique at top-ranked journals across scientific disciplines: a cross-sectional assessment of policies and practice. Royal Society Open Science.Hardwicke & Vazire (2023). Transparency Is Now the Default at Psychological Science. Psychological Science.Kidwell, Lazarević, Baranski, Hardwicke, Piechowski, Falkenberg, ... & Nosek (2016). Badges to acknowledge open practices: A simple, low-cost, effective method for increasing transparency. PLoS biology.Nosek, Hardwicke, Moshontz, Allard, Corker, Dreber, ... & Vazire (2022). Replicability, robustness, and reproducibility in psychological science. Annual review of psychology.Ritchie (2020). Science fictions: Exposing fraud, bias, negligence and hype in science.