54. Jessica Kay Flake: Schmeasurement, making stats engaging, and the Psychological Science Accelerator

Jessica Flake is Assistant Professor for quantitative psychology and modeling at McGill University, where she studies measurement. In this conversation, we talk about her recent paper 'Measurement Schmeasurement:  Questionable measurement practices and how to avoid them' (with former guest of the podcast Eiko Fried), how she makes stats lectures interesting, and her work on the Psychological Science Accellarator.BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith. In 2022, episodes will appear irregularly, roughly twice per month. You can find the podcast on all podcasting platforms (e.g., Spotify, Apple/Google Podcasts, etc.). Timestamps0:00:04: Eiko Fried is maybe not that good at p-hacking0:02:03: How Jessica got into researching measurement0:10:42: The title of 'Measurement Schmeasurement'0:16:15: So what is Schmeasurement?0:24:47: How does Jessica ('literally the best prof ever') make statistics engaging?0:43:02: Is transparency the solution to schmeasurement?0:49:56: Was I measuring or schmeasuring in my recent paper?1:03:39: The next generation of the open science movement1:15:15: What's it like working on large collaborative projects like The Psychological Science Accelerator?Podcast linksWebsite: https://geni.us/bjks-podTwitter: https://geni.us/bjks-pod-twtJessica's linksWebsite: https://geni.us/flake-webGoogle Scholar: https://geni.us/flake-scholarTwitter: https://geni.us/flake-twtBen's linksWebsite: https://geni.us/bjks-webGoogle Scholar: https://geni.us/bjks-scholarTwitter:  https://geni.us/bjks-twtReferencesMy episode with Eiko Fried: https://geni.us/bjks-friedThe Twitter thread that started schmeasurement: https://twitter.com/JkayFlake/status/917514276893536257Axelrod (1980). Effective choice in the prisoner's dilemma. Journal of conflict resolution.Flake & Fried (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science.Flake, Pek, & Hehman (2017). Construct validation in social and personality research: Current practice and recommendations. Social Psychological and Personality Science.Flake, Davidson, Wong, & Pek (2022). Construct validity and the validity of replication studies: A systematic review.Kuper-Smith, Doppelhofer, Oganian, Rosenblau, & Korn (2021). Risk perception and optimism during the early stages of the COVID-19 pandemic. Royal Society open science.Moshontz, ... & Chartier, C. R. (2018). The Psychological Science Accelerator: Advancing psychology through a distributed collaborative network. Advances in Methods and Practices in Psychological Science.Nosek, Beck, Campbell, Flake, Hardwicke, Mellor, ... & Vazire (2019). Preregistration is hard, and worthwhile. Trends in cognitive sciences.Simmons, Nelson, & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological science.