Unpacking the Disagreement: Guest Post by Donkin and Szollosi

This post is a response to the previous post A Breakdown of “Preregistration is Redundant, at Best”. We were delighted to see how interested people were in the short paper we wrote on preregistration with our co-authors (now published at Trends in Cognitive Science – the revised version of which has been uploaded). First, a note on the original title.…

read more

The Support Interval

This post summarizes Wagenmakers, E.-J., Gronau, Q. F., Dablander, F., & Etz, A. (in press). The support interval. Erkenntnis. Preprint available on PsyArXiv: https://psyarxiv.com/zwnxb/ Abstract A frequentist confidence interval can be constructed by inverting a hypothesis test, such that the interval contains only parameter values that would not have been rejected by the test. We show how a similar definition…

read more

Preprint: A Cautionary Note on Estimating Effect Size

This post is a teaser for van den Bergh, D., Haaf, J. M., Ly, A., Rouder, J. N., & Wagenmakers, E.-J. (2019). A cautionary note on estimating effect size. Preprint available on PsyArXiv: https://psyarxiv.com/h6pr8/   Abstract “An increasingly popular approach to statistical inference is to focus on the estimation of effect size while ignoring the null hypothesis that the effect…

read more

Compensatory Control and Religious Beliefs: A Registered Replication Report Across Two Countries

This post is an extended synopsis of Hoogeveen, S., Wagenmakers, E.-J., Kay, A. C., & van Elk, M. (in press). Compensatory Control and Religious Beliefs: A Registered Replication Report Across Two Countries. Comprehensive Results in Social Psychology. https://doi.org/10.1080/23743603.2019.1684821   Abstract Compensatory Control Theory (CCT) suggests that religious belief systems provide an external source of control that can substitute a perceived…

read more

What Makes Science Transparent? A Consensus-Based Checklist

This post is a synopsis of Aczel et al. (2019). A consensus-based transparency checklist. Nature Human Behaviour. Open Access: https://www.nature.com/articles/s41562-019-0772-6. The associated Shiny app is at http://www.shinyapps.org/apps/TransparencyChecklist/.   How can social scientists make their work more transparent? Sixty-three editors and open science advocates reached consensus on this topic and created a checklist to help authors document various transparency-related aspects of…

read more

Preprint: BFpack — Flexible Bayes Factor Testing of Scientific Theories in R

This post is a synopsis of Mulder, J., Gu, X., Olsson-Collentine, A., Tomarken, A., Böing-Messing, F., Hoijtink, H., Meijerink, M., Williams, D. R., Menke, J., Fox, J.-P., Rosseel, Y., Wagenmakers, E.-J., & van Lissa, C. (2019). BFpack: Flexible Bayes factor testing of scientific theories in R. Preprint available at https://arxiv.org/pdf/1911.07728.pdf Abstract “There has been a tremendous methodological development of Bayes…

read more

Crowdsourcing Hypothesis Tests: The Bayesian Perspective

This post is a synopsis of the Bayesian work featured in Landy et al. (in press). Crowdsourcing hypothesis tests: Making transparent how design choices shape research results. Psychological Bulletin. Preprint available at https://osf.io/fgepx/; the 325-page supplement is available at https://osf.io/jm9zh/; the Bayesian analyses can be found on pp. 238-295. Abstract “To what extent are research results influenced by subjective decisions…

read more

Preprint: Practical Challenges and Methodological Flexibility in Prior Elicitation

This post is an extended synopsis of Stefan, A. M., Evans, N. J., & Wagenmakers, E.-J. (2019). Practical challenges and methodological flexibility in prior elicitation. Manuscript submitted for publication. Preprint available on PsyArXiv: https://psyarxiv.com/d42xb/       Abstract It is a well-known fact that Bayesian analyses require the specification of a prior distribution, and that different priors can lead to…

read more