Skip to content

Latest commit

 

History

History
50 lines (30 loc) · 2.92 KB

SoundResearchPractice.md

File metadata and controls

50 lines (30 loc) · 2.92 KB
Raw

Researchers Degrees of Freedom

The problems of undisclosed flexibility in data analysis (aka researchers degrees of freedom)

https://www.ncbi.nlm.nih.gov/pubmed/22006061 Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5122713/ Wicherts, J. M., Veldkamp, C. L., Augusteijn, H. E., Bakker, M., Van Aert, R. C., & Van Assen, M. A. (2016). Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A checklist to avoid p-hacking. Frontiers in psychology, 7.

The garden of forking paths: multiple comparisons and researchers degrees of freedom

http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf Gelman, A., & Loken, E. (n.d.). The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time. 17.

Questionable Research Practices in the neuroscience

https://www.nature.com/articles/s41562-016-0021 Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Sert, N. P. du, … Ioannidis, J. P. A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1(1), 0021. https://doi.org/10.1038/s41562-016-0021

Power problems in cog neuro

Button, K. S., Ioannidis, J. P., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S., & Munafò, M. R. (2013). Power failure: why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14(5), 365-376. https://www.ncbi.nlm.nih.gov/pubmed/23571845

Cremers, H. R., Wager, T. D., & Yarkoni, T. (2017). The relation between statistical power and inference in fMRI. PloS one, 12(11), e0184923. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0184923

Turner, B. O., Paul, E. J., Miller, M. B., & Barbey, A. K. (2018). Small sample sizes reduce the replicability of task-based fMRI studies. Communications Biology, 1, 62 https://doi.org/10.1038/s42003-018-0073-z

Questionable measurement practices

https://psyarxiv.com/hs7wm/ Flake, J. K., & Fried, E. I. (2019). Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them [Preprint]. https://doi.org/10.31234/osf.io/hs7wm

Increasing transparency through Multiverse analysis

https://www.ncbi.nlm.nih.gov/pubmed/27694465 Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016). Increasing Transparency Through a Multiverse Analysis.

Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 11(5), 702–712. https://doi.org/10.1177/1745691616658637

This was contributed by:
[email protected]
on 12. December 2019