Open Science Teaching and Training Resources
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
$
%
123
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ABCDEFGHIJKLMNOPQRSTUVWXYZAA
1
Link to resourceAuthorTitle / citationType (video, blog, paper, etc.)Level (beginner, intermediate, etc.)CommentkeywordsYearLength / Time needed to view or absorbmeta keyword
2
http://io9.gizmodo.com/i-fooled-millions-into-thinking-chocolate-helps-weight-1707251800John BohannonI Fooled Millions Into Thinking Chocolate Helps Weight Loss. Here's How.ArticleBeginner2015
3
http://journal.frontiersin.org/article/10.3389/fpsyg.2014.00823/fullCarter & McCulloughArticlesintermediatePETPEESE application, ego depletion
4
http://onlinelibrary.wiley.com/doi/10.1111/j.1740-9713.2006.00204.x/epdfTony O'HaganArticlesbeginnerBayes Factors
5
http://www.psychologicalscience.org/index.php/publications/observer/2015/september-15/bayes-for-beginners-probability-and-likelihood.htmlObserverArticlesbeginnerlikelihood, Bayes
6
http://alexanderetz.com/2015/04/15/understanding-bayes-a-look-at-the-likelihood/Alex EtzBlogintermediatelikelihood
7
http://alexanderetz.com/2015/08/09/understanding-bayes-visualization-of-bf/Alex EtzBlogintermediateBayes Factorsstatistical inference
8
http://andrewgelman.com/Andrew Gelmanblogvariousstatistical analysis, research methods, repoducibility
9
http://andrewgelman.com/Gelman, AndrewStatistical Modeling, Causal Inference, and Social ScienceBlogIntermediatestatistical inference
10
http://bayesfactor.blogspot.co.ukRichard MoreyBlogintermediateR package tutorial
11
http://blog.efpsa.org/2015/09/01/introducing-jasp-a-free-and-intuitive-statistics-software-that-might-finally-replace-spss/JEPSBlogbeginnerJASP software
12
http://daniellakens.blogspot.com/2014/06/data-peeking-without-p-hacking.htmlDaniel LakensData peeking without p-hackingBlogintermediatesequential testing
13
http://daniellakens.blogspot.com/2014/08/what-is-p-value_21.htmlDaniel LakensWhat is a p-value?Blogbeginnerp-values
14
http://daniellakens.blogspot.com/2015/01/always-use-welchs-t-test-instead-of.htmlDaniel LakensAlways use Welch t-testBlogintermediatet-test
15
http://datacolada.org/2015/04/09/35-the-default-bayesian-test-is-prejudiced-against-small-effects/Uri SimonsohnBlogadvancedBayes Factors
16
http://datacolada.org/2015/05/08/37-power-posing-reassessing-the-evidence-behind-the-most-popular-ted-talk/Blogp-curve applicationassessing evidence
17
http://datacolada.org/2015/08/24/41-falsely-reassuring-analyses-of-all-p-values-2/Blogp-curveassessing evidence
18
http://deevybee.blogspot.com/2016/01/the-amazing-significo-why-researchers.html?m=1Dorothy BishopThe Amazing Significo: why researchers need to understand pokerBlogBeginnerp-hacking
19
http://disjointedthinking.jeffhughes.ca/2015/01/evaluating-r-index-p-curve/Jeff HughesBlogp-curve, R indexassessing evidence
20
http://jeffrouder.blogspot.ca/2015/04/reply-to-uri-simonsohns-critique-of.htmlJeff RouderBlogadvancedresponse to Uri SimonsohnBayes Factors
21
http://retractionwatch.com/category/by-author/lacour/MultipleRetraction Watch: Michael LaCour archivesBlogIntermediateCollection of articles about the faking of data, discovery through replication attempt
22
http://ron.dotsch.org/degrees-of-freedom/Ron DotschDegrees of Freedom Tutorialblogbeginnerexplanation about degrees of freedom for ANOVA2015statistics
23
http://rpsychologist.com/calculating-the-overlap-of-two-normal-distributions-using-monte-carlo-integrationKristoffer MagnussonCalculating the overlap of two normal distributions using monte carlo intergrationblog
24
http://rpsychologist.com/d3-one-way-anovaKristoffer MagnussonVisualizing a one-way ANOVAblogvisualization
25
http://rpsychologist.com/d3/CI/Kristoffer MagnussonInterpreting confidence intervalsblogvisualization
26
x`Kristoffer MagnussonInterpreting cohen's d effect sizeblogvisualization
27
http://rpsychologist.com/d3/correlation/Kristoffer MagnussonInterpreting correlationsblogvisualization
28
http://rpsychologist.com/d3/NHST/Kristoffer MagnussonUnderstanding Statistical Power and Significance Testing: an interactive visualizationblogbeginngervisualization
29
http://rpsychologist.com/d3/pdist/Kristoffer MagnussonDistribution of p-values when comparing two groupsblogvisualization
30
http://rpsychologist.com/effect-of-sample-size-on-the-accuracy-of-cohens-d-estimates-95-ciKristoffer MagnussonEffect of sample size on teh accuracy of Cohen's d estimatesblog
31
http://rpsychologist.com/expected-overestimation-of-cohens-d-under-publication-biasKristoffer MagnussonExpected overestiationg of Cohen's d under publication biasblogvisualization
32
http://rpsychologist.com/how-to-tell-when-error-bars-correspond-to-a-significant-p-valueKristoffer MagnussonHow to tell when error bars correspond to a significant p-valueblog
33
http://rpsychologist.com/new-d3-js-visualization-bayesKristoffer MagnussonBayesian inferenceblogvisualization
34
http://rpsychologist.com/new-d3-js-visualization-t-distributionKristoffer MagnussonThe t-distritbution and its normal approximationblogvisualization
35
http://rpsychologist.com/r-guide-longitudinal-lme-lmerKristoffer MagnussonUsing R and lme/lmer to fit different two- and three- level longitudinal modelsblog
36
http://rpsychologist.com/short-r-script-to-plot-effect-sizes-cohens-d-and-shade-overlapping-areaKristoffer MagnussonShort R script to plot effect sizes (Cohen's d) and share overlapping areblog
37
http://rpsychologist.com/updated-d3-js-visualization-p-curve-distributionKristoffer MagnussonP-curve visualization updated with log x-axisblogvisualization
38
http://sometimesimwrong.typepad.com/wrong/2015/06/why-p-048-should-be-rare-and-why-this-feels-counterintuitive.htmlSimine VazireWhy p=.048 should be rareBlogp-values
39
http://sometimesimwrong.typepad.com/wrong/2015/11/guest-post-a-tale-of-two-papers.htmlMichael InzlichtA tale of two papersBlogfile drawer
40
http://willgervais.com/blog/2014/7/20/my-p-curveWill GervaisBlogp-curveassessing evidence
41
http://willgervais.com/blog/2015/3/27/mission-p-curveWill GervaisBlogClass Projectp-curveassessing evidence
42
http://www.badscience.net/Goldacre, BenBad Science log, post-Guardianblogintermediate2015
43
https://funderstorms.wordpress.com/2015/07/22/bargain-basement-bayes/David FunderBlogbeginnerBayes statistical inference
44
https://funderstorms.wordpress.com/2015/07/22/bargain-basement-bayes/JEPSBlogbeginnerBayesstatistical inference
45
https://hardsci.wordpress.com/Sanjay SrivastavaThe Hardest ScienceBlogvarious
46
https://psyborgs.github.io/projects/replication-in-psychology/the psyborgs lab, PettitReplication in Psychology: a historical perspectiveblogbeginningreproducibility2015
47
https://replicationindex.wordpress.com/2014/12/30/the-test-of-insufficient-variance-tiva-a-new-tool-for-the-detection-of-questionable-research-practices/Uli SchimmackBlogTIVA
48
https://replicationindex.wordpress.com/2015/04/30/replacing-p-values-with-bayes-factors-a-miracle-cure-for-the-replicability-crisis-in-psychological-science/Uli SchimmackBlogintermediatecriticismBayes Factors
49
https://sakaluk.wordpress.com/2015/08/27/6-make-it-pretty-plotting-2-way-interactions-with-ggplot2/Sakaluk, JohnTutorial/R code for creating plots for 2-way interactionsBlogIntermediateR; data-visualization; interactions
50
https://sakaluk.wordpress.com/2016/02/16/7-make-it-pretty-plots-for-meta-analysis/Sakaluk, JohnTutorial/R code for creating funnel/forest plotsBlogIntermediateR; data-visualization; meta-analysis
51
https://sakaluk.wordpress.com/2016/05/26/11-make-it-pretty-scree-plots-and-parallel-analysis-using-psych-and-ggplot2/Sakaluk, JohnTutorial/R code for creating scree/parallel analysis plotsBlogIntermediateR; data-visualization; factor analysis
52
https://www.theguardian.com/science/series/badscienceGoldacre, BenBad Science blog on the Guardian webpagesblogintermediate2011
53
https://robertgrantstats.wordpress.com/2015/10/21/frequentist-accuracy-of-bayesian-estimates/#commentsRobert GrantBlog advancedBayes, frequentiststatistical inference
54
http://alexanderetz.com/2015/08/30/the-bayesian-reproducibility-project/Alex EtzBlog (I think it is now also a paper?)Bayes, replication projectstatistical inference
55
http://theincidentaleconomist.com/wordpress/pre-registration-of-clinical-trials-is-associated-with-fewer-positive-findings/The Incidental EconomistPre-registration of clinical trials is associated with fewer positive findingsBlog postBeginner
56
http://www.latrobe.edu.au/psychology/research/research-areas/cognitive-and-developmental-psychology/esciCummingCumming, G. (2012). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York: Routledge.Book
57
https://errorstatistics.files.wordpress.com/2014/12/fakingscience-20141214.pdfDiederik StapelFaking Science: A True Story of Academic FraudBookintro, intermediate2014
58
https://he.palgrave.com/page/detail/?sf1=barcode&st1=9780230542303DienesDienes, Z. (2008). Understanding psychology as a science: An introduction to scientific and statistical inference. Palgrave Macmillan.bookbeginnerCompanion Website: http://www.lifesci.sussex.ac.uk/home/Zoltan_Dienes/inference/NHST; Likelihoods; Bayesian Statistics; Frequentist Statistics; Philosophy of Science2008Philosophy of Science
59
https://www.crcpress.com/Statistical-Evidence-A-Likelihood-Paradigm/Royall/p/book/9780412044113RoyallRoyall, R. (1997). Statistical evidence: A likelihood paradigm. CRC Press.bookadvancedLikelihood1997statistical inference
60
Plucker & MakelDoing Good Social Science: Trust, Accuracy, Transparencybookbeginneredited volume collecting perspectivesin press
61
http://www.amazon.com/Dyadic-Analysis-Methodology-Social-Sciences/dp/1572309865?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o09_s00Kenny et al.,Dyadic Data AnalysisBooksIntermediate-AdvancedGo-To text for dyadic data analysisStatistics; dyadic datastatistical inference
62
http://www.amazon.com/Exploratory-Factor-Analysis-Understanding-Statistics/dp/0199734178?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o00_s00Fabrigar & WegenerExploratory Factor Analysis (Understanding Statistics)BooksBeginner-AdvancedAccessible but comprehensive resource for how to do EFAStatistics; factor analysisstatistical inference
63
http://www.amazon.com/Introduction-Mediation-Moderation-Conditional-Analysis/dp/1609182308?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00HayesIntroduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based ApproachBooksBeginner-AdvancedAccessible text for fitting different regression models (simple, moderated, mediated, conditional process)Statistics; regression; interactions; mediationstatistical inference
64
http://www.amazon.com/Introduction-Meta-Analysis-Michael-Borenstein/dp/0470057246?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o02_s00Borenstein et al.,Introduction to Meta-AnalysisBooksIntermediate-AdvancedIntroductory meta-analysis textStatistics; meta-analysis
65
http://www.amazon.com/Longitudinal-Structural-Equation-Modeling-Methodology/dp/1462510167?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00LittleLongitudinal Structural Equation ModelingBooksIntermediate-AdvancedGo-To resource for longitudinal SEMStatistics; latent variables; longitudinalstatistical inference
66
http://www.amazon.com/Multilevel-Analysis-Introduction-Advanced-Modeling/dp/0761958908?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o07_s00Snijders & BoskerMultilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling 1st EditionBooksIntermediate-AdvancedMultilevel modeling resourceStatistics; MLM; HLMstatistical inference
67
http://www.amazon.com/Multiple-Regression-Correlation-Analysis-Behavioral/dp/0805822232?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00Cohen et al.,Applied Multiple Regression/Correlation Analysis for the Behavioral SciencesBooksIntermediate-AdvancedComprehensive resource for regression modelsStatistics; regressionstatistical inference
68
http://www.amazon.com/R-Graphics-Cookbook-Winston-Chang/dp/1449316956?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00BeaujeanLatent Variable Modeling Using R: A Step-by-Step GuideBooksIntermediate-AdvancedIntroductory SEM text (for use with R)Statistics; R; latent variablesstatistical inference
69
http://www.amazon.com/Theory-Construction-Model-Building-Skills-Methodology/dp/1606233394?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00Jaccard & JacobyTheory Construction and Model-Building Skills: A Practical Guide for Social Scientists BooksBeginner-AdvancedIntroduction to how to generate/conceptualize theoryTheory
70
https://www.amazon.ca/gp/product/0415832446/ref=oh_aui_detailpage_o01_s00?ie=UTF8&psc=1Finch & FrenchLatent Variable Modeling with RBooksIntermediate-AdvancedBook for EFA/CFA/IRT/LCA in RR; latent variable; statisticsstatistical inference
71
http://www.ssc.wisc.edu/soc/faculty/pages/docs/elwert/Elwert%202013.pdfElwert, F. Graphical causal modelschapterintermediatevery clear introDAG, causal inference2015
72
https://xkcd.com/882/Randall MunroeSignificantComicBeginner
73
https://osf.io/vkhbt/multiplesCourse Syllabi for Open and Reproducible MethodsCourse Syllabigradosf project of methods course syllabi
74
https://www.haverford.edu/tierProject TIERCuricculumbeginnerundergrad curriculum templates for teaching RR methods
75
http://projects.fivethirtyeight.com/p-hacking/FiveThirtyEightHack Your Way To Scientific GloryDemoBeginner
76
http://rpsychologist.com/d3/pdist/Kristoffer MagnussonDistribution of p-values when comparing two groupsDemoBeginner
77
https://osf.io/wfc6u/Jon GraheCREP projectOSF projectbeginnerundergrad curriculum templates for teaching RR methods
78
http://www.psychologicalscience.org/index.php/publications/observer/2015/september-15/bayes-for-beginners-probability-and-likelihood.htmlRandy GallistelBayes for Beginners: Probability and Liklihoodpaperbeginner
79
DOI: 10.1037//OOO3-O66X.56.2.12Meyer et alPsychological Testing and Psychological AssessmentA Review of Evidence and Issuespaperintermediatereview2001
80
http://dx.doi.org/10.1037/0003-066X.44.10.1276Rosnow RosenthalRosnow, R.L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.paperintermediateStatistical Inference; NHST; Power1989statistical inference
81
http://dx.doi.org/10.1037/1082-989X.5.2.241NickersonNickerson, R. S. (2000). Null hypothesis significance testing: a review of an old and continuing controversy. Psychological methods, 5(2), 241-301.paperbeginnerNHST; Frequentist Statistics; p-value2000NHST
82
http://dx.doi.org/10.1037/a0021524BemBem, D. J. (2011). Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect. Journal of Personality and Social Psychology, 100(3), 407-425.Papercanary in the coal mine
83
DOI: 10.1097/EDE.0b013e31818131e7IoannidisWhy Most Discovered True Associations Are Inflatedpaperintermediateidentifying problems
84
DOI: 10.1177/0956797611417632Simmons, Nelson, SimonsohnFalse-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significantpaperbeginningidentifying problems2011
85
DOI: 10.1177/0956797611430953John, Loewenstein, PrelecMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Tellingpaperintermediateidentifying problems2012
86
DOI: 10.1177/1740774507079441Ioannidis, TrikalinosAn exploratory test for an excess of significant findingspaperadvancedidentifying problems2007
87
DOI: 10.1177/1948550615612150Fiedler & SchwarzQuestionable Research Practices Revisitedpaperbeginningquestionable research practicies2015
88
DOI: 10.1177/2378023115625071PetersonThe Baby Factory: Difficult Research Objects, Disciplinary Standards, and the Production of Statistical Significancepaperbeginningquestionable research practicies2016
89
doi:10.1017/XPS.2015.19Mullinix, Leeper, Druckman FreeseThe Generalizability of Survey Experiments∗paperintermediatereproducibility2015
90
doi:10.1038/nrn3475ButtonPower failure: why small sample size undermines the reliability of neurosciencepaperintermediatepower2013
91
DOI:10.1136/bmj.318.7175.23Rooyen, Godlec, Evans, Black, Smiththe effect of open peer review on quality of reviews and on reviewers' recommendations: A randomized trialspaperintermediateopen peer review1999
92
http://bmcpsychology.biomedcentral.com/articles/10.1186/s40359-016-0126-3Lakens Hilgard StaaksLakens, D., Hilgard, J., & Staaks, J. (2016). On the reproducibility of meta-analyses: six practical recommendations. BMC Psychology, 4, 24. http://doi.org/10.1186/s40359-016-0126-3paperbeginnerMeta-Analysis; Publication Bias2016meta-analysis
93
http://cdp.sagepub.com/content/1/3/98.citationCohenCohen, J. (1992). Statistical power analysis. Current Directions in Psychological Science, 1(3), 98–101.paperbeginnerPower; Power Analysis1992Power
94
http://comp.uark.edu/~whlevine/psyc5133/fritz.morris.richler.2012.xge.pdfFritz, C. O., Morris, P. E., & Richler, J. Effect Size Estimates: Current Use, Calculations, and Interpretationpaperintermediateeffect size2012
95
http://ctj.sagepub.com/content/4/3/245.shortIoannidis TrikalinosIoannidis, J.P.A. & Trikalinos, T.A. (2007). An exploratory test for an excess of significant findings. Clinical Trials, 4, 245-253.paperintermediatePublication Bias2007Meta-Analysis
96
http://dx.doi.org/10.1037/0022-006X.46.4.806MeehlMeehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.paperbeginnerNHST1978the problem
97
http://dx.doi.org/10.1037/0033-2909.105.2.309Sedlmeier GigerenzerSedlmeier, P. & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.paperbeginnerPower; Publication Bias1989the problem
98
http://dx.doi.org/10.1037/a0025172LeBel PetersLeBel, E.P., & Peters, K.R. (2011). Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study in deficiencies in modal research practice. Review of General Psychology, 15, 371-379.paperbeginnerP-hacking; Replication; Psi; NHST2011the problem
99
http://dx.doi.org/10.1371/journal.pone.0010068Fanelli - ‘Fanelli, D. (2010) “Positive” Results Increase Down the Hierarchy of the Sciences. PLoS ONE 5(4): e10068. doi:10.1371/journal.pone.0010068Paper
100
http://dx.doi.org/10.1371/journal.pone.0026828Wicherts, Baaker, & MolenarWicherts, J. M., Baaker, M., & Molenar, D. (2011). Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results. PLoS ONE 6(11): e26828. doi:10.1371/journal.pone.0026828Paper
Loading...
 
 
 
Sheet1
 
 
Main menu