Open Science Teaching and Training Resources
Comments
 Share
The version of the browser you are using is no longer supported. Please upgrade to a supported browser.Dismiss

 
$
%
123
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ABCDEFGHIJKLMNOPQRSTUVWXYZAA
1
Link to resourceAuthorTitle / citationType (video, blog, paper, etc.)Level (beginner, intermediate, etc.)CommentkeywordsYearLength / Time needed to view or absorbmeta keyword
2
http://www.psychologicalscience.org/index.php/publications/observer/2015/september-15/bayes-for-beginners-probability-and-likelihood.htmlRandy GallistelBayes for Beginners: Probability and Liklihood beginner
3
http://io9.gizmodo.com/i-fooled-millions-into-thinking-chocolate-helps-weight-1707251800John BohannonI Fooled Millions Into Thinking Chocolate Helps Weight Loss. Here's How.ArticleBeginner2015
4
http://onlinelibrary.wiley.com/doi/10.1111/j.1740-9713.2006.00204.x/epdfTony O'HaganArticlesbeginnerBayes Factors
5
http://www.psychologicalscience.org/index.php/publications/observer/2015/september-15/bayes-for-beginners-probability-and-likelihood.htmlObserverArticlesbeginnerlikelihood, Bayes
6
http://journal.frontiersin.org/article/10.3389/fpsyg.2014.00823/fullCarter & McCulloughArticlesintermediatePETPEESE application, ego depletion
7
https://www.theguardian.com/science/series/badscienceGoldacre, BenBad Science blog on the Guardian webpagesblogintermediate2011
8
http://www.badscience.net/Goldacre, BenBad Science log, post-Guardianblogintermediate2015
9
http://sometimesimwrong.typepad.com/wrong/2015/11/guest-post-a-tale-of-two-papers.htmlMichael InzlichtA tale of two papersBlogfile drawer
10
http://sometimesimwrong.typepad.com/wrong/2015/06/why-p-048-should-be-rare-and-why-this-feels-counterintuitive.htmlSimine VazireWhy p=.048 should be rareBlogp-values
11
http://daniellakens.blogspot.com/2015/01/always-use-welchs-t-test-instead-of.htmlDaniel LakensAlways use Welch t-testBlogintermediatet-test
12
http://daniellakens.blogspot.com/2014/06/data-peeking-without-p-hacking.htmlDaniel LakensData peeking without p-hackingBlogintermediatesequential testing
13
http://daniellakens.blogspot.com/2014/08/what-is-p-value_21.htmlDaniel LakensWhat is a p-value?Blogbeginnerp-values
14
http://willgervais.com/blog/2015/3/27/mission-p-curveWill GervaisBlogClass Projectp-curveassessing evidence
15
http://willgervais.com/blog/2014/7/20/my-p-curveWill GervaisBlogp-curveassessing evidence
16
http://disjointedthinking.jeffhughes.ca/2015/01/evaluating-r-index-p-curve/Jeff HughesBlogp-curve, R indexassessing evidence
17
http://datacolada.org/2015/05/08/37-power-posing-reassessing-the-evidence-behind-the-most-popular-ted-talk/Blogp-curve applicationassessing evidence
18
http://datacolada.org/2015/08/24/41-falsely-reassuring-analyses-of-all-p-values-2/Blogp-curveassessing evidence
19
https://replicationindex.wordpress.com/2014/12/30/the-test-of-insufficient-variance-tiva-a-new-tool-for-the-detection-of-questionable-research-practices/Uli SchimmackBlogTIVA
20
http://alexanderetz.com/2015/04/15/understanding-bayes-a-look-at-the-likelihood/Alex EtzBlogintermediatelikelihood
21
http://alexanderetz.com/2015/08/09/understanding-bayes-visualization-of-bf/Alex EtzBlogintermediateBayes Factorsstatistical inference
22
https://funderstorms.wordpress.com/2015/07/22/bargain-basement-bayes/David FunderBlogbeginnerBayes statistical inference
23
https://funderstorms.wordpress.com/2015/07/22/bargain-basement-bayes/JEPSBlogbeginnerBayesstatistical inference
24
https://replicationindex.wordpress.com/2015/04/30/replacing-p-values-with-bayes-factors-a-miracle-cure-for-the-replicability-crisis-in-psychological-science/Uli SchimmackBlogintermediatecriticismBayes Factors
25
http://blog.efpsa.org/2015/09/01/introducing-jasp-a-free-and-intuitive-statistics-software-that-might-finally-replace-spss/JEPSBlogbeginnerJASP software
26
http://datacolada.org/2015/04/09/35-the-default-bayesian-test-is-prejudiced-against-small-effects/Uri SimonsohnBlogadvancedBayes Factors
27
http://jeffrouder.blogspot.ca/2015/04/reply-to-uri-simonsohns-critique-of.htmlJeff RouderBlogadvancedresponse to Uri SimonsohnBayes Factors
28
http://bayesfactor.blogspot.co.ukRichard MoreyBlogintermediateR package tutorial
29
http://rpsychologist.com/d3/NHST/Kristoffer MagnussonUnderstanding Statistical Power and Significance Testing: an interactive visualizationblogbeginngervisualization
30
http://rpsychologist.com/new-d3-js-visualization-bayesKristoffer MagnussonBayesian inferenceblogvisualization
31
http://rpsychologist.com/updated-d3-js-visualization-p-curve-distributionKristoffer MagnussonP-curve visualization updated with log x-axisblogvisualization
32
http://rpsychologist.com/new-d3-js-visualization-t-distributionKristoffer MagnussonThe t-distritbution and its normal approximationblogvisualization
33
http://rpsychologist.com/r-guide-longitudinal-lme-lmerKristoffer MagnussonUsing R and lme/lmer to fit different two- and three- level longitudinal modelsblog
34
http://rpsychologist.com/d3/pdist/Kristoffer MagnussonDistribution of p-values when comparing two groupsblogvisualization
35
http://rpsychologist.com/d3/CI/Kristoffer MagnussonInterpreting confidence intervalsblogvisualization
36
http://rpsychologist.com/d3/correlation/Kristoffer MagnussonInterpreting correlationsblogvisualization
37
http://rpsychologist.com/expected-overestimation-of-cohens-d-under-publication-biasKristoffer MagnussonExpected overestiationg of Cohen's d under publication biasblogvisualization
38
http://rpsychologist.com/d3/cohend/Kristoffer MagnussonInterpreting cohen's d effect sizeblogvisualization
39
http://rpsychologist.com/calculating-the-overlap-of-two-normal-distributions-using-monte-carlo-integrationKristoffer MagnussonCalculating the overlap of two normal distributions using monte carlo intergrationblog
40
http://rpsychologist.com/d3-one-way-anovaKristoffer MagnussonVisualizing a one-way ANOVAblogvisualization
41
http://rpsychologist.com/how-to-tell-when-error-bars-correspond-to-a-significant-p-valueKristoffer MagnussonHow to tell when error bars correspond to a significant p-valueblog
42
http://rpsychologist.com/effect-of-sample-size-on-the-accuracy-of-cohens-d-estimates-95-ciKristoffer MagnussonEffect of sample size on teh accuracy of Cohen's d estimatesblog
43
http://rpsychologist.com/short-r-script-to-plot-effect-sizes-cohens-d-and-shade-overlapping-areaKristoffer MagnussonShort R script to plot effect sizes (Cohen's d) and share overlapping areblog
44
https://sakaluk.wordpress.com/2016/05/26/11-make-it-pretty-scree-plots-and-parallel-analysis-using-psych-and-ggplot2/Sakaluk, JohnTutorial/R code for creating scree/parallel analysis plotsBlogIntermediateR; data-visualization; factor analysis
45
https://sakaluk.wordpress.com/2016/02/16/7-make-it-pretty-plots-for-meta-analysis/Sakaluk, JohnTutorial/R code for creating funnel/forest plotsBlogIntermediateR; data-visualization; meta-analysis
46
https://sakaluk.wordpress.com/2015/08/27/6-make-it-pretty-plotting-2-way-interactions-with-ggplot2/Sakaluk, JohnTutorial/R code for creating plots for 2-way interactionsBlogIntermediateR; data-visualization; interactions
47
http://deevybee.blogspot.com/2016/01/the-amazing-significo-why-researchers.html?m=1Dorothy BishopThe Amazing Significo: why researchers need to understand pokerBlogBeginnerp-hacking
48
https://hardsci.wordpress.com/Sanjay SrivastavaThe Hardest ScienceBlogvarious
49
https://psyborgs.github.io/projects/replication-in-psychology/the psyborgs lab, PettitReplication in Psychology: a historical perspectiveblogbeginningreproducibility2015
50
http://andrewgelman.com/Andrew Gelmanblogvariousstatistical analysis, research methods, repoducibility
51
http://andrewgelman.com/Gelman, AndrewStatistical Modeling, Causal Inference, and Social ScienceBlogIntermediatestatistical inference
52
http://retractionwatch.com/category/by-author/lacour/MultipleRetraction Watch: Michael LaCour archivesBlogIntermediateCollection of articles about the faking of data, discovery through replication attempt
53
http://ron.dotsch.org/degrees-of-freedom/Ron DotschDegrees of Freedom Tutorialblogbeginnerexplanation about degrees of freedom for ANOVA2015statistics
54
https://robertgrantstats.wordpress.com/2015/10/21/frequentist-accuracy-of-bayesian-estimates/#commentsRobert GrantBlog advancedBayes, frequentiststatistical inference
55
http://alexanderetz.com/2015/08/30/the-bayesian-reproducibility-project/Alex EtzBlog (I think it is now also a paper?)Bayes, replication projectstatistical inference
56
http://theincidentaleconomist.com/wordpress/pre-registration-of-clinical-trials-is-associated-with-fewer-positive-findings/The Incidental EconomistPre-registration of clinical trials is associated with fewer positive findingsBlog postBeginner
57
https://errorstatistics.files.wordpress.com/2014/12/fakingscience-20141214.pdfDiederik StapelFaking Science: A True Story of Academic FraudBookintro, intermediate2014
58
http://www.latrobe.edu.au/psychology/research/research-areas/cognitive-and-developmental-psychology/esciCummingCumming, G. (2012). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York: Routledge.Book
59
https://he.palgrave.com/page/detail/?sf1=barcode&st1=9780230542303DienesDienes, Z. (2008). Understanding psychology as a science: An introduction to scientific and statistical inference. Palgrave Macmillan.bookbeginnerCompanion Website: http://www.lifesci.sussex.ac.uk/home/Zoltan_Dienes/inference/NHST; Likelihoods; Bayesian Statistics; Frequentist Statistics; Philosophy of Science2008Philosophy of Science
60
https://www.crcpress.com/Statistical-Evidence-A-Likelihood-Paradigm/Royall/p/book/9780412044113RoyallRoyall, R. (1997). Statistical evidence: A likelihood paradigm. CRC Press.bookadvancedLikelihood1997statistical inference
61
Plucker & MakelDoing Good Social Science: Trust, Accuracy, Transparencybookbeginneredited volume collecting perspectivesin press
62
https://www.amazon.ca/gp/product/0415832446/ref=oh_aui_detailpage_o01_s00?ie=UTF8&psc=1Finch & FrenchLatent Variable Modeling with RBooksIntermediate-AdvancedBook for EFA/CFA/IRT/LCA in RR; latent variable; statisticsstatistical inference
63
http://www.amazon.com/Multiple-Regression-Correlation-Analysis-Behavioral/dp/0805822232?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00Cohen et al.,Applied Multiple Regression/Correlation Analysis for the Behavioral SciencesBooksIntermediate-AdvancedComprehensive resource for regression modelsStatistics; regressionstatistical inference
64
http://www.amazon.com/Multilevel-Analysis-Introduction-Advanced-Modeling/dp/0761958908?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o07_s00Snijders & BoskerMultilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling 1st EditionBooksIntermediate-AdvancedMultilevel modeling resourceStatistics; MLM; HLMstatistical inference
65
http://www.amazon.com/Theory-Construction-Model-Building-Skills-Methodology/dp/1606233394?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00Jaccard & JacobyTheory Construction and Model-Building Skills: A Practical Guide for Social Scientists BooksBeginner-AdvancedIntroduction to how to generate/conceptualize theoryTheory
66
http://www.amazon.com/Exploratory-Factor-Analysis-Understanding-Statistics/dp/0199734178?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o00_s00Fabrigar & WegenerExploratory Factor Analysis (Understanding Statistics)BooksBeginner-AdvancedAccessible but comprehensive resource for how to do EFAStatistics; factor analysisstatistical inference
67
http://www.amazon.com/Dyadic-Analysis-Methodology-Social-Sciences/dp/1572309865?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o09_s00Kenny et al.,Dyadic Data AnalysisBooksIntermediate-AdvancedGo-To text for dyadic data analysisStatistics; dyadic datastatistical inference
68
http://www.amazon.com/Introduction-Mediation-Moderation-Conditional-Analysis/dp/1609182308?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00HayesIntroduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based ApproachBooksBeginner-AdvancedAccessible text for fitting different regression models (simple, moderated, mediated, conditional process)Statistics; regression; interactions; mediationstatistical inference
69
http://www.amazon.com/Longitudinal-Structural-Equation-Modeling-Methodology/dp/1462510167?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00LittleLongitudinal Structural Equation ModelingBooksIntermediate-AdvancedGo-To resource for longitudinal SEMStatistics; latent variables; longitudinalstatistical inference
70
http://www.amazon.com/R-Graphics-Cookbook-Winston-Chang/dp/1449316956?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o03_s00BeaujeanLatent Variable Modeling Using R: A Step-by-Step GuideBooksIntermediate-AdvancedIntroductory SEM text (for use with R)Statistics; R; latent variablesstatistical inference
71
http://www.amazon.com/Introduction-Meta-Analysis-Michael-Borenstein/dp/0470057246?ie=UTF8&psc=1&redirect=true&ref_=oh_aui_detailpage_o02_s00Borenstein et al.,Introduction to Meta-AnalysisBooksIntermediate-AdvancedIntroductory meta-analysis textStatistics; meta-analysis
72
http://www.ssc.wisc.edu/soc/faculty/pages/docs/elwert/Elwert%202013.pdfElwert, F. Graphical causal modelschapterintermediatevery clear introDAG, causal inference2015
73
https://xkcd.com/882/Randall MunroeSignificantComicBeginner
74
https://osf.io/vkhbt/multiplesCourse Syllabi for Open and Reproducible MethodsCourse Syllabigradosf project of methods course syllabi
75
http://rpsychologist.com/d3/pdist/Kristoffer MagnussonDistribution of p-values when comparing two groupsDemoBeginner
76
http://projects.fivethirtyeight.com/p-hacking/FiveThirtyEightHack Your Way To Scientific GloryDemoBeginner
77
https://osf.io/wfc6u/Jon GraheCREP projectOSF projectbeginnerundergrad curriculum templates for teaching RR methods
78
https://www.amstat.org/newsroom/pressreleases/P-ValueStatement.pdfAmerican Statistics AssociationAmerican Statistical Association Releases Statement On Statistical Significance And P-Valuespaperintermediatep-values2016
79
http://comp.uark.edu/~whlevine/psyc5133/fritz.morris.richler.2012.xge.pdfFritz, C. O., Morris, P. E., & Richler, J. Effect Size Estimates: Current Use, Calculations, and Interpretationpaperintermediateeffect size2012
80
https://scholar.google.ca/citations?view_op=view_citation&hl=en&user=V4uGPd8AAAAJ&citation_for_view=V4uGPd8AAAAJ:9yKSN-GCB0ICWicherts et al., The poor availability of psychological research data for reanalysis.PaperIntermediateOpen-data; meta-science
81
https://scholar.google.ca/citations?view_op=view_citation&hl=en&user=V4uGPd8AAAAJ&citation_for_view=V4uGPd8AAAAJ:isC4tDSrTZICBakker et al.,The rules of the game called psychological sciencePaperIntermediateScientific norms; NHST
82
https://scholar.google.ca/citations?view_op=view_citation&hl=en&user=V4uGPd8AAAAJ&citation_for_view=V4uGPd8AAAAJ:9ZlFYXVOiuMCWicherts et al., Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical resultsPaperIntermediateOpen-data; misreporting; meta-science
83
https://scholar.google.ca/citations?view_op=view_citation&hl=en&user=V4uGPd8AAAAJ&citation_for_view=V4uGPd8AAAAJ:qxL8FJ1GzNcCBakker & WichertsThe (mis) reporting of statistical results in psychology journalsPaperIntermediateMisreporting; meta-science
84
https://scholar.google.ca/citations?view_op=view_citation&hl=en&user=ohvM23IAAAAJ&citation_for_view=ohvM23IAAAAJ:UeHWp8X0CEICNuijten et al., The prevalence of statistical reporting errors in psychology (1985–2013)PaperIntermediateMisreporting; meta-science
85
https://scholar.google.ca/citations?view_op=view_citation&hl=en&user=ohvM23IAAAAJ&citation_for_view=ohvM23IAAAAJ:9yKSN-GCB0ICVeldkamp et al.,Statistical reporting errors and collaboration on statistical analyses in psychological sciencePaperIntermediateMisreporting; meta-science; collaboration
86
https://www.researchgate.net/profile/John_Sakaluk/publication/278669337_Analytic_Review_as_a_Solution_to_the_Misreporting_of_Statistical_Results_in_Psychological_Science/links/55821a5c08ae1b14a0a1052d.pdfSakaluk, JohnAnalytic Review as a Solution to the Misreporting of Statistical Results in Psychological SciencePaperBeginner-IntermediateMisreporting; meta-science
87
http://johnsakaluk.com/wp-content/uploads/2014/06/Sakaluk_2015_JESP.pdfSakaluk, JohnExploring Small, Confirming Big: An Alternative System to The New Statistics for Advancing Cumulative and Replicable Psychological ResearchPaperBeginner-AdvancedMeta-science; systems for research; the new statistics
88
http://robotics.cs.tamu.edu/RSS2015NegativeResults/pmed.0020124.pdfIoannidisIoannidis, J. P. A. (2005). Why most published research findings are false. PloS MEDICINE, 2, 696-701.Papercompute probability of true finding given p < .05 using Bayesian argumentthe problem
89
IoannidisIoannidis, J. P. A. (2012). Why science is not necessarily self-correcting. Perspectives on Psychological Science, 7, 645-654.Paperthe problem
90
Begley & EllisBegley, C. G. & Ellis, L. M. (2012). Raise standards for preclinical cancer research. Nature, 483, 531-533.Paper11 / 59 studies had reproducible resultsreplication, biology, cancerthe problem
91
Simmons, Nelson, & SimonsohnSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359-1366.PaperDescribes QRPs and has compelling simulationthe problem
92
Ferguson & Heene Ferguson, C. J. & Heene, M. (2012). A vast graveyard of undead theories: Publication bias and psychological science’s aversion to the null. Perspectives on Psychological Science, 7(6), 555-561.Paper
93
Makel, Plucker, & HegartyMakel, M. C., Plucker, J. A., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7(6), 537-542.Paper
94
MakelMakel, M. C. (2014). The empirical march of science: Making science better at self-correction. Psychology of Aesthetics, Creativity, and the Arts.Paper
95
McBee & Matthews: McBee, M. T. & Matthews, M. S. (2014). Change starts with journal editors: In response to Makel (2014). Psychology of Aesthetics, Creativity, and the Arts, Vol 8(1), Feb 2014, 8-10.Paper
96
Simmons et al. SPS dialogue - A 21 word solutionPaper
97
Makel & Plucker - Facts are more important than noveltyPaper
98
Nosek, Spies, & MotylNosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific Utopia II. Restructuring Incentives and Practices to Promote Truth Over Publishability. Perspectives on Psychological Science, 7(6), 615-631.Paper
99
McBee & MatthewsWelcoming quality in non significance and replication work, but moving beyond the p value: announcing new editorial policies for quantitative research in JoAAPaper
100
Pashler & Wagenmakers Intro to the special issuePaper
Loading...
 
 
 
Sheet1