Impact measures for OER and OEP

	A	B	C	D	E	F
1	Goal: an at-a-glance view of studies that measured impact of OER or OEP and what those measures are	Guidelines open to anybody to add to the list. If you want to add a column or add more detail feel free to make a copy of the Workbook and share back	Note: Currently unsorted but as list grows I may separate into different sheets	Why: I'm interested in the range of types of impact measures and the frequency of which they occur. I'm not an expert in impact measurement and would like to understand this better for application in my own context.
2	authors and year	Unit measured	What it's about	How impact measured	URL	contributer
3	Pitt et al 2013	OER - courses	completion, persistence, mastery between all students and low income	1. educator views on learner performance. 2. learner survey responses while students used the course materials.3., an analysis of student performance data in instances where students were studying formal assessed courses either alongside, or after using, the open course material from Bridge to Success.	https://files.eric.ed.gov/fulltext/EJ1034706.pdf	@tanbob
4	Otago Polytechnic	OEP (at institutional level)		the strongest indication of the benefit is expressed in the return on investment (ROI). This is calculated by gains in: 1.branding awareness 2. educational resource quality 3. savings in IT infrastructure costs.	https://en.wikibooks.org/wiki/Open_Education_Practices:_A_User_Guide_for_Organisations/Measuring_Open_Education	@tanbob
5	Weller et al 2015	OER	impact on teaching and learning practice	via 11 hypotheses	https://oro.open.ac.uk/44963/1/227-1106-2-PB-3.pdf	@tanbob
6	Open ED Group	OER	framework -approach to studying the impact of open educational resources (like open textbooks) and open pedagogy	Cost, outcomes, usage, perceptions	https://openedgroup.org/coup	@tanbob
7	Ross et al 2018	OER-textbooks	student views and completion rates	student views of quality and purchasing; course grades and completion rates	https://www.openpraxis.org/index.php/OpenPraxis/article/view/892	@tanbob
8	Fischer et al 2015	OER-textbooks	comparing students who use OER and not	1. course completion 2. course grade C- or better 3. course grade 4. number of credits taken in given semester	http://link.springer.com/10.1007/s12528-015-9101-x	@tanbob
9	Grimaldi et al 2019	OER	methodological issues in OER studies	access hypothesis: when access rates are high, impact of OER intervention will be lower.Important consideration in impact research.	https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0212508	@tanbob
10	Hilton et al 2016	OER-textbooks	course throughput	drop rates, withdrawal rates, and C or better rates.	http://www.irrodl.org/index.php/irrodl/article/view/2686	@tanbob
11	Colvard et al, 2018	OER-textbooks	impact of course level facutly adoption of OER	1.student academic performance via evaluating final grades and DFW (D, F, and withdrawal letter grades) rates 2) lower socio economic (Pell Grant) vs non Pell grant 3) student performance of underserved populations when a free OER textbook is used instead of a traditional textbook.	http://www.isetl.org/ijtlhe/pdf/IJTLHE3386.pdf	@tanbob
12	Conole and Brown, 2018	open ed movement	reflection paper on impact on learning, teaching and research	no measures, summary/reflection	http://www.jl4d.org/index.php/ejl4d/article/view/314	@tanbob
13	Wiley et al, 2016	OER - Z degree	sustaining adoption of OER	there are real costs to adopting OER. INTRO model (for sustaining OER adoption).INcreased Tuition Revenue through OER. Enrollments and drops in Z vs Non Z courses	http://epaa.asu.edu/ojs/article/view/1828	@tanbob
14	Jhangiani et al, 2018	OER-textbooks	open digital vs open print comparison	perceptions, use, and course performance: performance on course exams ; student study habits ; students’ perception of quality ; students’ perceptions of a fair price ; students’ textbook format preferences	https://ojs.lib.uwo.ca/index.php/cjsotl_rcacea/article/view/7032/5746	@tanbob
15	Jhangiani and Jhangiani, 2017	OER-textbooks	perceptions, use and impact of open textbooks	textbook purchasing behaviours; Impact of Textbook Costs on Course Outcomes (course enrollment, persistance and grade); Use of Open Textbooks; perceptions of quality and features;	http://www.irrodl.org/index.php/irrodl/article/view/3012	@tanbob
16
17	Hoosen and Butcher, 2019			[tbc...]	https://iite.unesco.org/wp-content/uploads/2019/04/Understanding_the_impact_of_OER_2019_final.pdf	@cmplxtv_studies
18	Hodgkinson-Williams and Arinto, 2017			[tbc...]	https://zenodo.org/record/1005330	@cmplxtv_studies
19	Law, Perryman, and Law, 2013			[tbc...]	http://oro.open.ac.uk/39102/	@cmplxtv_studies
20	Reich, 2015 [2011]				http://edutechdebate.org/oer-and-digital-divide/open-educational-resources-expand-educational-inequalities/	@cmplxtv_studies
21	Clinton et al, 2019		student learning open and commercial textbooks	student learning from, and perceptions of commercial vs open: Textbook Assessment and Usage Scale; validated questionnaire;	https://www.frontiersin.org/articles/10.3389/feduc.2019.00110/full	@tanbob
22	https://www.fasttrackimpact.com/
23	https://www.slideshare.net/robertfarrow/shaping-open-practice-oer-research-impact-for-research-excellence-framework-2021
24	prasad				http://oasis.col.org/bitstream/handle/11599/2516/PDF?sequence=1&isAllowed=y
25	Pitt et al 2013	open initiative	impact of an open initiative and problemetizing the methododlogy	impact on learners - educator perceptions of studnet performance ,student surveys, student performance data; see helpful model on p 13
26	kirkwood and price 2014	TEL	meta-anaylsis of TEL - not impact directly but useful things to consider in lit review	lit review: . Efficiency – existing processes carried out in a more cost-effective, time- effective, sustainable or scalable manner. . Enhancement – improving existing processes and the outcomes. . Transformation – radical, positive change in existing processes or intro- ducing new processes. note diff stakeholders may be interested in differnt things
27	ATD report	ATD OER program- textbooks		academic and economic impacts
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100