Evaluation Matrix

	A	B	C
1	Evaluation Matrix
2	Evaluation Criteria and Categories	Specific Questions	Methods and Tools
3

4	Effectiveness:
5	Objectives
6		Is the presented information accurate?	Expert (SME) checklist
7		Are the objectives clear?	End-user Survey Assessment information
8		Are the objectives achievable?	Expert (SME) checklist End-user Survey Assessment information
9		Are the objectives in line with time constraints?	Expert (SME) checklist End-user Survey Assessment information
10
11	Content
12		Is the content appropriate for 3D Game Lab?	Expert (SME) checklist End-user survey
13		Does the content cover the topic completely and accurately?	Expert (SME) checklist End-user survey Assessment information
14		Do content, objectives, activities, and assessment tools and procedures align?	Expert (SME) checklist
15		Does the content promote learning and personal application?	Expert (SME) checklist End-user survey Assessment information
16		Does the content promote collaboration and engagement?	Expert (SME) checklist End-user survey
17		Are there areas provided for discussion and reflection?	Expert (SME) checklist End-user survey Assessment information
18		Are there no violation of copyright laws?	Expert (SME) Checklist
19
20	Technology
21		Is the navigation intuitive and accessible?	End-user survey Expert (subject matter) checklist
22		Do all technical tools work as expected?	End-user survey Expert (subject matter) checklist
23		Are content materials easy to access for students?	End-user survey Expert (subject matter) checklist
24		Do the website and the 3D Game Lab merge seamlessly?	End-user survey Expert (subject matter) checklist
25		Do all external links go to a current and working website?	End-user survey Expert (subject matter) checklist
26
27	Message Design
28		Do the supporting graphics and other design elements enhance the learning without being distracting?	Expert (ID) discussion feedback Expert (SME) checklist
29		Is the voice in the content consistent throughout, and consistent with the material?	Expert (ID) discussion feedback Expert (SME) checklist
30		Are the instructions clear?	Expert (ID) discussion feedback Expert (SME) checklist End-user survey Assessment information
31		Is the time provided for the course sufficient in all areas?	End-user survey Expert (subject matter) checklist Assessment information
32		Does the design meet ADA accessibility requirements?	Expert (ID) discussion feedback Expert (SME) checklist
33
34	Appeal:
35	Objectives
36		Are the objectives relevant to students?	End-user survey Assessment information
37
38	Content
39		Is the content engaging?	End-user survey Expert (SME) checklist Assessment information
40		Is the content challenging?	End-user survey Assessment information
41		Are the activities age appropriate?	End-user survey Expert (SME) checklist
42
43	Technology
44		Is the use of 3D Game Lab appropriate for this content?	Expert (ID) discussion feedback Expert (SME) checklist
45		Has the content been proofread for typographical, spelling, grammar, and punctuation errors?	End-user survey Expert (SME) checklist
46		Do all graphics and videos appear on the page with no link breakage and do they function properly?	End-user survey Expert (SME) checklist
47		Do all external links open in a new window for easy navigation back to the lesson area?	End-user survey Expert (SME) checklist
48
49	Message Design
50		Are the message and media produced in a professional and pleasing manner?	Expert (ID) discussion feedback Expert (SME) checklist
51		Is the message design appropriate for the content and the age of the learners?	Expert (ID) discussion feedback Expert (SME) checklist
52		Are the screens uncluttered and designed to reduce cognitive overload?	Expert (ID) discussion feedback Expert (SME) checklist
53		Are the typeface, color, and font choices conducive to learning?	Expert (ID) discussion feedback Expert (SME) checklist End-user survey
54		Are all navigation devices easy to use and clear as to their function and where they will go?	End-user survey Expert (SME) checklist
55
56	Efficiency:
57	Objectives
58		Are the objectives visible and clear as to their meaning?	Expert (ID) discussion feedback Expert (SME) checklist Assessment information
59		Is the content aligned concisely with and mapped to the objectives and to National Standards?	Expert (SME) checklist
60
61	Content
62		Is the content information clearly and concisely presented without undue fluff?	End-user survey Expert (SME) checklist Assessment information
63		Is the content appropriate to the subject?	End-user survey Expert (SME) checklist
64		Is the content up-to-date and timely?	End-user survey Expert (SME) checklist
65		Is it easy to identify the assessment activities and what is expected of the learner?	End-user survey Expert (SME) checklist Assessment information
66
67	Technology
68		Is there easy access to the instructor and other learners if needed?	End-user survey Expert (SME) checklist
69		Is the use of 3D Game Lab seamlessly integrated into the Google Site, which is used as the student portal?	End-user survey Expert (SME) checklist
70		Are web tools easily and quickly accessed when needed?	End-user survey Expert (SME) checklist
71		Is a site map provided?	Expert (SME) checklist
72		Is there a FAQ section that is easily accessed and and able to be updated by the learners?	End-user survey Expert (SME) checklist
73
74	Message Design
75		Is the organization and structure of the content easily understood?	Expert (ID) discussion feedback Expert (SME) checklist Assessment information
76		Are there titles and subtitles used as appropriate for organizational purposes?	Expert (ID) discussion feedback Expert (SME) checklist
77		Does each lesson follow a consistent pattern to make navigation and searching easier?	Expert (ID) discussion feedback Expert (SME) checklist
78		Are colors, typefaces, and fonts used as organizational and navigational tools?	Expert (ID) discussion feedback Expert (SME) checklist
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100