ABCDFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAI
1
Multi-community member requestLevelMetric CategoryIs this a basic metric to help me analyze growth/health of my instance?Will this metric help me to identify learners at risk of dropping out?Will this metric help me to analyze the effectiveness of my assessments?Display metricAdmin (manager)InstructorCourse creatorSite operator (sys-admin)On-campus needMOOC (lighttouch) needIs this possible with OARS?Is this in OARS V1?Needs further clarificationNotes
2
Total number of students that attempted an exam (Spanish)courseData aggregated across learners in a courseyesNumberX?need to classify an examfelipe: agree. I'll ask for further clarification
3
Ranking of learners per course based on learner performance (Spanish)courseData aggregated across learners in a courseTableXyes*nowould require UI investmentfelipe: this comes from a concept of performance that is not yet well defined. I think this would only make sense in a plugin since every installation might define performance diferently
4
Time a student takes to complete a course (Spanish)courseData aggregated across learners in a courseAverageXXxmaybeOPtions: 1) Real time from registration to completion, 2) How much total time which is an aggregate as in #of hours working on course
5
Percentage of students completing a course in a specific time period. (Spanish)courseData aggregated across learners in a courseNumber(Total)XXxyesno
6
Learners’ success rate(learners course approval rate) (Spanish)courseData aggregated across learners in a courseyesPercentangeXXx?qualitative from exit surveys?
7
Number of courses per org (Spanish)instance/org
Data aggregated across multiple courses (instance or org level)
TotalXXXxxyesmaybe
8
Total unique video minutes watched (Spanish)courseData on specific course contentNumberXyesyes
9
Total repeated minutes of fully viewed videos. (Spanish)courseData on specific course contentNumberXyesyesweird ontingency for fully watched?
10
Evaluable problems answered correctly (Spanish)courseData on specific course contentyesPercentage per courseXyesyes
11
Non-evaluable problems answered correctly (Spanish)courseData on specific course contentyesPercentage per courseXyesyes
12
Attempts per evaluable problems (Spanish)courseData on specific course contentyesAverageXyesyes
13
Attempts per non-evaluable problems (Spanish)courseData on specific course contentyesAverageXyesyes
14
How learners perform on a subset of questions that share specific content-tags (e.g., all questions that target the same learning objective)- for content revision. (Darcy MIT)courseData on specific course contentyes
15
Difficulty and discrimination factor of problems (to find out which are confusing or at the wrong level) --Colin, HarvardcourseData on specific course contentyes
16
What percentage of learners follow outside links? (so I know how many of those to provide) --Colin, HarvardcourseData on specific course content
17
Total number of videos per course (Spanish)courseData on specific course contentNumber, with % variation to last weekXXXyesyes?
18
Total video content time (Spanish)courseData on specific course contentNumber, with % variation to last weekXyesyes?know how many videos there are, not sure how long they are (video played, paused, skipped, closed captions, finished with time stampt - so know from teh finish event so the video actually has to be finished)
19
Total number of evaluable ORA components (Spanish)courseData on specific course contentNumberXyesyes?
20
Total number of non-evaluable ORA components (Spanish)courseData on specific course contentNumberXyesyes
21
Total number of non-evaluable problem components (Spanish)courseData on specific course contentNumberXyesyesmeans non-graded?felipe: yes non evaluable would be problem components that are not in a graded section
22
Total number of course materials per course (Spanish)courseData on specific course contentNumberXXnocourse materials? files and uploads?
23
Total number of learners’ file uploads (Spanish)courseData on specific course contentNumberXXnono
24
Total number of learners' file downloads (Spanish)courseData on specific course contentNumberXXnono
25
How are my client administrators using the dashboards to see usage and performance data on their learners?instance/org
Data that enables internal analyses of an instance, organization or course
26
What are common patterns of instructional design in our courses? (internal training) --Colin, Harvardinstance/org
Data that enables internal analyses of an instance, organization or course
27
Which courses are taking up inordinate amounts of space? (cleanup) --Colin, Harvardinstance/org
Data that enables internal analyses of an instance, organization or course
28
How long does it take authors to create various components? (UX improvement) --Colin, Harvardinstance/org
Data that enables internal analyses of an instance, organization or course
29
What are the most common errors generated by Studio? (UX revision) --Colin, Harvardinstance/org
Data that enables internal analyses of an instance, organization or course
30
Course enrollments breakdown (course modes) by course and by org (Spanish)courseSelf-reported learner datayesPie chartXXXxno
31
All the statistics on the list should be filterable by demographics (so I can tell whether my course is biased) --Colin, HarvardcourseSelf-reported learner datayes
32
For the learners in a particular course, which other courses have they taken before? (marketing and program design) --Colin, HarvardcourseSelf-reported learner data
33
New registrations per month (Spanish)course/instance
Data about a single course; Data aggregated across multiple courses (instance or org level)
yesAverage, totalXxyesyes
34
Course enrollments in the last week, month, year (Spanish)Aggregate course enrollments in the last month, so I can measure growth month over monthcourse/instance
Data about a single course; Data aggregated across multiple courses (instance or org level)
yesTotalxyesyes
35
Number of active users per course in a specific period (Spanish)courseData aggregated across learners in a courseyesXXxyesno
36
Students’ grades breakdown(grading policy) (Spanish)courseData aggregated across learners in a courseyesAverageXXx?have pass/fail - needs more info
37
Learners progress based on completions, grades, and forum participation time spent and interactions (Spanish)A list of students and their progress/grade -- John, Curricu.meindividual learnerData about a single learneryesyesPercentageXno?how to define interactions?could do completions, grades, but not forums
38
Time without accessing the course (course inactivity) (Spanish)Period of time between a learner's engagements with the course, as an indicator of drop-out risk

"Last Activity" by student. Could be a date when they last interacted with the course. Or a date plus the location/component they last interacted with. -- John, Curricu		individual learnerData about a single learneryesTotal per learnerXXxyesno
39
Learners progress (Spanish)A way to determine the amount of progress through the course - % of material viewed, read, listened to etc so that certificates can be awarded based on progress or grades.

I would like to track learner journeys through the course. Julie M.

Where do people who pass the course stop? What about those who don't pass? (targeting course revision) --Colin, Harvard		individual learnerData about a single learneryesPercentageXXxyescould use completion data - here are the problems in the course, numebr of people who have completed them
40
Learners' activity by device (Spanish)Learners' activity by device, so I can assess outcomes on mobile vs non-mobilecourseData aggregated across learners in a courseyesPie chartXXXyesno
41
Learners' video engagement (how much content of the video students watched) (Spanish)courseData aggregated across learners in a coursemaybePercentageXyesyes
42
Number of distinct users participating in the forum (Spanish)courseData aggregated across learners in a courseyesTotalXnonoforums currently doesn't produce events
43
Number of total participation in the forum (Spanish)courseData aggregated across learners in a courseyesTotalXnono
44
Time learners spent on a course (Spanish)How does time spent correlate with grade and experience level? (so I can give good advice to the learners) --Colin, HarvardcourseData aggregated across learners in a courseyesAverage, TotalXXxyesnoDetermined by dropoff rates and a certain threshold
45
course dropout rate (Spanish)courseData aggregated across learners in a courseyesPercentageXXXxyesno
46
Time learners spent on the platform (Spanish)instance/orgData aggregated across learners in an instance/orgyesAverageXXxyes*noWhat are the parameters for ACTIVE involvement? Which parts of the student workflow count? Just in the course outline? In Discvoery? On particular problems? Support? etcfelipe: the specific graph they want to show is a time series of time spent to the same learner that is currently logged in. Making sure that the time spent is active time could become a definition nightmare. What we have done for this type of report in the past is to take any action as a watchdog reset on the session time. The reset window we have seen used is 5min. I believe this is how cairn does it (https://github.com/overhangio/tutor-cairn/blob/6f3637e34f798661d88462c0477a7e703f15cf03/tutorcairn/templates/cairn/apps/superset/bootstrap/courseoverview.json#L18).
47
Time without accessing the platform (platform inactivity) (Spanish)instance/orgData aggregated across learners in an instance/orgyesTotal per learnerXXxnocould do last activity on any course, but if you're in support, catalog, etc wouldn't be measured
48
Number of active users per site in a specific period (Spanish)instance/org
Data aggregated across multiple courses (instance or org level)
yesTotalXxyesmaybe
49
Certificates generated per org and course (Spanish)instance/org
Data aggregated across multiple courses (instance or org level)
yesTotalXXXxyesnowould be scoped to only platfrom certificates, not third party
50
Component completion rate (Spanish)course
Data aggregated across multiple courses (instance or org level)
yesAverage, totalXXXxyesclarify what component means - xblock compoennt? or unit?felipe: I believe this means leaf-xblock as per my other comment above
51
How do the metrics on my course compare with other similar courses? (program design and course revision) --Colin, Harvardinstance/org
Data aggregated across multiple courses (instance or org level)
yes
52
Which courses have the highest forum traffic? (TA resource allocation) --Colin, Harvardinstance/org
Data aggregated across multiple courses (instance or org level)
yes
53
Time learners spent on a component (Spanish)courseData on specific course contentyesAverage, TotalXXxnoNeed to clarify what a "component" means - component xblock? Or several chunks of text? Or a unit?This is a common error in communication. Component for most people that are not familiar with the technical side of studio means an xblock that is a leaf from the tree of the course content. It comes from the studio interface (https://imgur.com/UmqkFoP)
54
Time a student takes to complete a problem component (Spanish)courseData on specific course contentyesyesAveragexxxnoWill. know how much time is spent on page and where on cycle you clicked the completed button. Not possible to measure time from clicking checkbox to submission
55
Problem completion data across any course where it is used so I can measure if a learner is improving over time on a particular skill.courseData on specific course contentyesyes
56
Course section dropout rate (Spanish)courseData on specific course contentyesReport/tableXXXxnoTricky - could be either this as as far as you got in the course, or this is the last thing you looked at, but both assume linear progress
57
A better way to view learners' partial credit scores per problem in something like an Insights report- would give us a more accurate picture of performance. (Darcy MIT)courseData on specific course contentyesyes
58
If there a correlation between assessment performance and engagement in related instructional activities.courseData on specific course contentyesyes
59
Forum Responses, Replies by Student and Topic -- John, Curricu.mecourseData on specific course contentyes
60
"Bounce Rate". How many students saw a component but didn't interact with or finish it.courseData on specific course contentyes
61
What pages in the course generate the most discussion in the forum? (those page might be confusing or compelling) --Colin, HarvardcourseData on specific course contentyes
62
Course enrollments breakdown (geography) by course and by org (Spanish)Basic demographics: age, gender, location, education level, etc. (marketing) --Colin, HarvardcourseSelf-reported learner datayesMapXXXxyes*nocontingent on student self-reporting, would need a pipeline to get data into reporting database
63
Course enrollments breakdown (age) by course and by org (Spanish)Basic demographics: age, gender, location, education level, etc. (marketing) --Colin, HarvardcourseSelf-reported learner datayesPie chart by age groups (0-10, 10- 20, 20-36, 36-56, 56+)XXXxno
64
Course enrollments breakdown (organization) if they use TPA by course and by org (Spanish)courseSelf-reported learner datayesPie chartXXXxno
65
Course enrollments breakdown (level of education) by course and by org (Spanish)Basic demographics: age, gender, location, education level, etc. (marketing) --Colin, HarvardcourseSelf-reported learner datayesPie chartXXXxno
66
Course enrollments breakdown (gender) by course and by org (Spanish)Basic demographics: age, gender, location, education level, etc. (marketing) --Colin, HarvardcourseSelf-reported learner datayesBar chartXXXxno
67
Course enrollments breakdown (custom registration fields) by course and by org (Spanish)courseSelf-reported learner datayesPie chartXXXxno
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100