ABCDFGHIJKLMNOPQRSTUVWXYZ
1
Penn StatePersonaKeywords/Focus areaSourceWill this be accomplished with OARS?Product Priority
2
Row level security: the capability to limit access to certain rows (records) to users, based on the content of a field (e.g., allow each teacher to access only their courses)course adminaccess, permissions, securityAulasneo customers
✅ Yes, I hope to support 3 levels of permissions in v1: Instructors can see all events for their courses, Org admins can see all events for all courses in the org, site operators can see all event data and create / edit reports.
3
Column level security: restrict access to certain fields to users (e.g., course price)course adminaccess, permissions, securityAulasneo customers
❌ No, data is not likely to be stored in such a way that this is possible. Data that needed more granular permissions would need to be stored in different tables. Currently there isn't a plan to include anything but learner traces, however.
4
Need more nuanced permissions control and security levels. For example currently can’t give instructors access to analytics without also giving them access to Studio, but they don’t want their instructors all having access to Studio.course adminaccess, permissions, securityWGU
〰️ Maybe, right now all permissions come from LMS but I will put a note in the Superset permissions ticket to see if we can allow site operators to override those permissions. I don't think we'll be able to do it on a course-by-course basis though.
5
As a site admin, I want to compare figures between courses, organizations, editionscourse adminaggregate dataAulasneo customers
✅ Yes, but we're not likely to have those reports pre-written as part of v1. They'll have to write them themselves, and are likely to be slow.
6
Analysis of all courses, and all learners, at the same time, is the goaleducator, course adminaggregate dataHMS
〰️🦾 This will be possible for site operators, but the system won't be optimized for this at large scales, usability would depend on the size of the install, how much money they want to spend, and the types of queries they want to run
7
Initiative for aggregated statistics- aggregated across multiple courses rather than course-leveleducator, course adminaggregate dataUC3M
〰️🦾 This will be possible at the org level and site operator level, but usability will also depend on the size of the install and how much data they want to work with
8
Generating real-time learner experience pathways based on assessments and other feedback loopslearnerlearner engagement dataWHO
❌ v1 will be the first step to this, and this ticket will help us understand how this might work, but adaptive learning is a huge task that is not planned yet
9
Need both static and dynamic attributes to determine what content students see. Need deep event engagement data to answers questions like - is this student taking a long time because they are struggling, or because they are distracted? How many videos have they watched? How long were they engaged with the video?educator, instructional designerlearner engagement data WGU
✅〰️❌ Some yes, some no. There are a number of things conflated here. We expect to have deep engagement data on things like problems and videos. It's not clear to me how that could be used to tease out why a learner is struggling. As above, v1 doesn't currently have a path back to the LMS for adaptive learning but we have some discovery work for it.
10
What is the correctness delta between the first assessment attempt and the second attempt?educator, instructional designerlearner engagement data - assessmentsHMS
❌ I don't believe that we will have enough data on the problems themselves to answer this question. We would need to have some information on "how correct" each answer is, and I don't believe that exists. We could report on, ex, number of attempts per student or usage of the "show hint" / "show answer" functionality to help understand the difficulty of the problems or identify learners that are having an unusually hard time which is not really the same thing. I think we would need LMS changes to support this.
11
Content reuse data - -descriptive and dynamic metadata (dynamic like time on task and difficulty it gives students). Dynamic data examples: atomic time - how much time did a student spend on a problem. Molecular time - additional time needed to reference textbooks. The ideal would be to measure learning per unit time.educator, instructional designerlearner engagement data - assessmentsMIT
〰️ It seems like there are a lot of requests for page view times / counts. We don't currently support that for v1, so I'll see what we can do to add it. It's vastly more data than we were expecting to collect at this point.
12
As a teacher, I want to see in which units do students spend more timeeducator/course adminlearner engagement data - page dataAulasneo customers〰️ (See line 11)
13
What was the learner page view path through their course? Is there a theme, are pages frequently revisited, and which page has the longest dwell time?educator, instructional designerlearner engagement data - page dataHMS〰️ (See line 11)
14
How many total seconds were spent viewing a page? Basically, any learner or administrative activity in the logs is within the scope of our research.educator, instructional designerlearner engagement data - page dataHMS〰️ (See line 11)
15
Page views and amount of time spend per page (total seconds)educator, course adminlearner engagement data - page dataPenn State〰️ (See line 11)
16
“We want to look at a course with 10k people and be able to say: In XYZ year, this is how many people engaged with this page and this is how much time they spent”educator, course adminlearner engagement data - page dataPenn State〰️ (See line 11)
17
Predictive reports/analytics to identify at-risk students. educator, course adminlearner engagement data - predictiveMIT
✅〰️ Probably, I'm not sure how Insights calculates this but I think we can do the same or similar. If it's in the "existing in Insights" bucket I would expect that we will do it in v1
18
Predictive analyticseducator, instructional designerlearner engagement data - predictiveUC3M✅ (See line 17)
19
As a teacher, I want to see how many videos have been watched, out of the units that were released in the last period (e.g. week)educatorlearner engagement data - videoAulasneo customers
✅ I'm not sure what "units were released last" week means here, but we will display which videos were viewed and segment that by time frame
20
As a course author, I want to see which videos were most seen, which were seen at double speed, which were replayed, which segment of the video was most seen, replayed and skippededucatorlearner engagement data - videoAulasneo customers
〰️🦾 These will all be technically possible, but there will likely not be "out of the box" built in reports to surface them all in v1
21
Their need is to to connect in-person and online experiences into one cohesive learning experience. Use case: Learner completes a 5-hour online training course on landscaping, then has their pruning skills assessed in-person. Need 1) Seamless purchase of a blended learning experience; 2) Tie the off-campus event to the platformoffline eventsPenn State
❌ Not out of the box in v1. They would need to do the work to bring in data from the offline course into the LRS, which is an open standard so pretty feasible, then tie the OeX user to the offline user and generate custom reports. So it would be doable with some work, and it would be work documenting how to do it, but it's not a v1 use case.
in-person=off line
22
Data and analysis to track progress of cohorts/groups, especially for blended contextseducator, course adminprogress data (cohort/group)anonymized
❌ Not in v1. We won't have access to cohorts or group data in v1, for the blended case the answer is the same as Penn State's above.
23
Individual data - for in-person/live courses. An instructor/educator needs to understand which individual is doing what and their individual progress in real-timeeducator, course adminprogress data (individual)anonymized
🧑🏾‍🎓〰️ Maybe, we are set to have a discussion about this soon, as some places only want anonymized data and others only want identified data. It seems likely that we will settle on a way to let site operators choose which identifiers to use for their install.
24
As a site admin, I want to track all activities of a specific studentcourse adminprogress data (individual)Aulasneo customers
🧑🏾‍🎓〰️ Maybe, see line 23. If we are only storing anonymized data the identifier will remain the same for a course so tying user data together will still work, it will just be more difficult to tie it back to a person's identifying information. If we go with storing personal information, or allow a site admin to choose that route, the answer would be yes.
25
As a teacher, I need a progress report for each studenteducator, course adminprogress data (individual)Aulasneo customers🧑🏾‍🎓〰️ Maybe, see line 23
26
Easier ways to track individual student progresseducator, course adminprogress data (individual)UBx🧑🏾‍🎓〰️ Maybe, see line 23
27
Real-time progress reports at individual level - both at progress-across-the-course level and at the individual problem/assessment leveleducator, instructional designerreal time progress data (individual)anonymized
🧑🏾‍🎓〰️ Maybe, see line 23 (the general expectation is that data will be "near real time", seconds behind LMS)
28
Real-time, in-context analyticseducator, course adminreal time progress data (individual)UC3M🧑🏾‍🎓〰️ Maybe, see line 23
29
Need to know who is where and what they are doing at all times - better tracking of progress at individual student level for engagementeducator, course adminreal time progress data (individual)WGU🧑🏾‍🎓〰️ Maybe, see line 23
30
“Quick views” for educators. For educators, quick insights into #enrollments, courses by enrollment, courses by completion, quick stats by course etceducator, course adminreportinganonymized ✅ Yes
31
"Quick view" for learners. For learners, courses enrolled, progress by course, completionslearnerreportinganonymized
❌ No, this is LMS functionality. There are currently no plans to surface any of this data to learners for v1.
32
Better visualization of real-time dataeducator, course adminreportinganonymized Yes (near real time)
33
An important need for enterprise instances is to be able to align their enterprise training to internal KPIsreportinganonymized
〰️🦾 Maybe. It's a vague ask, but the data generated could be exported into a variety of formats, and reports that we offer might satisfy this need... or custom reports written to do that.
34
As a student, I want to see the courses I’m enrolledlearnerreportingAulasneo customers❌ No, this is LMS functionality.
35
As a student, I want to see the courses I’ve completed and my gradelearnerreportingAulasneo customers❌ No, this is LMS functionality.
36
As a teacher, in courses with zoom live sessions, I need an attendance report per student for each sessioneducatorreportingAulasneo customers
🧑🏾‍🎓〰️🦾 Maybe, if the zoom call is from a specific page / block in the LMS and they're storing user identifying information. Otherwise I don't know how we would track this.
37
Make it easy to export data into third-party business analytics tools - tie to google analytics for exampleeducator, course adminreporting - exportinganonymized
✅ Yes, and we support GA outside of this system as well
38
Challenge is integration - getting accurate course completion data. Need a more elegant way to define course completion. The only way around their integration setup is to have students complete a yes/no quiz saying they completed the course. They rely on the course completions to report out CEUs or credential. They use the completion counts to measure impact of programs and if no CEU attached, there’s not a lot of motivation to complete the quiz. course adminreporting - exportingPenn State
✅ Yes, but completion is a difficult problem in the platform. We will be using the best data we have, but I suspect it will be an issue of ongoing debate until the platform can finally tell us once and for all, definitively, what "complete" means.
39
Easy integration of data - particularly grades/outcomes - to campuswide LMSeducator, course adminreporting - exportingUBx
🧑🏾‍🎓〰️🦾 I'm not sure what this one means, if there is a non-OeX LMS in play the integration will depend on what it is and what data it expects. Definitely won't be a seamless thing out of the box, and we don't currently plan to do anything with grades, but using xAPI gets us a much better level of interoperability than we've ever had.
40
As a teacher, I want to see how many activities have been completed, out of the units that were released in the last period (e.g. week)educatorreporting - student activityAulasneo customers
〰️❌ I'm not sure what this one means specifically, but I think it's the same as line 19. We'll be able to show what problems have been completed in a given time frame. I don't expect we will be able to roll up to the level of "unit" until the "completions" xblock is on by default. Currently it's behind a waffle flag
41
As a teacher, I want to see how much activity is happening in the forums, out of the units that were released in the last period (e.g. week)educator/course adminreporting - student activityAulasneo customers❌ No, there isn't a plan to track forum activity in v1
42
Daily reports of student activity from the day prior.educatorreporting - student activityMIT
✅ Yes, student activity should be able to be tracked by various time slices
43
✅❓❌〰️🦾🧑🏾‍🎓
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100