BCDYZ
1
2
Purpose and Work Streams 2019-20
3
Research & Program Evaluation Office
4
5
Purpose
6
PurposeRole
7
The Research & Program Evaluation Office provides high-quality analysis and reporting designed to support continuous improvement at all levels and strategic planning around district priorities.Department Manager
8
Oriana Eversole
9
10
Data Point Person
11
Brianne Monahan
12
13
14
Major Work Streams
15
TitleDescriptionLead
16
Central Office Measures of Performance RPEO staff releases COMP tools; COMP department leads work with their staff to develop content with RPEO support as needed; RPEO staff review COMPs and work with district leadership to finalize; RPEO staff map priority projects to Strategic Framework next steps; RPEO staff post final COMPs to website; Executive Director and Chief of Staff conduct mid-year and end-of-year COMP reviews with department leadsAndrew Statz
17
Identification and Reporting of District-level Accountability Metrics (Strategic Framework, State, and Federal)RPEO Director works with RPEO staff to identify new metrics for district reporting, as needed; RPEO Director confirms the state and federal reporting needs for schools and the district and serves as an accountability partner through DPI (along with Director of Assessment); RPEO Director works with the Executive Director to share new metrics identified and updates to current metrics (including those for the strategic framework and the district's annual reporting); metrics and reports are shared as drafts, reviewed by central office or senior leadership, revised as needed, and submitted to principals and Board of Education as appropriate; published to appropriate website as needed Oriana Eversole
18
External Research Committee ReviewResearchers submit proposals online; initial review by RPEO staff and assignment of liaison; committee reviews request; Assistant Superintendents and relevant department leadership review ERC recommendation; notification to researchers of approval/denial/table/needed modifications; background/criminal record checks conducted by HR; final approval granted to researcher by RPEO staff; researcher begins work with the school or districtChris Harrison
19
School-based SupportsRPEO Director works with RPEO team and district staff to identify current needs for updating and improving school data use (qualitative and quantitative) and evaluation needs (including data use for continuous improvement); RPEO Director and Researcher identify tools and systems that need to updated/improved (e.g., SIP, data use guides and resources, components of SBLT Toolkit) and work with identified district staff to make updates; RPEO Director and Researcher work with central office staff to identify ways to communicate updates, train and support school leaders, and support implementation of updated/improved tools and systemsChris Harrison
20
Toolkit and District Resource MaintenanceFor new toolkits/resources: RPEO staff receive request for new toolkit content; RPEO staff support content area experts in developing outline for toolkit; content area experts produce content for toolkit; RPEO supports organization and online presence of content
For existing toolkits/resources: RPEO staff review content annually, including requests for new content; RPEO staff update toolkit content; RPEO staff coordinate communication of changes as needed
Chris Harrison
21
Research Projects and Partnerships (large-scale)Includes major MEP projects (not including data requests), major MMSD research partnerships (e.g., MSAN), large-scale MMSD research projects (e.g., Building Excellence, community input), and literature reviews (e.g., research on evidence-based practices): RPEO Director identifies primary research projects and needs; RPEO Director works with the researcher to identify a plan to address these research needs; the Researcher carries out the research and communicates progress with RPEO Director; the Researcher develops reports; RPEO Director and additional stakeholders provide feedback on reports; reports revised; reports published or sharedOriana Eversole
22
EvaluationRPEO staff develop evaluation cycle for district's major plans and other identified projects (e.g., scaling up of ROCKiT Innovation projects); RPEO staff meet with plan staff and/or district leadership to determine scope and research questions in accordance with evaluation cycle; RPEO staff develop evaluation plans in collaboration with plan leaders; RPEO staff conduct analysis and prepare evaluation reports (internally evaluated plans); RPEO staff present report to plan staff and/or district leadership; RPEO staff support RFP and data provision process (externally evaluated plans); RPEO staff produce data and support narrative for annual monitoring updates for major plansOriana Eversole
23
Support grant applications/reviews and partnershipsExecutive Director or Director receive request for grant development or monitoring support; RPEO staff attend meetings with involved parties; RPEO staff determine data rights and access; RPEO staff recommend monitoring and/or data collection plans for grant and/or partnership; RPEO staff provide data and analysis support as neededOriana Eversole
24
Internal and external data requests (ad hoc)General ad hoc data requests: Executive Director, Director, Analytics Supervisor, or RPEO staff reviews or receives data request; Analytics Supervisor assigns request to RPEO staff (creation of datasets or generation of data); staff pulls data; Analytics Supervisor and Director/Executive Director review request (depending on audience--such as BOE or publicly posted data); staff provides requester with data; RPEO staff updates analytics/request tracker.
Support Student Information System data requests: RPEO staff receive requests for ad hoc data requests, support, or refinement; RPEO staff prioritize and fulfill requests
Brianne Monahan
25
Standard Data Reports (Scheduled, primarily for BOE)Review cycle reports and monitoring reports for BOE (not including evaluations and grant applications/reporting): Executive Director, Director, or Analytics Supervisor receives report request; Analytics Supervisor assigns report to RPEO staff; assigned staff draft report; Analytics Supervisor, Director, and Executive Director review draft report and report is revised; draft report reviewed by central office or senior leadership; report revised; report submitted to principals and Board of Education as appropriate; report published to RPEO website. Brianne Monahan
26
Survey development, deployment, and summarizationDirector or RPEO staff receive request for survey; RPEO staff review the request in the context of strategic framework, COMPs and previous surveys; RPEO staff develops survey plan; RPEO staff share survey plan with requester; RPEO staff work with department heads, staff, and principals to plan data collection; RPEO staff coordinate deployment of the survey; RPEO staff summarize results and deliver report to staff and/or district leadership.Jill Brown
27
MMSD Data Dashboard enhancementsDashboard updates and maintenance: Dashboard Supervisor identifies need or receives request, supervisor and dashboard staff review request with input from other staff as needed to prioritize enhancement, supervisor assigns enhancement to RPEO staff, staff complete enhancement, supervisor or RPEO staff notifies requester and other users, RPEO staff coordinate introduction of new content with relevant staff.
Dashboard 2.0: Dashboard Supervisor and RPEO Director develop project plan for Dashboard 2.0 development and rollout; development and rollout are implemented on an ongoing basis; program staff review dashboards and updates are made as needed; communication plans and training supports are identified, developed, and implemented at multiple levels of MMSD
Travis Grover
28
Madison Education PartnershipMEP co-director provides partnership leadership and meets weekly with MEP co-directors to plan activities and conduct research; Executive Director and Director attend Steering Committee and project-based design meetings; Analysts provide research support for MEP projects as neededBeth Vaade
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100