1 of 28

Hacking Canvas: Making the Rubric Tool Work for You

April Millet

The John A. Dutton e-Education Institute

http://bit.ly/hackingcanvas

2 of 28

A rubric is “a coherent set of criteria for students' work that includes descriptions of levels of performance quality on the criteria.”

Susan M. Brookhart, How to Create and Use Rubrics for Formative Assessment and Grading, 2013.

3 of 28

Types of Rubrics

Single-Point

Holistic

Analytic

Primary Trait

4 of 28

Rubrics in Canvas

Can add rubrics to assignments, quizzes, and discussions

Create a rubric once and copy and reuse in any course

Search for existing rubrics and edit and use in your course

Very quick and easy to set up

Very quick and easy to use in Speedgrader to grade

5 of 28

Creating a Rubric in Canvas

DEMO!

6 of 28

Single Point Rubrics

Description: focuses on proficiency

Advantages:

Contains far less verbiage than the analytic rubric
Takes less time to create than other rubrics
Areas of concern and excellence are open-ended
No need to predict how students might go wrong or excel

Disadvantages:

Requires more writing on the instructor’s part during use

7 of 28

Single-Point Rubric Design

Areas that need work	Criteria Standards for task	Evidence of exceeding standards



subtract points	100 points	add points

8 of 28

Sample

From: http://digitalcommons.unomaha.edu/cgi/viewcontent.cgi?article=1004&context=tedfacpub

9 of 28

Single-Point Rubric in Canvas

10 of 28

Analytic Rubrics

Description: breaks down tasks, score and feedback on each part, calculated final score

Advantages:

Give considerable feedback to students embarking on an assignment
Show clearly what portions of the product are most important (and which are not)

Disadvantages:

Developing a quality analytic rubric can be a lengthy process
Rarely perfect the first time used

Analytic Rubrics are the most common type of rubric and the type that Canvas is designed to create. There isn’t any hacking to do with this one. Analytic rubrics are used to rate a performance or product by the parts required to meet the project objectives. It breaks down the tasks, score and feedback on each part to calculate the final score. This type of rubric gives considerable feedback to students on the assignment. It clearly shows what portions of the rubric are the most important and which are not so students know what to focus on. Because this rubric used multiple criteria and descriptors, developing a quality rubric can be a lengthy process. When developing one of these rubric, you will need to predict how students may fair and excel as the assignment and distinguish between them. This is rarely a done perfectly the first time so you may end up making revisions.

11 of 28

Analytic Rubric Design

	Above (3)	Meets (2)	Below (1)	Score
Criteria 1	Descriptor for criteria 1 for students above standard	Descriptor for criteria 1 for students meeting standard	Descriptor for criteria 1 for students not meeting standard
Criteria 2
Criteria 3
				Total

12 of 28

Sample

13 of 28

Analytic Rubric in Canvas

14 of 28

Primary Trait Rubrics

Description: breaks down tasks, levels of performance build from bottom up score is based on lowest level achieved

Advantages:

Can re-use common primary traits across assignments

Disadvantages:

Require careful reflection on all levels of a product/performance
No ability to weigh on individual traits when they are combined--score is based on lowest level

15 of 28

Primary Trait Rubric Design

Score	Detailed Description
4 points	Criteria in addition to item(s) below
3 point	Criteria in addition to item(s) below
2 points	Criteria in addition to item(s) below
1 points	Criteria in addition to item(s) below
0 points	Detailed description

16 of 28

Sample

This level of quality includes all categories below and is distinguishable according to the regular, timely, and high-quality nature of the participation. For example, this level of contribution not only responds to preceding postings, but it reflects insight and depth of understanding of course materials and/or stimulates additional relevant discussion.	4 points
This level of quality includes all categories below and includes periodic and timely contributions to class message boards, clear involvement in team exercises, and active, quality responses and questions pertaining to online activities.	3 points
The student regularly logs in to the course system, responds to direct requests for input (for example, e-mail), and contributes to team exercises.	2 points
The student irregularly logs on to the course system, fails to reliably respond to requests for input, and does not clearly contribute to team exercises.	1 point

Discussion Rubric

Students are expected to participate in in online activities and discussions. Because of the importance of discussion to meeting the objectives of the course, students will be evaluated on the frequency and quality of their participation, including the level of preparation for discussion and student analysis and integration of the assigned materials. Students are expected to communicate their ideas clearly and persuasively. This rubric provides the levels of quality expected in this course.

17 of 28

Primary Trait Rubric in Canvas

18 of 28

Holistic Rubrics

Description: provides a broad overview of student performance, and assesses tasks as a whole

Advantages:

Allow evaluation of a large number of projects quickly
Make transparent the elements needed for quality in items generally considered ineffable

Disadvantages:

Require a “norming” process
Require samples at each level of quality
Do not allow for variation in performance

19 of 28

Holistic Rubric Design

Score	General Area	General Area	General Area	General Area
0 points	Detailed Description	Detailed Description	Detailed Description	Detailed Description
1 point	Detailed Description	Detailed Description	Detailed Description	Detailed Description
2 points	Detailed Description	Detailed Description	Detailed Description	Detailed Description
3 points	Detailed Description	Detailed Description	Detailed Description	Detailed Description
4 points	Detailed Description	Detailed Description	Detailed Description	Detailed Description

20 of 28

Sample

21 of 28

Holistic Rubric in Canvas

22 of 28

Using Rubrics in Canvas

SpeedGrader!

23 of 28

Developing Rubrics

Identify objectives that the assessment will cover

Develop outcomes that students will master

Set criteria for students to achieve

Select scale and levels of achievement

Write descriptions for levels

Revise

24 of 28

Guidelines

Make sure the assignment is clearly defined and aligns with the learning objectives for the lesson or project
Brainstorm what your expectations are for the assignment
Refine the list of expectations and organize into criteria
Write detailed mastery standards for each criteria
Review the standards for fairness and practicality
Continue to develop the type of assessment you prefer based on the type of rubric used

25 of 28

Best Practices

Plan rubric in another document and use it to copy and paste into Canvas

Give yourself the “10%” rule the first time you use a rubric

Have students contribute to rubric generation

Use clear language in constructing a rubric

Give the rubric to the students when the assignment is made, not at the end

26 of 28

Penn State Resources

Dutton Faculty Development - http://facdev.e-education.psu.edu/plan/rubrics

Schreyer Institute- http://www.schreyerinstitute.psu.edu/tools/?q=rubric

References:

http://www.cultofpedagogy.com/holistic-analytic-single-point-rubrics/

http://www.carla.umn.edu/assessment/vac/improvement/p_5.html

27 of 28

Questions?

http://bit.ly/hackingrubrics

28 of 28

Thank you!