Revised: November 12, 2019

Agenda

• Philosophy: what moves the needle in student success?
• Annotate PRO (AP) overview (assumes site license)
• Creating feedback in:
• Google Docs, Canvas LMS, Microsoft Word, Schoology, Blackboard, Gmail (!)...
• Creating & Editing AP Libraries
• Status: Available → Active → Selected
• ‘Deleting’ Content
• Sharing AP Libraries
• Exec Editor & Admin Accounts
• Analytics
• Appendices:
• How to install?
• What else does 11trees make?
• Canvas LMS integrations
• Roadmap for 11trees’ solutions
• 11trees tech stack

What moves the needle in student success?

• Feedback
• “...the most powerful single moderator that enhances achievement.”
• Professor John Hattie, University of Melbourne
• Relationships
• Encourage and enable student-teacher interactions
• Growth Mindset
• Resilience, grit
• Productivity
• Minimize friction and wasted effort so students and teachers can focus on the above
• Simplicity
• Extend and improve the solutions teachers and students already know and love: �Microsoft Word, Google Docs, Canvas, Blackboard, Schoology...

Annotate PRO Overview

Annotate PRO (AP) is a Chrome Extension and Microsoft Word Add-in that makes it easy to create, share, and use libraries of reusable comments to speed feedback and engagement. AP focuses on Canvas, Google Docs, Word 2016/2019, Blackboard, Schoology...

AP compliments these solutions - it leverages their commenting and feedback tools.

AP has some special powers in Google Docs and Microsoft Word.

AP has superpowers in Canvas LMS (SpeedGrader).

AP in Chrome and Word - the basics:

In Chrome: AP pops out from the toolbar.

In Word: AP is a taskpane available from the Ribbon.

AP in Google Docs, Canvas, Bb, Schoology...

Optional toolbars you can add to the right, top, or both.

​

Change toolbar preferences from the A icon always visible in your Chrome toolbar.

Basic usage...

• Create multiple libraries and run them at the same time. Example:
• Library 1: “Writing Mechanics”
• Library 2: “Information Literacy”
• Library 3: “Fall Term 2020 Assignments”
• Library 4: “Rubric Feedback”
• Comment in Google Docs, Word, Canvas SpeedGrader:
• Highlight as you always would, then use AP to find a comment and insert it. BOOM! You get a comment AND the selected text. Now you can personalize.
• Adding text to LMS discussions, document bodies, Gmail:
• Click to place your cursor where you want the text to go, then use AP to find a comment and insert it. BOOM! Your text appears as if you’d typed it.

Example using Search in Google Docs:

Core features across Chrome and Word

Multiple Libraries (in green)

Full-text search

Groups

Sub-groups

Previews of comment text

Advanced features

• Feed of comments

• Create reusable Comments from previous ‘freeform’ feedback
• Google Docs, Word, Canvas SpeedGrader

• Student History (Canvas SpeedGrader)

• Usage Analytics
• Individual
• Aggregate data for shared Libraries

Creating feedback: �Google Docs

Canvas SpeedGrader

(see appendix for basic installation instructions)

Commenting on Google Docs

Highlight text

Hover/click a blue Favorite...

Explore a green Library...

Use Search...

Click your choice...and BOOM! Comment inserted...ready for editing.

Google Docs - Special Features

One-Click commenting…

1. Click A in your Chrome toolbar
2. Click the gear icon
3. Click Account & Store�(new web page opens...logs you in…)
4. Scroll down to Google Docs Options
5. Toggle Edit to One-Click
6. Flip back to your Google Doc...comments now apply and are finalized

Comment Histories

1. Click A in your Chrome toolbar
2. Toggle History ON / History OFF

With History ON, in Google Docs, will record even your freeform comments AND edits you make to comments inserted with AP.��Benefit? You can review your Feed and promote one-off comments to become reusable Comments by adding them to an existing Library.

AP Pop up

Always Available: Pop up

• ALT-A to open AP from any webpage
• Dropped into Search...start typing to find a Comment...arrow down to select...hit Enter...and Boom!
• Or click a blue Favorite button
• Or: click the A in the Chrome toolbar

Click to flip available Libraries on/off

Toggle History ON/OFF for saving ALL feedback

Choose Toolbar position and status

• Or: right-click to access the AP context menu!

AP Toolbars: Google Docs

• Use Top, Right, or Both

Top Toolbar

Right Toolbar

Click ‘X’ to collapse

Creating and Editing Libraries

Editing/Creating Libraries:

• Editing/creating permissions are set by your AP license agreement and your local AP admin.
• Not every user can edit/create AP content.
• Shared Libraries can prohibit users from personalizing the content.

Three ways to create and edit:

• Chrome:
1. Click A
2. Click Edit Libraries
3. AP opens a new browser window

• Word:
• Click Edit in the AP Taskpane
• Click Edit Libraries
• AP opens a new browser window

• Web:
• Visit https://www.11trees.com/annotate/library/annotateLibrary.html directly
• Log in with your credentials
• Click Edit/Libraries or New/New Library

What is a ‘Library’?

• A Library is a collection of Comment Groups
• Comment Groups can contain Comments and/or Sub-Groups
• Sub-Groups are a paid feature.
• A Comment has a Label and Text
• Only the Comment Text is inserted into Google Docs, Canvas etc.�
• Example:
• Library: “UG Writing Feedback”
• Group: “Documentation & Formatting”
• Sub-Group: “MLA Formatting”
• Comment Label: “MLA: Citation Formatting”
• Comment Text: �“Incorrectly formatted citation. When using MLA, the correct format is (Author Page#). Example: (Hemingway 45). There is no comma between the author and the page number. For websites, use a short version of the website name if no author is identified. See https://11trees.com/guide/mla-in-text-citations/.”

Tips for Creating AP Content

• Sketch first - on paper, in a Gsheet or Excel spreadsheet or document
• Outline, play with your categories.
• When creating Groups, Sub-Groups and Comment Labels think like a teacher
• Use the hierarchy to aid discovery, especially if you’re sharing Libraries
• When writing Comment Text think like a student�
• Tips
• Use the hierarchy to differentiate feedback by skill level. For instance, have a Library of feedback called “Developing Learners” and have all the content inside specific to that skill level. That way, when you are providing feedback to student developing skills you can drop other Libraries and just use the one most appropriate.
• When creating large Libraries, consider using Groups or Sub-Groups in the same way - to differentiate skill level.
• Think of 300 Comments total as the upper level for a single Library. Of course you can combine Libraries quickly and easily when using AP to provide feedback. So split your content out over a few Libraries.

Create a New Library, Group, or Comment

• Many paths!

​

​

• Sub-Groups are just Groups with a Parent

Create your own Library

Control sharing. Active - Private means only you can see this Library.

IF you shared the Library, controls whether others can personalize or “extend” the Library. Their changes will not affect your original.

Click on a Group name to see its Comments appear on the right side of the page.

Anatomy of a Comment

Toggle to Select for moving a Comment.

Promote a Comment to be a blue Favorite - one click away!

Click to add new blank Comments.

Comment Text - this will appear when you use this Comment. The [[brackets]] create a Form experience and will prompt you to enter some text.

Toggle to Inactive to hide this Comment when searching AP to add a Comment.

Sort Comments within a Group or Sub-Group

Click Sort to start.

Drag and drop Labels to reorder. Then click Update Order in the top-right of the popup window.

Edit and Sort Groups in a Library

Drag and drop Groups to move them.

​

Click the edit icon (in a Group row) to edit the Group name and edit/order any sub-Groups.

Edit a Shared Library (if “Extensible):

This user cannot edit the underlying Comment - only customize it for their own use.

This Library makes use of Groups and Sub-Groups to organize content for discoverability.

Changes to Comment Labels and Text are saved automatically.

Toggle the Comment between Default or Custom content.

What makes for a good Comment?

• Descriptive, specific Labels (the Label is most useful for searching).
• YOU are the audience for Labels
• Write Comment Text for your intended audience/reader:
• Grad student, 8th grade struggling writer etc.
• Include URLs in the Comment Text to provide additional help:�“Acknowledging an opposing argument (i.e. a 'counterargument'), and then showing why that counter argument is invalid is an excellent strategy when arguing a point. Using a counter argument will help position you as a more sophisticated and accomplished writer. See the following for more help: https://11trees.com/guide/strengthen-your-argument-by-including-a-counterargument/.”�
• Tips:
• Put a “+” in front of a Label to indicate it is a positive/encouraging Comment:
• “+Original!”
• Then you can search for “+” to see only positive/encouraging Comments!
• Use double brackets to create simple Forms - placeholder text - in Comment Text:
• “Dear [[student name here]],”

Deleting Content

• AP uses a paradigm that content is not deleted, just made inactive.
• You can make a Group or Comment inactive, then repurpose it later, then flip to be Active.
• This way we avoid inadvertent deletes!�
• If you really want a piece of content deleted just contact us.

This Group is inactive. It will not appear when using this Library to provide feedback.

This Comment, unlike the first one, is Active. It will appear when using this Library to provide feedback.

Sharing Libraries

- Institution and Institution+ Accounts only -

AP Roles

• Instructor
• Default role. Use AP to create feedback. Review the Feed and Analytics based on their own work.
• Creating and Editing content can be restricted by client Admin.
• Ability to share Libraries, informally, can be restricted by client Admin.
• Executive Editor
• Instructor capabilities PLUS:
• Can share Libraries formally - which means Libraries automatically appear on instructor active Library lists.
• Can review all data created with Libraries they have shared.
• Admin
• Executive Editor capabilities PLUS:
• Can review ALL content created by ANY user: Libraries, Groups, Comments.
• Can review ALL data created by ANY user at that specific AP client.
• Can access summary and detailed usage data.
• Can create new users manually and adjust permissions for users (for instance, converting an Instructor into an Executive Editor).

​

Sharing Libraries:

Active - Shared (informal)

• A Library shared ‘informally’ can be discovered by users through Account & Store menu choice.
• Users can add a shared Library to their account, potentially personalize it, but never edit the original.

Active - Shared (formal)

• A Library shared ‘formally’ will automatically appear on ALL user’s active Library lists - great for providing content automatically.
• Only AP Exec Editor and Admin roles can share formally.

• Sharing permissions are set by your AP license agreement and your local AP admin.
• Not every user can share. Screenshot below shows a user who cannot share.

Exec Editor Sharing Example

• The above Library is set to Active - Shared (formal), which means this Library will appear for ALL users at this institution.
• The library is set to Extensible, which means others can personalize the content but never edit the original version.
• Note: Insert Name is a feature specific to Microsoft Word and defines the name that will appear on Comments created with the Library. This feature is useful for writing centers or tutoring organizations, where communications may want to appear as coming from “State University Writing Center,” not the current Microsoft Word user.

Teacher Experience - Shared Library

• IF a shared Library is made ‘Extensible’ by its author, other teachers can personalize the content.
• In the example at left, the teacher shared into the Library can see the original (Default) Label and Comment...and can customize both to suit.
• If a teacher customizes content the Default toggle will flip to Custom.
• Teachers can make a shared Comment Inactive and change Favorite status.
• No changes made by a non-author affect the original content.
• Changes made to the Library by its author will flow to all shared into the Library...but teachers’ Default/Custom settings will define what exact content appears for them.

Exec Editor & Admin Accounts

- Institution and Institution+ Accounts only -

Exec Editor and Admin Roles

Executive Editor

• Instructor capabilities PLUS:
• Can share Libraries formally - which means Libraries automatically appear on instructor active Library lists.
• Can review all data created with Libraries they have shared.

​

Admin

• Executive Editor capabilities PLUS:
• Can review ALL content created by ANY user: Libraries, Groups, Comments.
• Can review ALL data created by ANY user at that specific AP client.
• Can access summary and detailed usage data.
• Can create new users manually and adjust permissions for users (for instance, converting an Instructor into an Executive Editor).

​

​

Exec Editor: Sharing

• In the example below this Exec Editor can share Informally or Formally
• Informal sharing: the Library will be available for discovery by other users
• Formal sharing: the Library will automatically appear in every user’s list of Active Libraries
• The Library will default to the Selected status set by the Exec Editor
• Users can remove Formally shared Libraries from their Active Library list�
• Best practice: create Exec Editor accounts to be used only for sharing AP content. Use a non-person email alias like “AP-Editor@yourschool.edu”. We can create “yourschool-editor@11trees.com” to facilitate this approach.

Exec Editor: Data

• In the example below this Exec Editor can visit Feed & Analytics in the main menu to:
• View all data they have created - just like any Instructor
• Filter by Instructor - viewing all data created with the Libraries they have created and shared

Admin

• View ALL Libraries created by users.
• New menu choice: Admin.

​

• Add users manually and adjust permissions (promote to Exec Editor etc).
• Review aggregate usage.
• Review detailed usage by user and recipient (Canvas SpeedGrader only).

​

Analytics

- Institution and Institution+ Accounts only -

Individual Instructor

Filter by date, freeform/categorized.

Canvas SpeedGrader users can filter by Course, Assignment, and Student!

Date by Category on the left, specific Comment on the right. Click to drill down.

Pop a tabular view - so you can export for further analysis.

‘Feed’ of Comments created…

Add 100% custom Comments (Google Docs and SpeedGrader) to a reusable Library with a couple of clicks.

Exec Editor or Admin

Same experience BUT:

• Admins can filter by instructors
• Exec Editors can see data created with the Libraries they have shared

Thank you!

Appendices

Installing AP

Google Chrome Extension

• Chrome installation instructions�
• Google “Annotate PRO Chrome”
• Click Install
• Click and then Sign up
• Use your school email address and create a password
• 8 characters with 1 Capital and one number
• Wait for a validation email to arrive
• Click the link in the email to validate
• Click

Microsoft Word Add-in

• Word installation instructions.�
• Make sure your Word install is updated - this is really important!
• Visit the Insert tab in Word.
• Click Add-ins and then Get Add-ins or the Office Store.
• Search for “Annotate PRO”.
• Install.
• Look for the Annotate tab in Word. Click Home.
• Use your school email address and create a password:
• 8 characters with 1 Capital and one number
• Wait for a validation email to arrive.
• Click the link in the email to validate.
• Click Validated or Insert Comments in�the Annotate PRO taskpane

Sign up issues...

• Didn’t receive a validation email?
• Check spam / quarantine folders
• Check with IT - maybe they need to whitelist “11trees.com” as a valid sender
• Don’t see the content (Libraries) you expect?
• Visit your Account page (click the gear icon, then Account) to make sure you’ve connected to your school AP environment, not an individual user setup

11trees Solutions

Annotate PRO (AP): feedback is a teacher’s superpower

• Shareable cloud libraries of expert feedback to speed interactions in Word, Canvas, Google Docs…
• 230+ comments College Edition feedback library
• Analytics on feedback created; histories of feedback per student in Canvas

Q for Success: success begins with good questions

• Single UX for student access to key academic resources: reduce friction and increase engagement: LMS, library research, library chat, tutoring, writing center
• Rich analytics on student behavior and engagement
• Growth mindset encouragement and wizards to help students get work done

Canopy: see the forest for the trees

• Analytics and efficient discussion topic management for teachers and institutions
• Eliminate thousands of clicks and gain a strategic view of student interactions

Canvas Integrations

• Annotate PRO
• ‘Integrates’ through powerful Chrome Extension; no technical integration required.�
• Q for Success & Canopy
• Require Developer Key
• Use Canvas for authentication & to obtain token to make API calls

Future State / Potential

Annotate PRO

• Active feedback
• Student reflection, action, sentiment on feedback provided
• Integrate with SRM systems to capture instructor-student dialog
• Connect advising and teaching to focus on student’s story
• NLP/ML on resulting data
• Sentiment analysis of instructor-student dialog
• Structure peer review via forms and analytics

Q for Success

• Notifications of new discussion responses
• Assignment due date reminders
• Content editing front end
• Personalized recommendations and content
• Shared success stories: story as intervention
• Social learning around research and assignments
• Self-graphing to break down assignments and encourage action and small steps
• Multiple wizards to demystify academic writing tasks: paraphrasing, conclusions, transitions etc.

Canopy

• Visualizations
• Sentiment / bias analysis
• Keyword analysis
• Chrome Extension:
• automate discussion topic analysis
• CRM-like capabilities to focus on student relationship

11trees Tech

• Canvas partner; Microsoft partner
• Solutions hosted by Siteground in US-based dedicated virtual server
• SOC2 report available on request
• Student Privacy Pledge signatory
• Stack: web apps, Chrome extensions, Microsoft add-ins
• Google Firebase for authentication
• Javascript & jQuery with Bootstrap 3 frontend
• PHP backend; MySQL databases
• Store as little PI data as possible!