Assessment and feedback in training and teaching
ELIXIR-GOBLET Train the Trainer - Session 4
Teaching Goal
Session 4
Learning outcomes
Session 4
Curriculum Design
- Nicholl’s cycle -
Inspired by: Via A, Palagi PM, Lindvall JM et al. Course design: Considerations for trainers – a Professional Guide. F1000Research 2020, 9:1377 doi: 10.7490/f1000research.1118395.1
Aligned with LEs?
Support progress towards LOs?
Supports LEs?
Promotes LOs?
LOs achievable by most learners?�Content, LEs & Assessments support LOs?
SMART
LEs aligned with LOs?
LOs
LEs
Content
Assessment*
Evaluation*
1
2
3
4
5
Legend
Confirmed
Denied
Proposition to move forward
Phase
Success
Key concepts:
ASSESSMENT
FEEDBACK
What is assessment?
Assessment is estimation of:
recolored image by @vectorjuice at Freepik
Assessment is bidirectional
It can be used both by instructors and learners
Assessment is estimation of:
recolored image by @vectorjuice at Freepik
There are different types of assessment and different ways that we can categorize them
When?
ASSESSMENT
BEFORE
DURING
AFTER
Pre-course
At the beginning of the course
related to the time of the course
What?
When?
ASSESSMENT
BEFORE
DURING
AFTER
Pre-course
At the beginning of the course
related to the time of the course
Discuss…
What?
When?
ASSESSMENT
BEFORE
DURING
AFTER
Pre-course
At the beginning of the course
related to the time of the course
Assess prerequisites of target audience
Assess if learning has occurred
Assess prior knowledge�mental model(s)
Assess whether learning is occurring
What?
Type
When?
ASSESSMENT
BEFORE
DURING
AFTER
Pre-course
At the beginning of the course
related to the time of the course
Assess prerequisites of target audience
Assess if learning has occurred
Assess prior knowledge�mental model(s)
Assess whether learning is occurring
Formative assessment
Summative assessment
Formative assessment
Summative assessment
Assess prerequisites of target audience
Assess if learning has occurred
Assess prior knowledge
mental model(s)
Assess whether learning is occurring
ASSESSMENT
BEFORE
DURING
AFTER
Pre-course
At the beginning of the course
related to the time of the course
Diagnosis assessment
What is Feedback?
Feedback
is information meant for improvement, such as:
_Feedback is bi-directional_
One categorization: related to the time of the course
Long time after
Measure impact of the course
At the end
Measure the quality & �adequacy of the course & trainer
Short term feedback
Long term feedback
TRAINER
LEARNER
ASSESSMENT
During course
After course
Feedback
Challenge 4.1
Diagnostic Assessment
Group Activity (in pairs) �⏰ 8 min
Write it in the Shared notes
What is the difference?
vs.
ASSESSMENT
FEEDBACK
How and what to assess
Assessment process flowchart
ASSESSMENT
WHAT
HOW
PRODUCT
PROCESS
SUMMATIVE
FORMATIVE
What to assess
PRODUCT
ASSESSMENT
PROCESS
ASSESSMENT
Model |
Gymnastics routine |
Project |
Assignment |
Exercise |
Painting |
Attitudes |
Social-relational skills |
Problem-solving ability |
Creativity |
Method use |
Progress |
Instructor’s didactic process |
Why to do each assessment
| FORMATIVE | SUMMATIVE |
TIMING | Throughout the�learning process | At the end of an�instructional period |
PURPOSE | Gauge student learning and provide instant feedback | Evaluate overall achievement (LOs achievement) |
vs.
What is the difference?
FORMATIVE
SUMMATIVE
Comparing Formative & Summative
Formative ��During teaching & learning. �
Does not:
Summative ��At the end of teaching and learning.�
Summative assessment �Methods
Summative assessment �Methods
_For training, the focus is _�_formative assessment _
Formative assessment�Collect information on their learning progress
Image from: Ken Whytock, Flickr
Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement (Hattie, 2008)
Reversal
Developmental
Average teacher effects
Zone of enhanced
achievement
1.2
-0.2
-0
0.2
0.4
Treatment: Feedback
d=0.73
Break
10 min
Challenge 4.2�Formative Assessment
�
Group Activity �⏰ 5 min
Now, discuss how you could collect information on learners’�
�Write it in the Shared notes
Challenge 4.3
Multiple Choice Questions and mental model
⏰ 3-5 min - individual
Choose each wrong answer and write down on the shares doc which misconception is associated with that wrong answer.
Q: what is 27 + 15 ?
https://carpentries.github.io/instructor-training/02-practice-learning/index.html
Multiple Choice Questions and mental model
The correct answer is 42,
but each of the other answers provides valuable insight.
Q: what is 27 + 15 ?
Formative assessment & feedback can be done in many ways
Tools for Assessment
Google Forms
Mentimeter
Socrative
in-class Assessment approach
Sticky notes
Zoom Reactions
Shared notes
GDocs
Etherpad
Asking questions & discussions
Group activities
_Asking questions & discussions_
_Self assessment_
_Peer evaluation_
Challenge 4.4
How to integrate the result of formative assessment / feedback in your course (5 min)
�Think about this course:
Challenge 4.5
How frequent should formative assessment be? (2 min)
Take some notes for the short review afterwards.�
| FORMATIVE | SUMMATIVE |
PURPOSE | Gauge student learning and provide feedback | Evaluate overall achievement |
TIMING | Throughout the learning process | At the end of an instructional period (unit, semester, year, etc) |
FREQUENCY | Frequent and ongoing (daily, weekly, etc) | Infrequent, usually a few times a year |
EXAMPLES |
|
|
Feedback mechanisms�Teacher ⇄ Students
Triangle - feedback about teacher’s efforts
Model developed by Alexia Cardona (2021)
Learn and teach others how to give good feedback
Giving good feedback
Feedback types
FEEDFORWARD
FEEDBACK
FEEDUP
CURRENT LEVEL
TARGET LEVEL
Strategy to reach the target level
Gap between current performance and target level
What and how? | Effective feedback | Conditions |
Feedback type:
Feedback levels:
| Frequent | Clear goals |
Immediate | Measurable goals | |
Specific | Achievable and challenging goals | |
Detailed | Quality instructions |
What does not work:
Personal level feedback.
Example: you are really smart
What does work:
Feedback is hard
Dealing with (bad) feedback �(received from trainees)
Humans focus more on negative feedback than on positive
you are not alone!
Dealing with (bad) feedback �(received from trainees)
Good trainer & Effective training
(Complementing session 3)
Good practices
Other ways of course assessment:
Combining the 4 sessions
Curriculum Design
- Nicholl’s cycle -
Legend
Inspired by: Via A, Palagi PM, Lindvall JM et al. Course design: Considerations for trainers – a Professional Guide. F1000Research 2020, 9:1377 doi: 10.7490/f1000research.1118395.1
Aligned with LEs?
Support progress towards LOs?
Supports LEs?
Promotes LOs?
LOs achievable by most learners?�Content, LEs & Assessments support LOs?
SMART
LEs aligned with LOs?
LOs
LEs
Content
Assessment
Evaluation
Confirmed
Denied
Proposition to move forward
Phase
Success
8 Learning Principles
8 Learning Principles
Goal-directed practice �+ �Targeted feedback
Become self-directed
6 Learning Strategies
Spaced practice | | Spreads activities out over time |
Interleaving | | Switching between topics while teaching |
Elaboration | | Asking & explaining why and how … |
Concrete examples | | Illustrate abstract concepts with specific examples |
Dual coding | | Combining words with visuals |
Retrieval practice | | Activating memory bringing learned information back |
7 Evidence Based Learning Principles
Resources to learn more about how learning works
Learning is impacted by course climate
New
Challenge 4.6
Example
Principle 7: �To become self-directed learners, students must learn to assess the demands of the task, evaluate their own knowledge and skills, plan their approach, monitor their progress, and adjust their strategies as needed.
Challenge 4.6
How do you see the 8 Principles of Learning now? (15 min)
Work in 3 groups of 3-4�
Carefully read the principles as a group
Each group will work on 2-3 principles (see Shared Google doc)
Discuss
Challenge 4.6
Example
Principle 2:�How students organise knowledge influences how they learn and apply what they know.
Conclusion
Thank you
elixir-europe.org
@elixir-europe.org
/company/elixir-europe
Follow us on social media