GenAI Maker Session: Checking Progress and Evaluating Learning with AI

​

​

​

​

​

​

Lucas Wright

Session Objective

By the end of this session, you will be able to integrate Generative AI tools into formative assessment practices to enhance student engagement, provide actionable feedback, and support adaptive instruction.

​

​

​

​

​

The Plan for Today

• Opportunities and Issues using Generative AI for Ongoing Assessment
• Using GenAI to Design Ongoing Assessments
• Integrating Generative AI in Ongoing Assessment Activites
• Using AI as a Tool for Ongoing Assessment

​

​

​

​

​

Tools and Resources

ChatGPT

Claude

Co-pilot

​

Worksheet: https://bit.ly/3XHoOAo

Opportunities and Issues using Generative AI for Ongoing Assessment

​

• ​

nAI in Teaching and Learning

Formative Assessment

6

Formative assessment is an ongoing process used to monitor student learning and provide feedback that helps both instructors improve their teaching and students improve their understanding. It is generally low-stakes and aims to identify strengths, weaknesses, and areas for improvement.

​

3. GenAI in Teaching and Learning

Activity 1: Ongoing Assessment

7

The more productive way forward is for educators to focus on demystifying AI, emphasizing the learning process over the final product, honoring learner agency, orchestrating multiple sources of motivation, cultivating skills that AI cannot easily replicate, and fostering intelligence augmentation (IA) through building human-AI partnerships

​

Dede & Cao 2023

“

3. GenAI in Teaching and Learning

Activity 1: Ongoing/Formative Assessment

8

Using the whiteboard share ways that you are currently using Generative AI to support assessment in your teaching?

3. GenAI in Teaching and Learning

Formative assessment opportunities with AI

9

3. GenAI in Teaching and Learning

Limitations

10

Using GenAI to Design Ongoing Assessments (AI to Design)

​

3. GenAI in Teaching and Learning

Elements of Formative/Ongoing Assessment

12

1. Clear Learning Goals and Success Criteria
2. Effective Elicitation of Student Understanding
3. Detailed, Actionable Feedback
4. Student Reflection and Self-Regulation
5. Adaptive Instructional Responses

​

3. GenAI in Teaching and Learning

13

​

​

​

​

​

Clear Learning Goals and Criteria - Exemplars

Developing exemplars for assignments can help to model high-quality work, clarify expectations, and provide students with concrete examples of successful approaches to a task.

3. GenAI in Teaching and Learning

Elicit student understanding by developing CATs

14

​

​

​

​

​

3. GenAI in Teaching and Learning

Detailed, Actionable Feedback - Theming with AI

​

15

Prompt: Theme the following answers from a muddiest point activity that I facilitated as part of an introduction to Canadian political science class. Suggest what I should focus on for my next class

3. GenAI in Teaching and Learning

Activity 2: Developing CATs

16

1. Use the included prompt and generative two types of CATs for your classroom context Evaluate the CATs. Would these be applicable in your teaching?
2. Using the included synthetic data from a ‘muddiest point activity’ and theme the answers using the included prompt.

​

Integrating Generative AI in Formative Assessment Activites (AI to teach)

​

​

Integrating Generative AI in Ongoing Assessment

​

​

Activity: Think-Chat-Share

• Think: Students independently brainstorm and jot down their understanding of a key course topic, including key ideas, relationships, and potential questions they have.
• Chat: Students interact with ChatGPT by asking it to explain the topic, provide examples, or suggest connections. They critically evaluate AI’s response, identifying insights, gaps, or alternative perspectives.
• Share: In small groups or as a class, students discuss how AI’s response compared to their initial understanding. They refine their ideas based on the discussion, highlighting key takeaways and lingering questions.�

Integrating Generative AI in Ongoing Assessment

​

​

Concept Mapping with AI

• Think: Students independently create a preliminary concept map illustrating their understanding of a key course topic.
• AI Collaboration: Students prompt ChatGPT to generate its own concept map or connections related to the same topic, comparing structures and relationships.
• Reflect & Share: Students reflect on differences or gaps between their initial maps and AI-generated insights, updating their maps to integrate new understanding, then share in small groups or class discussion.

Integrating Generative AI in Ongoing Assessment

​

​

AI Peer Feedback Loop

​

• Draft: Students independently create a short piece of work (e.g., a thesis statement, lab report abstract, or problem solution).
• AI Feedback: Students prompt ChatGPT to act as a peer reviewer, providing specific feedback focused on content accuracy, argument strength, or writing style.
• Critical Revision & Share: Students critically evaluate the AI feedback, identify what’s useful or irrelevant, revise accordingly, and share reflections on the AI’s feedback quality in small groups or class discussions.

Integrating Generative AI in Ongoing

Sel

​

Activity 3: Try one of the Approaches

Select a concept from your discipline and try out the included prompts.

​

• Peer feedback

​

Consider how this type of activity would be helpful for ongoing assessment in your teaching and learning context.

Using AI as a Tool for Ongoing Assessment (AI tools for assessment)

​

​

Interactive Simulations

Educational Games

Self-paced quizzes and assessments

​

​

Bots for Tutoring and Coaching

Self-paced quizzes and assessments

​

​

Quizzing and Testing Knowledge

3. GenAI in Teaching and Learning

27

Generative AI Self Assessment and Reflection

Self-paced quizzes and assessments

​

​

Activity 4: Developing a Tool for Ongoing Assessments

1. Create a game or simulation using Claude that could be used as an ongoing assessment in your teaching
2. Check your knowledge for a subject using AI tutor pro.

Self-paced quizzes and assessments

​

​

Activity 5: Developing a Tool for Ongoing Assessments

Share one takeaway you have from this session