1 of 49

METACOGNITION MATTERS FOR LEARNING

Jenni QuilterExecutive Director, Expository Writing Program, and Assistant Vice Dean for General Education�Arts & Science

Katie Schneider PaolantonioClinical Professor, Biology

Arts & Science

Duncan Smith Associate Professor, Biology�Arts & Science

March 19, 2025

Participation in TeachTalks assumes a commitment to respectful exchange and to keeping the focus on teaching and learning.

NYU attendees automatically enter a BOOK RAFFLE. Winners to be announced after each session.

2 of 49

PRESENTERS

Duncan Smith �Associate Professor of Biology�duncan.smith@nyu.edu

Jenni QuilterExecutive Director, Expository Writing Program;�Assistant Vice Dean for General Education, A&S

Katie Schneider Paolantonio�Clinical Professor of Biology�ks146@nyu.edu

2

3 of 49

Our students are not equally prepared

  • Significant variation in previous exposure to introductory course material

  • Equally (or more) significant variation in effectiveness of learning strategies

  • Our introductory classes are explicitly designed to

take the former into account

3

4 of 49

Many students develop learning strategies too late

  • Poor performance on the first midterm exam can be a formative experience if appropriately managed.

  • Attempting to turn things around a week before the final exam is more common but substantially less productive.

  • Students blame instructors: instructors blame students.

4

5 of 49

Coordinated interventions are needed

  • Explicitly incorporate strategies that promote metacognition into large, first-year-heavy courses. Faculty will need support with this

  • Promote metacognition via ULC programming directly tied to the above courses, using shared language and overlapping examples

  • Cohort-based interventions, timed for maximum effectiveness

5

6 of 49

Redesigned CAS College Cohort

Authoring Your NYU Story is a redesigned semester-long college-cohort course for all CAS first years. It was first rolled out in fall 2024 and developed by Student Affairs and the Changemaker Center in partnership with CAS:

Combining self-reflection, group discussion, and exploration of professional development and interpersonal theory, this course helps students cultivate a sense of purpose and direction. By weaving together the lived experiences that have brought students to this point, the course helps shape how students can intentionally use their time at NYU, how they can be the author of their lives moving forward, and empowers them to identify the contributions they will make to our community and our world.”

6

7 of 49

  • NYU Resources & Opportunities
  • Career Pathways
  • Time Management
  • Belonging & Access

1,440 Students Enrolled

46 Instructors, CLs & Sections

14, 75 Minute Sessions

Fall 2024 Implementation

Self

Community

  • Mentoring & Networking
  • Healthy Relationships- In Person and Online
  • Inclusion
  • Difficult Dialogues

Pathways

Action

  • Impact & Changemaking
  • Global Context
  • Mapping Time at NYU & Beyond

Authoring Your NYU Story

  • Identity & Values
  • Talents & Strengths
  • Emotion & Stress Management
  • Metacognition

7

8 of 49

Metacognition Module

Designed by Jenni Quilter (with a huge thanks to Jason Joyce who ed the design of Authoring Your NYU Story in general)

Slides designed for cohort leaders to adapt as they wish (and included at the end of this deck) and which included student expectations (86% of incoming students are used to receiving an A or A- for their work, etc.), Bloom’s taxonomy, discussion questions to guide reflection, narrative example of student study strategies, data that shows how other students interpret Bloom’s taxonomy, and examples of metacognitive study strategies.

Slides were introduced in orientation for cohort leaders and talked through in 45 min session.

8

9 of 49

Which level did you tend to work in when studying in high school?

Do you expect to work in the same levels in college?

Map everyone’s answers on the board through a show of hands.

Bloom’s Taxonomy of Learning was developed in 1956.

Newer versions exist, and the categories can shift according to which version you use, but the basic premise remains: this pyramid describes six different kinds of learning.

DISCUSSION

10 of 49

Takeaways

  • Limiting metacognition to one session is helpful but limited.
  • Exercises that show the effect of metacognition strategies in real time are more powerful than a potted summary: this approach could restructure the module.
  • Discussing metacognition outside of a specific class might be holistically helpful, but it lacks experiential edge or focus.
  • Student feedback named metacognition as impactful, and there were requests by instructors to think about this from non-Western perspectives, questions of timing and reinforcement and to consider the connection between metacognitive strategies and AI.

10

11 of 49

Principles of Biology

  • PoB I and PoB II are introductory classes for prospective Biology majors & pre-health students.

  • Large classes (~600 to ~800 students)

  • Students attend two professor-led lectures and one tutorial per week.

11

12 of 49

The Peer Facilitator Program

  • Launched in F2023
    • Create consistency in, and improve quality of, the tutorials
    • Build community within a large class
    • Support student-centered learning
    • Better integration with the ULC
    • Opportunity for upper level UG students

  • 14 – 15 Third/Fourth Year students
    • 100% retention of eligible PFs

12

13 of 49

What do the PFs do?

  • Facilitate two tutorials (~24 – 30 PoB students) for 50 minutes each
  • Host drop-in hours through the ULC
  • Host study slams and other events through the ULC
  • Enroll in a one credit course called “The Science of Teaching”

_________________________________________

7.6 hours/week

PFs compile their goals for the semester

13

14 of 49

The Science of Teaching

Reflection and Preparation (30 – 45 minutes)

    • PF experience in the tutorial during the week
    • Student experience in the tutorial during the week
    • Content overview from the Instructor of Record

Pedagogical Training (1 hr 15 mins – 1 hr 30 mins)

    • Discussion of a paper from a peer-reviewed journal
    • Consideration of how to apply material to tutorials/teaching

14

15 of 49

  • Course design for effective teaching and learning
  • Active learning techniques
  • Asking and answering questions
  • Formative and summative assessment
  • Inclusive teaching strategies
  • Technology in teaching and learning

  • Metacognition
  • Study Strategies
  • Fixed vs Growth Mindset

15

16 of 49

The basic model

Modified from Otero et al. 2010

Preparation Weekly meetings with the IoR

Pedagogy

Weekly course in scientific teaching and learning

Practice

Facilitate weekly tutorials of 25 - 30 undergraduates

16

17 of 49

Are these programs successful?

  • Better performance on exams, particularly with open-response questions, and in science classes overall ( Ferrari et al. 2023, Philipp et al. 2016, Talbot et al. 2015)

  • Decrease in DFW rates in STEM (Alzen et al. 2018), especially in students marginalized by racism (cited in Carlos et al. 2023)

  • Express positive attitudes towards STEM (Talbot et al. 2015), sense of belonging in STEM and confidence in talking about science (Clements et al. 2023)

  • Encourage peer-peer learning and metacognitive processes (Kornreich-Leshem et al. 2022)

17

18 of 49

18

19 of 49

Investigating impact (students)

19

20 of 49

Investigating impact (students)

20

21 of 49

Investigating impact (students)

  • Weekly Post-Tutorial Survey
    • How confident were you with the material BEFORE your tutorial?
    • How confident were you with the material AFTER your tutorial?
    • How prepared were you prior to the tutorial?
    • Did you read the problem set over prior to the tutorial?
    • What were the take home points?
    • What confused you during this tutorial?
    • What do you want to revisit?

21

22 of 49

Tutorials impact student confidence

22

23 of 49

Metacognitive Strategies

OfkjadlsjOf the

86 % of the students who said Yes say that learning these metacognitive strategies has influenced how they approach other courses.

23

24 of 49

Investigating impact (PFs)

  • Weekly Reflections (form and discussion in class)
    • What did you struggle with teaching this week and why?
    • How confident were you while teaching?
    • How confident were you in your preparation?
    • How much of the content did you cover?
    • What did the students struggle with?
    • What active learning strategies did you use?
    • Do you feel like your attitudes or strategies for teaching have shifted at all? If so, how?
    • Is there anything else you would like to share from this week?

24

25 of 49

Do PFs become better learners?

Breland et al. 2023 found significant increases in MAI scores after the first semester of participating in their LA program (F(1, 440) = 22.42, p < 0.001)

The largest increases were found in these questions:

  • “I ask myself if I learned as much as I could have once I finish a task”
  • “I know when each strategy I use will be most effective”
  • “I use the organizational structure of the text to help me learn”

Breland et al. 2023. The Benefits of Participating in a Learning Assistant Program on the Metacognitive Awareness and Motivation of Learning Assistants. CBE Life Sci Educ. 22(3):ar30.

doi: 10.1187/cbe.22-08-0156

25

26 of 49

Next steps: Teaching Innovation Award

  • This semester, we (KSP and EP) were awarded a TIA to create a series of high quality, peer-led video modules to teach metacognition and the hidden curriculum in PoB

  • Potential modules include
    • How do I prepare for lecture?
    • What are effective study strategies?
    • I got my test back….Now what?
    • What are student (office) hours?

Eugene Plavskin

Visiting Clinical Assistant Professor of Biology

Incoming Instructor for PoB

26

27 of 49

Key Takeaways

  • Highly structured model of pedagogy, preparation and practice enhances the experience

  • The PF program helps to build community, promotes conceptual understanding and provides formative feedback to the professor

  • The program allows for a better integration with the ULC

  • Students and PFs are gaining metacognitive skills and applying them to classes beyond PoB

27

28 of 49

RESOURCES

PoB PFs, Fall 23

PoB PFs, Spring 24

28

29 of 49

BULLET POINTS

  • Since its founding in 1831, NYU has been an innovator in higher education, reaching out to an emerging middle class, embracing an urban identity and professional focus, and promoting a global vision that informs its 19 schools and colleges.
  • List item #2
  • List item #3
  • List item #4

29

30 of 49

DISCUSS

[OR, CONSIDER, SHARE,

REFLECT,

ETC.]

Share the following information with us in the chat.

  • Question #1
  • Question #2
  • Question #3

Use this slide to add some topics for the audience to reflect upon, or use this as a prompt for another activity.

30

31 of 49

DISCUSS

[OR, CONSIDER, SHARE,

REFLECT,

ETC.]

Share the following information with us in the chat.

  • Question #1
  • Question #2
  • Question #3

Use this slide to add some topics for the audience to reflect upon, or use this as a prompt for another activity.

31

32 of 49

SLIDE WITH IMAGE

Today, that trailblazing spirit makes NYU one of the most prominent and respected research universities in the world, featuring top-ranked academic programs and accepting fewer than one-in-five undergraduates.

32

33 of 49

SLIDE WITH IMAGE LEFT

Today, that trailblazing spirit makes NYU one of the most prominent and respected research universities in the world, featuring top-ranked academic programs and accepting fewer than one-in-five undergraduates.

33

34 of 49

ACTIVITY

Today’s activity is written out here, with directions and ideas for reflection. Explain to the audience what you want them to do in the time allotted, and replace the picture on the right with an activity-related image.

34

35 of 49

Metacognitive Learning & the CAS Cohort Experience

Summer 2024

Jenni Quilter

36 of 49

Why are we talking about metacognitive strategies in first year cohort?

There are many professors who say that they wished students understood the benefit of metacognitive learning strategies early in their college career; understanding not just what you’re learning but why and how can transform your motivation, radically deepen your enjoyment and understanding of a subject, as well as significantly improve your grades.

This session is a basic introduction; look to the final slide for additional readings and information.

37 of 49

What study strategies did you rely on in high school?

5 mins to list strategies out on a board:

  • Strategies will likely vary from student to school to state to country;
  • Examples might be flash-cards, memorization, essay plans, wall charts, peer-discussions…
  • Are these strategies or habits? How and when did they develop?
  • What kind of knowledge did these strategies help with?

From the Office of Student Success we know that

86%

of incoming first years are used to receiving an A or A- for their work in high school.

CIRP Survey 2019 & 2020

DISCUSSION

38 of 49

  1. To make an A on the test;
  2. To teach the same material in a review session to the class.

What is the difference in the kind of learning you’d practice for each task?

What is the difference between learning a what and learning a why?

CIRP Survey 2019 & 2020

DISCUSSION

Incoming first years expect to spend

18 hrs

a week preparing for class, and 70% expect that most or half of this time will be spent reading.

Which task would requires more learning?

39 of 49

Which level did you tend to work in when studying in high school?

Do you expect to work in the same levels in college?

Map everyone’s answers on the board through a show of hands.

Bloom’s Taxonomy of Learning was developed in 1956.

Newer versions exist, and the categories can shift according to which version you use, but the basic premise remains: this pyramid describes six different kinds of learning.

DISCUSSION

40 of 49

In case you need more data:

Which level did you tend to work in when studying in high school?

Do you expect to work in the same levels in college?

In one survey, 21% of students said they focused on knowledge in high school, 35% on comprehension, 25% application, 13% on analysis, 3% on synthesis, and 3% on evaluation.

In the same survey, 7% of students expected to focus on knowledge in college, 6% on comprehension, 15% on application, 35% on analysis, 5% on synthesis, & 15% on evaluation.

How do we change our study strategies to reflect a shift in learning ?

41 of 49

STUDENT ONE: During office hours, Josephina expresses that she was happy the exam was on a Monday, because she had a lot of time to prepare the previous weekend. She shares that she started studying after work on Saturday evening and did not go out with friends that night. When queried, she also shares that she reread all of the assigned textbook material and made flashcards of the bold words in the text. She feels that she should have done well on the test, because she studied all Saturday night and all day on Sunday. She feels that she did everything she could do to prepare. That said, she is worried about what her grade will be, and she wants you to know that she studied really hard, so she should get a good grade on the exam.

STUDENT TWO: Later in the week, Maya visits your office. When asked how she prepared for the first exam, she explains that she has regularly reviewed the PowerPoint slides each evening after class since the beginning of the term 4 weeks ago. She also read the assigned textbook pages weekly, but expresses that she spent most of her time comparing the ideas in the PowerPoint slides with the information in the textbook to see how they were similar and different. She found several places in which things seemed not to agree, which confused her. She kept a running list of these confusions each week. When you ask what she did with these confusions, she shares that she brought them to her weekly study group with peers from her course lab section. There, she says, she got most of her questions answered and lots of her confusions cleared up. She has come to office hours to ask you about a couple of things that she did not figure out before the exam that she thinks she probably missed. She is not too worried about her score on the exam, because most of the material related to problems and concepts that she felt had been thinking about a lot.

To the right are descriptions of study strategies of two different students as told to faculty.

In pairs, discuss the key differences.

What do you guess about how each student is doing in the class overall?

42 of 49

STUDENT ONE: During office hours, Josephina expresses that she was happy the exam was on a Monday, because she had a lot of time to prepare the previous weekend. She shares that she started studying after work on Saturday evening and did not go out with friends that night. When queried, she also shares that she reread all of the assigned textbook material and made flashcards of the bold words in the text. She feels that she should have done well on the test, because she studied all Saturday night and all day on Sunday. She feels that she did everything she could do to prepare. That said, she is worried about what her grade will be, and she wants you to know that she studied really hard, so she should get a good grade on the exam.

STUDENT TWO: Later in the week, Maya visits your office. When asked how she prepared for the first exam, she explains that she has regularly reviewed the PowerPoint slides each evening after class since the beginning of the term 4 weeks ago. She also read the assigned textbook pages weekly, but expresses that she spent most of her time comparing the ideas in the PowerPoint slides with the information in the textbook to see how they were similar and different. She found several places in which things seemed not to agree, which confused her. She kept a running list of these confusions each week. When you ask what she did with these confusions, she shares that she brought them to her weekly study group with peers from her course lab section. There, she says, she got most of her questions answered and lots of her confusions cleared up. She has come to office hours to ask you about a couple of things that she did not figure out before the exam that she thinks she probably missed. She is not too worried about her score on the exam, because most of the material related to problems and concepts that she felt had been thinking about a lot.

To the right are descriptions of study strategies of two different students as told to faculty.

In pairs, discuss the key differences.

What do you guess about how each student is doing in the class overall?

43 of 49

The difference between these two students rather neatly maps onto Flavell’s 1976 definition of metacognitive learning strategies, which is the ability to…

  • Think about one’s thinking;
  • Be consciously aware of oneself as a problem solver;
  • Monitor, plan and control one’s mental processing;
  • Accurately judge one’s level of learning;

In pairs, come up with one learning strategy that would help you shift from remembering to applying or analyzing.

DISCUSSION

44 of 49

  • For a 4-credit class, expect to budget 6-7 hours per week for learning in addition to the lecture. Set up a weekly schedule that suits your learning style. Focus on understanding the course rather than just completing any given assignment.
  • Plan & list manageable tasks that can be completed in short chunks, i.e. 20 minutes to read, 20 minutes to summarize in writing (without looking at the text) everything you remember.
  • When taking notes by hand, using three columns of understanding: 1) what you feel confident about; 2) lingering questions or confusions, and 3) implications (i.e. “if this is the case, then….”);
  • Compare multiple texts that teach the same concept. What are the similarities? What are the revealing differences?
  • Looking for examples of concepts outside the text or lecture;
  • Recap the information for yourself in a different visual form, i.e. diagram, sketch.
  • Meet with another student or a small group each week to compare notes and questions from readings/lectures;
  • Make a point of asking your roommates and friends what's going well in their classes and the work they’re most excited or worried about;
  • Actively use a textbook’s index to understand how a topic in one chapter might be connected or recurring in another;
  • Complete homework without using solved examples as a guide;
  • Create practice exams for your friends (and vice versa);
  • Teach the material to a real or imagined audience;
  • Attend office hours with a list of specific questions!

You get to

design your own learning adventure!

These study strategies

change according to academic discipline, but here are some possibilities:

45 of 49

Free-write for 10 minutes:

What do you now understand about your own thinking & learning?

How do you want to modify your current learning process?

How are you going to assess your own progress beyond reviewing the material?

46 of 49

[KEEP NEXT THREE SLIDES AT END OF DECK]

47 of 49

Visit the NYU CTL website: www.nyu.edu/ctl

Email the NYU CTL: teaching@nyu.edu

48 of 49

VISIT OUR UPCOMING EVENTS PAGE

For future TeachTalks

48

49 of 49

LET US KNOW HOW WE DID!

49