1 of 38

The Use of Multimodality in World Language Classrooms

Dr. Fei Yu

fyu@bentley.edu

2 of 38

What is

Metaverse ?

3 of 38

Metaverse is a hypothetical iteration of the Internet as a single, universal and immersive virtual world that is facilitated by the use of virtual reality and augmented reality headsets. A metaverse is a network of 3D virtual worlds focused on social connection.

4 of 38

Learning styles

“......each child possessed specific talents and skills.”

-- Aristotle

5 of 38

  • Lev Vygotsky: Sociocultural Theory
  • Jean Piaget: Theory of Cognitive Development
  • Howard Gardner: Theory of Multiple Intelligences

6 of 38

Neil Fleming

7 of 38

8 of 38

About learning styles, it is agreed that

  • Every person has his/her own learning style.
  • As teachers, we need to know how our students learn best in order to plan for instruction.

9 of 38

However......

10 of 38

Multimodal Learning/Multimodality

11 of 38

What is multimodal learning/multimodality?

  • It refers to an embodied learning situation which engages multiple sensory systems and action systems of the learner (Massaro, 2012).

12 of 38

(WIDA English language development standards framework 2020 edition)

13 of 38

14 of 38

Multimodality is inherent to and essential for how students make meaning and engage in disciplinary practices. In addition to the use of spoken and written language, students also communicate through gestures, facial expressions, images, equations, maps, symbols, diagrams, charts, videos, graphs, computer-mediated, and other means (WIDA 2020).

15 of 38

WIDA English language development standards framework (2020 edition)

16 of 38

How?

17 of 38

Teachers’ concerns

18 of 38

Demo Lesson: �Chinese numbers

19 of 38

学习目标 Learning Objectives

1. 我能用中文从一数到十。

I can count from 1 to 10 in Chinese.

2. 我能用中文数字表达物体数量。

I can use Chinese numbers to express the quantity of items.

20 of 38

21 of 38

22 of 38

23 of 38

讲义页 �Handout

24 of 38

课堂活动一:Fei说你做, Fei做你说� Activity 1: Do as Fei say, Say as Fei do

25 of 38

https://www.youtube.com/watch?v=2eLP3FuuEVs

26 of 38

课堂活动二:数糖�Activity 2: Count candies as Fei say

kē táng

颗 糖

kē táng

颗 糖

27 of 38

课堂活动三�Activity 3

28 of 38

再回学习目标 �Revisiting Learning Objectives

1. 我能用中文从一数到十。

I can count from 1 to 10 in Chinese.

2. 我能用中文数字表达物体数量。

I can use Chinese numbers to express the quantity of items.

29 of 38

30 of 38

MULTIMODAL LEARNING/�MULTIMODALITY

31 of 38

What are the types of multimodal approaches/ communication modes used in the demo class?

32 of 38

Multimodal inputs:

images, videos, gestures, symbols......

Multimodal outputs:

movements, computer-mediated games

facial expressions......

equations, maps, symbols, diagrams, charts, graphs.....

33 of 38

Discussion: Do these multimodal approaches help to meet the needs of learners? Why or why not?

34 of 38

Knowledge

Construction

Information acquisition is added to the learners' memory and integrates multiple representations to improve learning outcomes.

Engagement

Learners become agents of their own meaning making by empowering them to be accountable and motivate by multiple ways to take in knowledge, skill, or concept.

Diverse Learners

One size, style, or type of learning does not "fit" all. It puts the learning content into context for the learner regardless of their background or experience.

(Kalantzis, Cope, Chan, & Dalley-Trim, 2016)

35 of 38

Final thoughts on multimodal learning/multimodality:

  • To properly implement multimodal learning, teachers first need to understand learning styles.
  • Multimodal learning environments support the need for differentiated instruction, considering all learning needs and helping every student success. to create a multimodal learning environment at your school.
  • A multimodal learner will thrive in a comprehensive learning environment that uses visual, auditory and kinesthetic inputs -- both verbal and non-verbal.

36 of 38

MULTIMODAL

ENSEMBLE

technology

available

social

context

modal

affordances

the agency

of an

individual

modes

available

(Fernández-Pacheco, 2018)

37 of 38

References

  • Reiff, J. C. (1992). Learning styles. What research says to the teacher, 7. Washington, DC: National Education Association.
  • Massaro, D.W. (2012). Multimodal Learning. In: Seel, N.M. (eds) Encyclopedia of the Sciences of Learning. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-1428-6_273
  • WIDA. (2020). WIDA English language development standards framework, 2020 edition: Kindergarten–grade 12. Board of Regents of the University of Wisconsin System.
  • Kalantzis, M., Cope, B., Chan, E., & Dalley-Trim, L. (2016). Literacies, 2nd Ed. Melbourne, Australia: Cambridge University Press
  • Fernández-Pacheco, N. (2018). The Impact of Multimodal Ensembles on Audio-Visual Comprehension: Implementing Vodcasts in EFL Contexts. https://doi.org/10.1515/mc-2018-0002

38 of 38