Defining and Assessing the Language Content: Effects on Curriculum Design� ��
9 March 2022
Session presenter: Prof. Emma Marsden,
Dept of Education, University of York.
Director, National Centre for Excellence for Language Pedagogy (NCELP)
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Session overview
Part 1/ What are ‘Language Competence’ and the ‘Subject Content’?
Part 2/ The content in 2015 and 2022
Part 3/ Some implications for curriculum design
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Bachman (1990)
Canale & Swain (1980)
Organisational Competence
Grammatical Competence
Morphology
Syntax
Vocab
Phonology/
Graphology
Textual Competence
Cohesion
Rhetoric
Pragmatic Competence
Illocutionary Competence
Functions of language
Sociolinguistic Competence
Register/
Genre / Dialect
What does it mean to ‘know a language’?
What can be taught and learnt in the early stages?
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
How does MFL education in England define and operationalise “content”, at each layer of specification?
The Subject Content and Annexes: knowledge and how it can be used
DfE
Ofqual
Awarding body
Publisher
Teacher
Checks exams test the content (not other things)
Checks sampling of content, year on year
teaching materials
The specification = syllabus
The exams
450 hours of classroom experience & materials (KS3 & 4)
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Session overview
Part 1/ What are ‘Language Competence’ and the ‘Subject Content’?
Part 2/ Comparing 2015 and 2022: similarities and differences
Part 3/ The implications for teaching and assessment(s)
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Similarities between Subject Content in 2015 & 2022
BUT note the requirement for “clear and comprehensible” speech
(rather than spontaneity+ fluency+ polish!)
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Changes to address what potential problems?
-> mismatch between the language content on specifications and the language used in exams
-> very heavy weighting on lexical inferencing
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Some consequences of having a lexical content that is not defined and not informed by frequency
-> Heavy reliance on inferencing, in early, vulnerable stages of learning
Inferencing = guessing meaning, using the context and own knowledge
Dudley & Marsden (in progress). Using word lists for high-stakes exams: Topic-driven versus frequency-informed.
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
inferencing skills are of course important BUT difficult …
Whether a student can successfully infer meaning is ‘hit and miss’:
Successful inference can depend on …
-> robust existing knowledge is helpful
(e.g., Albrechtsen et al., 2008; Bengeleil & Paribakht, 2004; Fraser, 1999; H. C. M. Hu & Nassaji, 2012; Huckin & Bloch, 1993; Nassaji, 2003; Pulido, 2007; Qian, 2005; Sternberg, 1987; Wesche & Paribakht, 2009).
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Key differences in 2022 Subject Content. [1/4]
The lexicon is specified:
All tasks fully accomplishable using only language from the defined vocabulary and grammar lists
NB Full credit given for appropriate production of language beyond the list!
Is it very unusual to have a word list?
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Having a word list is not very unusual
Word lists for proficiency tests:
~A2: 1,500 words / ~B1: 3,750 words
A2: 1,300 words / B1: 2,400 words
Word lists for curricula:
Guidelines about number of words:
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
How many words is reasonable if we want to teach…
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
What might inform decisions about how many words can be really learnt?
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Is the amount (1,250 and 1,750) about right?
2015 GCSE (minimum) word lists, AQA:
Spanish: 1,566 word families
French: 1,300 word families
German: 1,632 word families
Tier of GCSE | Word families used to create ONE exam | Word families used to create THREE exams |
Foundation | 609 | 1,173 |
Higher | 753 | 1,542 |
Median of range across awarding organisations & languages
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Why should “85%” be high frequency words?
The 2,000 most common words in a language generally cover…
How do we know what the most frequent words are in FLs?
Massive corpora: French 23 million; Spanish 2 billion; German 20 million
The very most frequent words change very little, over time or context
About 80-85% of the most frequent words are the same – no matter which large, general corpus you use
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Does this ‘constrained’ lexicon mean that students are less well prepared for an A level exam?
No.
On average, a new GCSE list has 13% fewer word families than a current list,
but provides 34% more coverage of the word families in typical A level exam
(averaging across AQA and Edexcel).
Dudley & Marsden (in progress). Using word lists for high-stakes exams: Topic-driven versus frequency-informed.
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Is a frequency-informed list useful for the current GCSEs?
Predicted probability of a word family in corpus of exams being from each word list
Yes: a frequency-informed list predicts more of the content of exams to date compared to the current word lists
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Is a frequency-informed list useful even for those words that have only ever been used once in current GCSEs?
Predicted probability of a word family only used once so far being from each word lists
It is equally as useful as all current AQA lists and all Higher Edexcel lists
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Key difference in 2022 Subject Content [2/4]
Vocabulary in Reading only:
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Hanoucca
Pour la communauté juive, la fête importante de décembre est Hanoucca. C’est une fête de lumières et on utilise des bougies pour célébrer. La fête est de huit jours, et on allume une bougie le premier jour, deux bougies la deuxième jour … Les bougies sont un symbole de la bonté de Dieu. Dans une vieille histoire juive, une petite bouteille d’huile a nourri une lampe pendant huit jours, beaucoup plus de temps que normalement. On mange des beignets comme un symbole de l’huile. Les enfants jouent avec des toupies qui contiennent une phrase religieuse. Hanoucca est plus familial et spirituel que religieux.
Use the words you know to choose the general meaning of the words in bold.
goodness
oil
doughnut
spinning top
Inferencing, in curriculum and assessment?
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
(e.g., interrogative types laid out)
(e.g. depuis +present; inflectional future)
Key difference in 2022 Subject Content [3/4]
Grammar content simplified, clarified, and sequenced:
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Key difference in 2022 Subject Content [3/4]
Grammar content:
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Key difference in 2022 Subject Content [4/4]
No longer just ‘isolated skills’ of L, R, S, W
Addition of sound-spelling correspondences (phonics)
Students demonstrate ability in:
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Session overview
Part 1/ Language competence and Subject Content
Part 2/ Comparing 2015 and 2022: similarities and differences
Part 3/ Some implications for curriculum design
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Implications for curriculum. The new content increases attention on …
practice reading aloud WITH understanding
practice writing down language that is heard
the most used words
independent manipulation of language
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
How to sequence a curriculum, if not with phrases from topics on ‘my routine’, ‘school’, ‘jobs’?
(VanPatten, Marsden & Chen/Kasprowicz/McManus)
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
And yet space 1750 words out, across varied, interesting contexts?
-> “expanding practice schedules” (see Nakata, 2015)
When we are “gardening in a gale” of English (Hawkins, 1996), how do you ensure there is enough revisiting of language?
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
An expanding practice schedule
Week 20: tested
Week 33: tested
Each of following years: practised and tested
Week 1: a set of words learnt for pre-lesson homework – e.g., Quizlet
wk
10
wk
2
wk
5
Week 10: relearnt before lesson and included in classroom activities
Week 5: relearnt before lesson and included in classroom activities
Nakata, T. et al. (2020). The long-term benefits of making the simple change from non-cumulative to cumulative weekly vocabulary quizzes . OASIS Summary of Nakata, T. et al. (2020) in TESOL Quarterly. https://oasis-database.org
Week 2: taught & practised in lesson
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Revisiting vocabulary in different semantic contexts
Talking about people’s lives
Asking about future intentions
Talking about the environment
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
2. Design
grammatical growth: word families gradually get larger as new features are introduced
Planning systematic vocabulary and grammatical growth
lesson | word families grow | number of words grows |
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
But won’t this lead to a dull diet? ��What about the country/ people / culture?�
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Be wary of ‘false dichotomies’
“Focusing on grammar means culture has been forgotten!”
“Focus on words means there is not enough interesting material!”
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
El pasado de Medellín
Medellín es una ciudad en Colombia que hace veinte años era muy peligrosa. Un grupo de criminales, el Cartel de Medellín, organizaba redes de narcotráfico* y prácticamente controlaba la ciudad. El narcotráfico era un muy _______ _________ (el Cartel ganaba hasta sesenta millones de dólares al día), así que era posible ganar mucho dinero en muy ________ _________. Sin embargo, era una ___________ _________ y el grupo usaba la violencia* muy a menudo. Mataba a policías en la calle y secuestraba* a ___________ _____________. A pesar de estas acciones, el jefe del cartel, Pablo Escobar, era una persona popular en los _________ _________. Él ayudaba a la población en lugares donde el gobierno no estaba. Por eso mucha gente de estas comunidades lo consideraba una _______ _________.
escuchar / escribir / leer
buen
negocio
actividad
ilegal
poco
tiempo
personas
importantes
barrios
pobres
gran
persona
*el narcotráfico = drug trafficking
*secuestrar = to kidnap, kidnapping
*la violencia = violence
Escucha y completa el texto.
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
El Medellín de hoy
Escobar murió en el año 1993. Hoy en día Medellín es mucho más __________. En general la gente puede vivir tranquilamente. La zona urbana es bastante agradable, con museos, plazas y parques. Medellín es la ________ ciudad de Colombia que tiene su _________ metro y una red de “metrocables” (un tipo de transporte que conecta las partes altas de la ciudad con las partes bajas). En 2012, incluso ganó un premio a nivel ____________ por estos proyectos de transporte público.
Al _________ tiempo, la ciudad no olvida su pasado ________. En 2006 el gobierno abrió un museo, la “Casa de la Memoria”, para acordarse de la violencia y promover el diálogo. La idea: aprender del pasado para crear un futuro _______.
leer
propio | única | mundial | oscuro | seguro | mismo |
Opciones:
seguro
única
propio
El metrocable
mundial
mismo
oscuro
mejor
*la violencia = violence
La Casa de la Memoria
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
La Manche
lire / écrire
La Manche* sépare la France et l’Angleterre. On peut traverser la Manche en bateau ou en train sous l’eau. Quand nous visitons l’Angleterre, nous aimons prendre le train – c’est plus rapide. Ils préfèrent prendre le bateau pour regarder la vue. Comment traversez-vous la Manche ?
Le tunnel sous la Manche constitue le plus long tunnel sous-marin* du monde – on trouve 38 de ses 50 kilomètres sont sous la mer*. On utilise le tunnel pour voyager entre l'Angleterre et la France. C'est idéal pour les vacances et les affaires.
Écris des réponses aux questions en anglais.
What are two ways you can cross the Channel?
boat / train
How long is the tunnel?
50km
How much of the tunnel is under the sea?
38km
What is the tunnel ideal for?
holidays / business
*la Manche = the English Channel
*sous-marin = underwater
*la mer = sea
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Una tradición mexicana: el Día de Muertos
Lee y escucha el texto sobre el Día de Muertos:
leer / escuchar
México tiene muchas tradiciones, pero su tradición del Día de Muertos es especialmente conocida. Es una costumbre única y muy importante para su comunidad porque es una forma de pensar en los muertos. Para los mexicanos, los muertos vienen a la tierra este día.
Nadia es mexicana y celebra el Día de Muertos con su familia. Por la mañana se levanta temprano para ayudar a su abuela: preparan pan* de muerto y un poco de fruta para el altar. Su altar tiene varios* niveles. Los niveles del altar son las diferentes partes del mundo: el primer nivel es la tierra y el segundo nivel es el cielo*. Nadia pone allí fotos de su abuelo y se sienta al lado de su abuela. Se queda unas horas en casa con su familia y se acuerda de su abuelo muerto.
Por la tarde se pone ropa divertida, se pinta de blanco y negro y va a la calle con su hermano. En su barrio hay un festival con música fuerte y luces de colores. ¡Es muy divertido!
1
2
3
4
5
6
*el pan = bread; *el cielo = sky, heaven; *varios = various
‘Pan de muerto’ es un tipo de pan tradicional en este día.
7
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Be wary of ‘straw men’
Texts with ‘all familiar words’ are unchallenging!
Arguing against an idea that no one proposed in the first place! – Misrepresenting an idea in a way that is so flimsy that no one would realistically propose – and so, it’s easy to shoot it down!
Who would really propose to always use texts in which all the words are completely known to all learners?
And what do ‘familiar’ or ‘known words’ mean?
Known without fail?
Or … Introduced last week?
Revisited last year?
On average, year 11s know between 550-850 words, then out of a word list of 1750, some words are still going to be ‘unfamiliar’ in their GCSEs ->
Inferencing will still be needed by most students for some words
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Le festival de Dieppe
Comment dit-on les mots orange en anglais ?
lire
Le festival de Dieppe est le plus grand* festival de cerfs-volants* au monde.
On trouve le festival sur la plage.
Les visiteurs viennent de beaucoup de pays pour regarder des cerfs-volants traditionnels, de l'art et des acrobates. Un aspect important du festival est qu’on peut visiter sans acheter de billet. Il est gratuit !
Il y a beaucoup d'activités pour les enfants et le festival encourage l'imagination. Cet événement culturel célèbre les relations internationales. Pendant le dernier week-end du festival, on regarde les cerfs-volants illuminés pendant un show son* et lumière. Je pense à visiter le �festival. Tu veut voyager au festival avec ma famille ?
visitors
traditional
acrobats
free
event
illuminated
light
What noun does this word look like?
What adjective does this word look like?
What noun does this word look like?
What does this sentence tell you about the festival?
The start of this word looks like the English
What adjective does this look like?
This word has the same stem as the previous one you worked out. What might it mean?
What words that you already know could you use instead of the words in orange?
Answer the question at the end.
*le plus grand =
the biggest
*le cerf-volant = kite
*le son = sound
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Do we know this to be true?
If we keep both equally ‘interesting’, are “authentic” texts somehow superior for beginner/intermediate learners?
One carefully controlled study, with learners of German, found:
BORDAG, D & ROGAHN, M. (2019) The role of literariness in second language incidental vocabulary acquisition. Applied Psycholinguistics 40, 399–425 doi:10.1017/S0142716418000620
“”Students learn better if a text is authentic literature compared to if it is created for the classroom”
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
““Too much focus on language – not enough on communication”
“They won’t be able to say anything useful with just high frequency words!”
““What about basic interactional skills?”
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
What about everyday communication and interactions for learners about this age, if they were abroad?
9.1.1.4 - interview about work experience (modal verbs: what you can, must, and want to do)
9.1.2.3 - listening comprehension: asking about a hotel
- writing and listening/reading gap-fills: booking table in restaurant
- asking about things in a restaurant
9.1.2.4 - speaking to find out about a school - role play
9.1.2.6 - asking what time things are happening
9.2.1.6 - reporting a crime
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
¡Lucía y Nadia van de compras! Están en una tienda de ropa. �Lee la conversación. Escribe 1-9 y ‘este’ o ‘esta’.
leer
Lucía: (1) Este / Esta tienda es muy buena. Creo que es mejor que la tienda en el centro.
Nadia: Sí, es verdad. ¿Te gusta (2) este / esta vestido azul?
Lucía: ¿Cuánto es?
Nadia: 30 euros. Es más bonito que el vestido rojo y menos caro que el vestido al lado de la puerta.
Lucía: Me gusta mucho. Y (3) este / esta marca es muy conocida también.
Nadia: Claro. Además, según una amiga,
el color azul es más popular que el amarillo o el rojo (4) este / esta año.
Lucía: ¡Mira! (5) Este / Esta falda es preciosa también, y ¡está a mitad de precio!
Nadia: ¡Qué bien!* El precio de la falda en (6) este / esta tienda es más bajo que en otros lugares.
¡Qué bien! That’s great!
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
leer / escuchar
La pregunta | Objetos |
1. ¿Por qué no compras estas ______? | zapatos bicicletas |
2. ¿Cuánto son estos ______? | bolsas espejos |
3. ¿Quién necesita estas ______? | relojes cosas |
4. ¿Cómo son estos ______? | pantalones cajas |
5. ¿Dónde guardas estas _______? | vestidos camisas |
6. ¿Cuáles son estas ________? | marcas libros |
Hugo y Daniel van de compras. Lee las preguntas. Completa la pregunta con la palabra correcta. Luego escucha las respuestas. Identifica la pregunta correcta (e.g. pregunta 3).
Respuestas |
|
|
|
|
|
|
A
B
C
D
E
F
Pregunta 6
Pregunta 2
Pregunta 5
Pregunta 1
Pregunta 3
Pregunta 4
Notice how the –a (‘s/he’) ending is used after ‘quién’.
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Persona A: read the question in Spanish but don’t say the crossed out word!
Persona A (pregunta):
Persona B (escucha y mira las tarjetas):
When do you need these (skirts)? (f)
hablar / escuchar / escribir
Preguntas en las tiendas
A
B
This Monday.
This week.
(m)
(f)
Un ejemplo
Persona B: look at the cards. Is it ‘A’ or ‘B’? Say the words below the picture in Spanish.
Say:
(faldas)
¿Cuándo necesitas estas…?
Esta semana.
_______________
Esta semana.
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Persona A
Persona B
hablar
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
1.
2.
3.
4.
5.
6.
A
B
A
B
A
B
A
B
A
B
A
B
in the market
in the shop
They are 30 euros.
They are 27 euros.
Because I want to drink something.
Because I want to read the news.
this week
They are pretty.
They are short.
my Mum
my Dad
this Saturday
(m)
(f)
(f)
(m)
(m)
(f)
(f)
(m)
(f)
(m)
(m)
(f)
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
1.
2.
3.
4.
5.
6.
A
B
A
B
A
B
A
B
A
B
A
B
They are 29 euros.
They are 24 euros.
They are not expensive.
I like the colour.
They are very practical/ useful.
They are tasty.
in the kitchen
in the shop
at the weekend
this Sunday
my grandfather
my aunt
(f)
(m)
(m)
(f)
(m)
(f)
(f)
(m)
(f)
(m)
(m)
(f)
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Y Daniel, ¿cómo ayuda?�
B bread (m)
A milk (f)
1
2
3
buys it at the market
B vegetable (f)
A wine (m)
leaves it next to the window
B egg (m)
A food (f)
places it on the table
escuchar
B cheese (m)
A fruit (f)
4
5
6
cuts it in
the kitchen
B juice (m)
A honey (f)
B apple (f)
A banana (m)
Acción y lugar
Acción y lugar
mixes it in
a glass
takes it out of the bag
Daniel también ayuda.
Escucha. ¿Es ‘A’ o ‘B’?
Escribe la acción y el lugar en inglés.
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Lucía compra en el mercado y habla con un dependiente. Lee y escucha el diálogo. Después, lee las frases en inglés. ¿Son verdaderas o falsas?
| V | F |
1. Lucía only wants big loaves of bread. | | |
2. She prefers hot bread. | | |
3. She wants bread for the evening. | | |
4. She puts the loaves of bread in the bag with the bottles of milk. | | |
5. The vegetables are fresh. | | |
leer / escuchar
*a ver = let’s see
*claro = of course
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Ahora intenta completar este diálogo en español:
escribir
Hi, how much do the eggs cost?
Do you prefer them big or small?
Mmmm, big. I also want to buy fruit and vegetables.
Look – I have some fresh apples. You can try one if you like.
Perfect, thank you! I need them for a traditional dish.
1
2
3
Hola, ¿cuánto _________ los huevos?
1
¿___ _________ grandes o pequeños?
2
Mmm, grandes. También quiero comprar _________ __________.
3
Mira – tengo unas manzanas frescas. ______________ una si quieres.
4
5
4
¡Perfecto, gracias! _____________ para un plato tradicional.
5
cuestan
Los
fruta y
Las necesito
prefieres
Puedes probar
verduras
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Mira las respuestas. ¿Tu traducción es correcta?
escribir
Hi, how much do the eggs cost?
Do you prefer them big or small?
Mmmm, big. I also want to buy fruit and vegetables.
Look - I have some fresh apples*!
Perfect, thank you! I need them for a traditional dish.
1
2
3
Hola, ¿cuánto cuestan los huevos?
1
¿Los prefieres grandes o pequeños?
2
Mmmm, grandes. También quiero comprar fruta y verduras.
3
Mira - tengo unas manzanas frescas.
4
5
4
¡Perfecto, gracias! Las necesito para un plato tradicional.
5
*apple = la manzana
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
Further resources from NCELP
https://resources.ncelp.org/
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes
CPD offer
CPD course free to teachers in state schools
Briefings from NCELP UNDERSTANDING THE NEW SUBJECT CONTENT FOR GCSE FRENCH, GERMAN AND SPANISH�
Format: online
Timings: 3.30-4.30pm / 4.00-5.00pm / 7.00-8.00pm
Dates: various dates throughout March – see schedule below for more information.
Audience: MFL Heads of Department, Subject Leaders or MFL teachers.
Cost: free
https://ncelp.org/march-briefings-gcse/
Please respond to 2 quick questions!
Sign up to receive OASIS accessible
summaries of research studies
https://mailchi.mp/481ba176f2d1/oasis-alerts
Want to hear more from NCELP?
Thanks for listening
Material licensed as CC BY-NC-SA 4.0�
Rachel Hawkes