1 of 21

Writing Moderation

1:30pm - 3:30pm

Venue: South Hornby School

3rd November 2022

Genre: Explanation

2 of 21

Gilberthorpe

Kathleen Ryan

kathleen@gilberthorpe.school.nz

Hornby

Heather Matthews

Rovena Jackson

Hornby High

Katie Tozer

Chris McLaren

Desirē Truter

tz@hornby.school.nz

ml@hornby.school.nz

tt@hornby.school.nz

South Hornby

Sarah McClelland

mcclellands@southhornby.school.nz

St Bernadettes

Shelley Sutherland

shelley@stbernadetteschch.school.nz

Wigram

Yaldhurst

Melissa Rennell

melissa.rennell@yaldhurst.school.nz

Uru Mānuka

Angela Taylor

angela.taylor@urumanuka.org.nz

Apologies:

3 of 21

The Why: The reason we moderate is to check the consistency of judgments and ensure a shared understanding of the E-asttle marking rubric across the cluster. It is important to have robust discussions around expectations and understandings and identify and resolve any differences within and across schools. Moderation does mean having

an open mind.

The How: Representatives from each school will come together to ensure a shared understanding of the marking rubric. Representatives will then return to their own school to lead/support their own in-school moderation and ensure the same messages and understandings from the Cluster Moderation are shared with all staff.

Please Note: All teachers should not mark writing until both the �cluster moderation and in-school moderation has happened.

4 of 21

Key Resources

5 of 21

2022 Writing Prompts (Explanation)

6 of 21

E-asttle Writing FAQ’s

How do I mark a script that seems off topic?

The topic outlined on the prompt (for example, ‘being a good friend’) is intended as a springboard for �writing, rather than a tightly defined focus. Take this into account when scoring the ‘ideas’ element: �ideas can be loosely related to the topic and still be considered relevant.

How do I mark a script that seems to be off purpose?

The purpose for the writing (to explain, persuade, narrate, describe or recount) is the focus of the ‘structure and language’ element. It is not the focus of any other element. If the student has been asked to describe a photograph of two dogs playing on the beach, but actually narrates a story about a dog, this will be reflected �in the category score for ‘structure and language’.

How do I mark when factual information is wrong?

E-asTTle writing does not assess curriculum area content knowledge, so there is no element for scoring the correctness of information. Writing sometimes contains incorrect facts, but this does not mean a student will necessarily have a low score for the ‘ideas’ element.

7 of 21

Of note from E-asttle

The communicative purpose for the writing (to explain, persuade, narrate, describe or recount, as specified on the prompt) is the focus of the element “structure and language”. If the student has been asked to describe a photograph of two dogs playing on the beach, but narrates a story about a dog, this will be reflected in the category score for structure and language. For all other elements, the writing will be scored at face value, without reference to the specified purpose. This approach enables the the E-asttle tool to provide rich diagnostic information about skill levels in seven clearly defined elements of writing, including the ability to achieve a communicative purpose through appropriate selection of structural and language features. Manual p.19

Of note from Manaiakalani

If any recorded scores are a 0, the data goes onto the spreadsheet not onto e-asTTle. No student can score a 0 for Structure and Language and Punctuation, they must score a 1.

Uru Manuka R0 criteria

8 of 21

Discussions from Previous Moderations

  • Exemplars MUST be used alongside the Rubric
  • Remember when looking at Sentence Structure read in the missing or incorrect punctuation as this is assessed separately.
  • Garry Taylor would like to acknowledge that the marking of e-asTTle is not an exact science, but neither should it be classed as subjective. You will never get total agreement but there are valid ways of getting very close to agreement.
  • We asked for further clarification re the definition of the complexity in regards to ideas (R3 to R4). The following was our reply:

So ideas covers three aspects – quality of ideas, selection of ideas and elaboration of ideas. Elaboration is the writer providing more detail to the event, description, or analysis etc. In R3 it can be either “Text has many simple, unelaborated ideas related topic. In my words ‘lots of different things without the detail’. (Have a look at ‘By the Mall in the generic exemplars). There is also “An idea is related to the topic and has some basic elaboration.” The important bit here is that it really is just one main idea with some detail. (My iPod in the generic exemplars is an ok example) Experience you typically see these type of texts in half a page to a page piece of writing where there is either a lot of assumed knowledge or it really only focuses one main idea. So R3 really focuses on relevance and elaboration (or lack thereof) At R4 the concept of movement form simple to complex ideas becomes prominent. Up to R3 ideas are simple, meaning they are generally focussed on the writer’s know world (the ‘All about me’ idea). Writers who write simple ideas focus on what they know, what they have seen, what they have done. Basically just tells it how it is. As writers become more complex the focus is still mainly on telling it how it is but there may be some aspects of reflection (I had a really enjoyable day (‘Rainbow’s end’ or ‘When I go to the beach’ is a good example)) or starts focussing on things that are not obvious but perceived (He was really honest handing that money back in) or deals with things that are abstract in nature (pollution, capitalism etc.) There feels like a bit of a jump in the maturity and sophistication of the writing because it is more than just the bare bones – the writing starts to develop some character.

9 of 21

Discussions from Previous Moderations

Question: Our focus has been on the description but we are finding a lot of scripts are written as narratives or recounts. Initially, we would have thought this was an R1 for 'structure and language' however there are some overlaps in features. The key word appears to be 'some' in R2. Would you suggest that in order to score an R2 they would be required to have more than one structural and one language feature from that genre? What happens if the genre overlaps eg tense, orientation?

The Describe a moment in time prompts are the prompts most likely not to go off script and end up as narratives and recounts. Just the way it is, but not enough of an issue to exclude them as a prompt option. “The adventurous dog” is a great example of this and it only scores at R1. “By the mall on the other hand has some language features so is placed at R2 although is probably best categorised as a describe piece of writing. So no I don’t think you need both a language and structural feature to be at R2. The rubric states AND/OR at R2, meaning only one or other is required to be classified at R2. The notes at the bottom of the structure and language notes may be helpful to answer your second question.

1 Some texts may also include the past tense, e.g., if background events to the moment in time are included or if the text is actually a narrative or a recount. Use

of the past tense is acceptable if it does not interfere with the purpose – to describe. Note that, if the text is a narrative or a recount, the structure and language

category is unlikely to be higher than R2.

So in other words you can use as tense in some circumstances, but I have found it generally means they have written a recount or narrative.

To summarise if they write a recount or narrative for this prompt R2 is about as high as you can go. If it is just a straight retelling then likely to be an R1, but if there are attempts to describe you can push them to an R2. Remember with describing words, it is just whether they are there or not, not how good they are. That is dealt with in Vocabulary.

10 of 21

From our Term 1 Discussion

  • The structure and language notes we found interesting due to being allowed to have persuasive features as well. Discussed how much is too much. Exemplars did not give us a clear indication on this point.
  • Interesting to discuss whether some of those more junior texts are one idea with elaboration or many simple ideas on a theme. Exemplars lead us to say that they are many on a theme whereas if it was a more senior piece we were marking it would be one idea with elaboration.
  • Again it has come up around how many precise words (and the type) that is needed in order to progress through the vocab marks. Robust discussion had around the length of the text in order to support what our expectations are. However short texts does not mean that a couple of precise words/adjectives would give you the extra mark.

11 of 21

Sample #1

IndependentlyMARK the sample noting down why you give each mark

Discuss marking taking note of the differences that exist in results

Look at Sample #1 that we will moderate

This is a model you can use back in your school for your school moderation

12 of 21

Writing Sample #1 for Moderation

R1

R2

R3

R4

R5

R6

R7

Notes

Ideas

R3: Nobody likes a mean, horrible, dishonest person. Not enough to strongly show complexity.

Structure & Lang

R3 - Discussion around how many language features they have used: R2 mostly vs R3 some (used exemplar The Erfeh)

Organisation

R5 - basic paragraphs are there and the breaks don’t detract from the message or coherence. (prompt 14 exemplar 2)

Vocabulary

R3 - all every day words and phrases. Discussed horrible, kindergarten, dishonest, not enough. Great discussion over subjectivity and bias as would our knowledge of the age of this student have changed our thinking

Sentence Structure

R3 - speech like, waffley, run on not complex

Punctuation

R3 - punctuation errors in long run on sentences so knowledge is not strong for the few commas they used. Only one other ?

Spelling

R4 - good range of high frequency words but not enough complexity.

13 of 21

Sample #2

IndependentlyMARK the sample noting down why you give each mark

Discuss marking taking note of the differences and justifications that exist in results

Look at Sample #2 that we will moderate

This is a model you can use back in your school for your school moderation

14 of 21

Writing Sample #2 for Moderation

R1

R2

R3

R4

R5

R6

R7

Notes

Ideas

Structure & Lang

Organisation

Vocabulary

Sentence Structure

Punctuation

Spelling

15 of 21

Sample #3

Mark the sample noting down why you give each mark.

Discuss marking taking note of the differences and justifications that exist in results

Look at Sample #3 that we will moderate in pairs

This is a model you can use back in your school for your school moderation

16 of 21

Writing Sample #3 for Moderation

R1

R2

R3

R4

R5

R6

R7

Notes

Ideas

Structure & Lang

Organisation

Vocabulary

Sentence Structure

Punctuation

Spelling

17 of 21

Highlighting Level 1

It is sometimes difficult for teachers to accurately mark writing at Level 1 in the higher years because of student experiences, maturity, developed vocabulary etc.

Let’s delve deeper into this.

18 of 21

Remaining Samples

Collect a sample that you & your partner will moderate together.

Pair up so we can start to collaborate

INPUT MARKS onto the score sheet already attached to the writing.

Discuss marking after 2 or more pairs have marked to disuss consistencies and any inconsistencies

Collect another sample and repeat

19 of 21

Moving forward from today …

  1. For today: Take notice of where you were not in accord with the majority. Figure out why and how you marked differently. Adjust how you mark accordingly.

  • Follow up back at school: Use the same pieces of writing and the same process as we have used today with staff (either as a whole staff meeting or team meetings) at your school, BEFORE sharing the results of the moderation.

  • After your in school moderation meeting, ask teachers at �your school to mark and moderate their learners’ writing, in �line with the rest of the cluster so that it is complete and�entered into easTTle on time!

Data due Friday, 25 November 2022

20 of 21

A Possible School Follow Up …

Once moderation has happened and all writing has been marked, schools should be conducting a further ‘blind’ moderation in order to check consistency of teachers’ judgments once they have made their assessments. This moderation should be conducted by at least two members of staff. Teachers should not be told beforehand which students writing will be looked at; this should only happen on the day of the ‘blind’ moderation. A record should be kept of each piece of writing moderated, the teachers’ judgements and the moderated scores. Reasons should also be given for any inconsistencies.

21 of 21

Follow Up/Things to think about from our Discussions

  • There was a lot of discussion around bias of marking when we know what the student is doing. How do we combat this in our schools?
  • Looking at writing where the handwriting and spelling elements have been removed also cause for an element of bias. As we experienced when we looked at the Level 1 Samples on Slide 17.
  • Vocabulary: Many teachers want a number of “precise” words in order to tick that box but it is not as simple as that and should not be dependent on the quantity of the writing. We spoke about the need for consistency of vocab throughout the writing and not just in a couple of places as well as the need for “enough” writing in order for us to judge this aspect correctly.
  • We spoke about how the age of the student effects what we see as “precise” words and therefore should it?
  • The afternoon session wasn’t as productive as the morning session. Many brains were already exhausted.
  • The 2 hour slot wasn’t enough time to get through everything. If we had to moderate pieces from all schools (not all schools had done their writing samples yet) then we wouldn’t have been able to them all.