DATA CHATS: �LEARNING SERVICES� �National Assessment of �Educational Progress:�FRAMEWORKS��https://tinyurl.com/4vwe84dy

SETTING THE STAGE:

The National Assessment of Educational Progress (NAEP) is the largest continuing and nationally representative assessment of what our nation’s students know and can do in core subjects.

​

A survey designed to produce national, state, and select urban district level results.

• NAEP results are for populations of students, not for individual students nor schools.
• Measures student performance nationally and reports changes over time.
• Allows comparisons between states and the nation.

​

NAEP is a required assessment for Arkansas schools

​

What data are you presenting? NAEP Background

SETTING THE STAGE:

NAEP is administered over a six-week period (+4wks for 2022)

• From January - March
• Each student is only assessed in one subject area.
• Students only take a small portion of the assessment.
• Accommodations are provided as necessary for students with disabilities and English language learners.

​

NAEP Results are reported in two formats

• Average Scale Scores
• Numeric scale
• 0 − 500 on mathematics and reading assessments
• Scores cannot be compared across content areas
• Achievement Levels
• Categorical scale
• NAEP Below Basic, NAEP Basic, NAEP Proficient, NAEP Advanced

​

What data are you presenting? NAEP Background

NAEP ASSESSMENT SCHEDULE:

NAEP Frameworks Overview:

• NAEP frameworks are written for large-scale assessment, are curriculum neutral, and reflect aspirations for what all students should know and be able to do.�
• Each NAEP framework describes:
• What is to be measured, �i.e., the content that will be assessed for the subject area;
• How it will be measured, �e.g., the format of each NAEP assessment, the knowledge and skills to be assessed at grades 4, 8, and 12, sample items for each grade, weighting of the item pool, provision of ancillary materials, uses of technology, etc.;
• How much content knowledge and skills are required for NAEP Basic, �NAEP Proficient, and NAEP Advanced performance, �i.e., how much of the content domain students should know and be able to do for each NAEP achievement level.�i.e., Item map analysis

​

NAEP Frameworks:

ZOOMING IN:

NAEP Mathematics Frameworks (2026, 2026 with comments)

Chapters:

1. Background, visioning and development process, test design, framework layout, contextual variables

2. Content Areas, Item Distribution, Objectives and organization, revisions of the 2017 content objections

3. NAEP Mathematical Practices in representing, abstracting and generalizing, justifying and proving, mathematical modeling, and collaborative mathematics (pg 49)

4. Overview of Assessment Design: types of tasks, items and supporting tools, matrix sampling, balance of the assessment

5. Legislative provisions, math-specific contextual variables

Appendices: items illustrating the achievement level descriptions for grades 4, 8 and 12

​

NAEP FRAMEWORKS

ZOOMING IN:

NAEP Reading Frameworks (2026)

Chapters:

1. Background, Reading in digital environment, updates to the framework, comprehension targes, comparison to the 2009-2019

2. Definition of Reading comprehension, key terminology, roots of the definition, updating the framework, contexts and purposes, texts, universal design elements

3. Situating readers in an assessment block, selecting texts and developing items, role of item response options and process data

4. Reporting reading 2026 results, achievement levels, reporting categories by disciplinary contexts, reader characteristics

Appendices: Policy definitions, items illustrating the achievement level descriptions for grades 4, 8 and 12, block sketches

NAEP FRAMEWORKS

ZOOMING IN:

NAEP Science Frameworks (2019, 2028 version expected in summer)

Chapters:

1. Challenges of framework, comparison of 1996-2005 and 2009-2019 frameworks

2. Organization and interpretation of science content, physical science, life science, earth and space sciences, assessment items, connecting content to practices

3. Identifying and using science principals and inquiry, using technological design, performance expectations, generation and interpretation of items, learning progressions, cognitive demands

4. Assessment item contexts, types of items, distribution of items, SD and ELL

Appendices: National Standards and Benchmarks, nature and practice of science, incorporates key attributes of effective assessment, achievement level descriptions for grades 4, 8 and 12

​

​

NAEP FRAMEWORKS

How to use the NAEP Frameworks?

Consider NAEP frameworks as guidelines when you revise state or district curricula.

• NAEP frameworks present and explain what experts in a particular subject area consider important.

​

• Each framework contains a subject outline that describes what students at grades 4, 8, and 12 should know and be able to do in that NAEP content area.

​

• The frameworks also provide specific examples of challenging objectives and sample test questions to illustrate the content standards.

​

• This information may serve as a "road map" to help teachers and curriculum planners evaluate and revise current state or district standards.

EXAMINING THE RESOURCES:

HOW OTHER STATES USE IT:

• Created one page summary maps for each of the state-level resources: Math (gr 4, 8), Reading (gr 4, 8)
• Math (Course of Study) and ELA created a 1-12 grade mapping between the NAEP framework and their state standards

​

​

​

ALABAMA

UNDERSTANDING THE FINDINGS:

WHAT ARE THE POSSIBLE IMPACTS OF THE FRAMEWORKS?

1. What are the benefits and disadvantages of using the current NAEP frameworks as a resource during our standards revision?

​

2. How can the NAEP frameworks be used to assist with the transition to the new state assessment implementation?

​

3. Many of the frameworks were finalized prior to and during COVID. How does that impact the frameworks’ relevance?

​

4. How can the Frameworks help you? As an educator? ADE employee? An administrator?

DATA CHATS: �LEARNING SERVICES� �National Assessment of �Educational Progress:�FRAMEWORKS��https://tinyurl.com/4vwe84dy

NAEP Mathematics Framework:�

NAEP Science Framework: (Conversations June 29, 2021; NAGB panel discussion March 2022):�

THANKS

PLEASE PROVIDE FEEDBACK THROUGH THE FOLLOWING LINK:

https://forms.gle/tCHtwmVYhN34xD5j7

CREDITS: This presentation template was created by Slidesgo, including icons by Flaticon, and infographics & images by Freepik

How to use the NAEP Frameworks?

3. Use released NAEP constructed-response questions and their corresponding scoring guides, along with the frameworks, as models of how to use innovative, challenging assessment practices that measure a given framework skill.

​

The sample scoring guides may help teachers improve the way they score student responses.

​

EXAMINING THE RESOURCES:

Conceptualizes reading as a dynamic cognitive process

Reading is an active and complex process that involves:

• Understanding written text;
• Developing and interpreting meaning;
• Using meaning as appropriate to type of text, purpose, and situation.

This definition applies to the assessment of reading achievement on NAEP and is not intended to be an inclusive definition of reading or of reading instruction.

NAEP Reading Frameworks

How to use the NAEP Frameworks?

2. Use the NAEP frameworks to evaluate how classroom instruction and assessment focus on each cognitive level.

​

• Frameworks frequently provide research-based information on important higher-order skills that students should master at each grade level.

​

• For example, by studying the mathematics framework teachers might see that most of their instruction in measurement addresses only procedural knowledge such as the ability to apply formulas for perimeter and area.

​

• The NAEP framework may assist teachers in expanding their level of instruction to include more complex problem-solving exercises at a grade-appropriate level.

​

EXAMINING THE RESOURCES:

NAEP Mathematics Frameworks

• Distribution of items by content:

​

​

​

​

​

​

​

​

• Sample questions and layout

21

Item Map

• Item Map analysis help readers understand student performance.
• Example questions are “mapped” onto the NAEP scale for that subject
• More difficult questions at the top of the map
• Easier questions at the lower part of the map.
• Complete scale range 0-500 (math, reading).

​

22

Item Map- Mathematics, grade 4

• AR, 2019 Gender
• Male (left)
• Female (right)
• IM link

NAEP Questions Tool

24

https://nces.ed.gov/NationsReportCard/nqt/Search

NAEP Questions Tool- Search

25

HSTI 2019 presentation: Innovative Digitally-Based Assessments

Resources and Digging into the Data:

• ADE: DESE NAEP website
• AR NAEP 2019 Highlights
• AR NAEP 2019 Mapping Study
• The Nation’s Report Card
• NAGB Schedule of Assessments
• NAEP Data Explorer (state trends, Long Term Trends, High School Transcript Study, National Indian Education Study)
• NAEP Questions Tools (search questions, create tests)
• NAEP Item Maps
• International Association for the Evaluation of Educational Achievement (IEA)
• Progress in International Reading Literacy Study (PIRLS)
• Program for International Assessment (PISA)

​

JOIN THE CONVERSATION

DEVELOPING AN ACTION PLAN:�What is a plan for addressing found issues?

Plan:

MEASURING SUCCESS:

HOW WILL WE KNOW IF PROGRESS IS BEING MADE?

1.

2.

3.