1 of 67

Research to Practice: Designing Learning Experiences for Teachers around Reading the Word and the World with Data Visualizations

Travis Weiland

2/26/25 AIDEA

2 of 67

Acknowledgement

  • This material is based upon work supported by the National Science Foundation under DRK-12 Grant #2143816
  • Any opinions, findings, and conclusions or recommendation expressed in this material are those of the author and do not necessarily reflect the view of the National Science Foundation.

3 of 67

Acknowledgement

  • A huge thanks goes out to my research assistance over the years
    • Dr. Anita Sundrani
    • Laura Shelton
    • Mandana Delavari
  • This work could not be done without the help of many teachers who I have had the privilege of working with over the years and who have given their time.

4 of 67

How do I Situate

  • I believe the goal of education is for empowering people to be engaged critical citizens
  • I work at the intersections of:
    • Mathematics education
    • Critical literacy and pedagogy
    • Statistics and statistics education
    • Data science and data science education

5 of 67

Reading the World with Data

Critical Literacy

Data/Statistical Literacy

6 of 67

Critical Literacy

  • Reading and writing the word and the world (Freire & Macedo, 1987; Gutstein, 2006)
  • Reading 
    • Making sense of symbol systems
    • Identifying and interrogating social structures in the world
  • Writing 
    • Creating and communicating one’s own meaning through symbol systems 
    • Actively influencing and shaping structures in society

7 of 67

Statistical/Data Literacy

  • Reading (Gal, 2002)
    • Making sense of and critiquing statistical information and data-based arguments
    • Evaluating the source, collection and reporting of statistical information
  • Writing (Franklin et al., 2007; Lee et al., 2022; Wild & Pfannkuch, 1999) 
    • Frame problem
    • Collect or consider data
    • Process data
    • Explore and visualize
    • Consider models
    • Communicate and propose action

8 of 67

Reading the World with Data

  • R1. Making sense of language and statistical symbols systems and critiquing statistical information and data-based arguments encountered in diverse contexts to gain an awareness of the systemic structures at play in society.
  • R2. Identifying and interrogating social structures which shape and are reinforced by data-based arguments.
  • R3. Understanding one’s social location, subjectivity, political context and having a sociohistorical and political knowledge of self and understanding how it influences one’s interpretation of information.
  • R4. Evaluating the source, operationalization, collection and reporting of statistical information and how they are influenced by the author’s social position, and sociopolitical and historical lens.
  • R5. Interrogating the epistemological and historical underpinnings of statistical practice and how it has shaped data-based discourses and beyond.

9 of 67

Guiding Question

How do we create spaces and experiences for students to read the world with data?

Source: DALL-E

10 of 67

Data Visualization—Data Viz

  • We use an expansive view of what counts as a data visualization
  • Working Definition: A representation of data, in a visual manner, that summaries/syntheses data
  • This then includes:
    • Infographics
    • Maps
    • Tables
    • Etc.

11 of 67

School Education is a Complex System

12 of 67

13 of 67

14 of 67

15 of 67

16 of 67

17 of 67

Problem

How do we get modern data visualization into the mathematics classroom?

Source: DALL-E

18 of 67

19 of 67

But What About the Teachers?

  • Teachers often only take one statistics course in their undergraduate preparation
  • That course is typically only an introduction to statistics courses
  • Guess what graphs they typically include in those courses
  • Therefore, there is a need for teacher education

20 of 67

Research Questions

  • How do we support teachers in developing critical statistical literacies for reading data visualizations common in media and society today?
  • How do we support teachers in providing students with opportunities to experience reading data visualizations critically?

21 of 67

NYT What’s Going on in this Graph

  • Joint venture between the New York Times and the American Statistical Association
  • Designed to help support classroom teachers in having conversations about data visualizations in the media about current issues
  • Each posting includes a notice/wonder prompt to get students making sense of the graph and thinking about and beyond the data
  • Students can also comment on NYT webpage and share that with their instructor and can also join a weekly chat with an ASA statistician about the graphic
  • https://www.nytimes.com/column/whats-going-on-in-this-graph

22 of 67

  • What do you notice?
  • What do you wonder?
  • What impact does this have on you and your community?
  • What’s going on in this map? Write a catchy headline that captures the map’s main idea.

23 of 67

Reading the World with Data

  • R1. Making sense of language and statistical symbols systems and critiquing statistical information and data-based arguments encountered in diverse contexts to gain an awareness of the systemic structures at play in society.
  • R2. Identifying and interrogating social structures which shape and are reinforced by data-based arguments.
  • R3. Understanding one’s social location, subjectivity, political context and having a sociohistorical and political knowledge of self and understanding how it influences one’s interpretation of information.
  • R4. Evaluating the source, operationalization, collection and reporting of statistical information and how they are influenced by the author’s social position, and sociopolitical and historical lens.
  • R5. Interrogating the epistemological and historical underpinnings of statistical practice and how it has shaped data-based discourses and beyond.

24 of 67

To the Literature

Past scholarship has emphasized an explicit focus on reading graphs to support graph comprehension (Curcio 1981; Friel et al., 2001, Shaughnessy, 2007)

 Reading Level

Description

Reading the data 

(Friel et al., 2001) 

Lifting information from the graph to answer explicit questions for which the obvious answer is in the graph 

Reading between data 

(Friel et al., 2001)  

Interpretation and integration of information that is presented in a graph – the reader completes at least one step of logical or pragmatic inferring to get from the question to the answer 

Reading beyond the data 

(Friel et al., 2001)  

Extending, predicting, or inferring from the representation to answer questions – the reader gives an answer that requires prior knowledge about a question that is related to the graph  

Reading behind the data (Shaughnessy, 2007, as cited in Rubel et al., 2016) 

Interpretations of why particular patterns exist in the data as well as questioning the sources of the data, the sampling used to generate it, and other factors

25 of 67

Helpful but Insufficient

  • The reading graph levels framework described by Friel et al. (2001) and Shaughnessy (2007) was helpful but not sufficient
  • Designed to be hierarchical, but did not fit what we saw in data or our perspective on learning
  • Boundary of between and beyond is murky
  • Was missing a critical literacy lens (Freire, 1970; Gutstein, 2006; Gutierrez, 2013). 
  • Drawing from more recent literature (Bailey & McCulloch, 2023; da Silva et al., 2021; Rubel et al., 2016; Rubel et al., 2021)

26 of 67

Reading Data Visualizations

  • We dropped the idea of levels and instead focus on different types of reading
  • The overall descriptions are updated but similar to what was in the original framework

Reading Type 

Description 

Reading the Data 

Locate and extract relevant information from data visualization   

Reading Between the Data 

Find patterns or relationships in the data visualization 

Reading Beyond the Data 

Move beyond the data visualization to making predictions or inferences, answering a question 

Reading Behind the Data 

Making connections between the context and the data visualization including how the context of how that data was collected and represented and how those aspects shape our view of the context 

27 of 67

Habit of Mind

Description

Questioning Sample Size and Methods

Individual demonstrates healthy skepticism regarding the sample, sample size, sampling technique, sampling bias, or lack of information regarding sampling that may lead to invalid inference on a target population.

Recognizing Appropriate Statistics & Appropriate Representations

Individual questions whether the type of statistics and/or the way it is represented is the most appropriate for the data.

Desiring Additional Information

Individual demonstrates a need for additional information to draw a reasonable conclusion.

Acknowledging Alternate Explanations

Individual acknowledges the potential for alternative interpretations for the meaning of findings or different explanations for what caused them

Recognition of One’s Own Sociopolitical/ Critical Consciousness

Individual recognizes how they are integrating their own social, political, economic, etc. understandings to make sense of injustice within the statistical message.

Employing Active Citizenry

Individual is aware of inequities within the statical message. Individual expresses a desire to disrupt and dismantle inequities

28 of 67

29 of 67

30 of 67

Initial Framework

Reading Type

Description

Reading the Word Practices

Reading the World Practices

Reading between the data  

Find patterns or relationships in the data visualization 

  • Identify and discuss the relationships between data representations (i.e. table, graph, dataset, statistics, etc.) 
  • Discussing patterns of relationships identified in the data visualization 
  • Recognizing the types of relationships (correlational or causal) that can be claimed based on the data collection methods 
  • Using personal experiences to discuss how you are interpreting/connecting to the patterns/relationships you see the data visualization 
  • Identifying and questioning how the author has highlighted particular relationships/trends in the data visualization 
  • Reimagining other ways that relationships/trends could be highlighted or visualized 

31 of 67

Pilot Study: Context

  • Context: University is HSI and AAPISI institution. Took place during a master’s level course on teaching statistics and probability
  • Sampling: convenience sampling from a course
  • Participants: 8 practicing teachers. All women – 4 white, 2 biracial white and Latina, 1 biracial Black and white, 1 Black
  • Wanted to use our framework with practicing teachers because they are more likely to be used to teaching and reading data visualizations in a variety of ways.

32 of 67

Data Visualization 1

33 of 67

Data Visualization 2

34 of 67

Data Visualization 3

35 of 67

Study 1: Data and Analysis

  • Data: Participants’ responses to 3 discussion board assignments using data visualizations from the NYT “What’s Going on in this Graph?” 
  • Responses were coded based on the framework we have shared 
  • Both authors coded all the data independently and reconciled for 100% agreement

36 of 67

Question 

WORD 

WORLD 

Reading the Data 

Reading Between the Data 

Reading Beyond the Data 

Reading Behind the Data 

Reading the Data 

Reading Between the Data 

Reading Beyond the Data 

Reading Behind the Data 

What do you notice?   

10 

11 

What do you wonder?   

10 

Create a catchy headline that captures the graph’s main idea.   

13 

What relationship(s) is the author highlighting?  

16 

What is a claim you could make from this data visualization?  

14 

What evidence are you using to make this claim?  

13 

14 

How does this relate to you and/or your community?   

37 of 67

 

WORD 

WORLD 

Participant 

Reading the Data 

Reading Between the Data 

Reading Beyond the Data 

Reading Behind the Data 

Reading the Data 

Reading Between the Data 

Reading Beyond the Data 

Reading Behind the Data 

Haya 

Alice 

Julie 

Danielle 

Jennifer 

Michelle 

Nicole 

11 

Valerie 

TOTAL 

35 

52 

42 

10 

26 

38 of 67

Study 1: Takeaways

  • The type of questions asked lead to different types of reading – useful for curriculum development and teacher educators.
  • We needed to think more carefully about the questions we ask.
  • We needed to think more carefully about the data visualizations we selected.

39 of 67

Practice: Assessing Questions

  • Listed practices by reading type
  • Drew questions from recent literature
  • Drew upon a common practitioner approach in U.S. in creating assessing questions

40 of 67

Reading Type

Description

Practices

Assessing Questions

Reading between the data  

Find patterns or relationships in the data visualization 

  • Identify and discuss the relationships between data representations (i.e. table, graph, dataset, statistics, etc.) 
  • Discussing patterns of relationships identified in the data visualization 
  • Recognizing the types of relationships (correlational or causal) that can be claimed based on the data collection methods 
  • Using personal experiences to discuss how you are interpreting/connecting to the patterns/relationships you see the data visualization 
  • Identifying and questioning how the author has highlighted particular relationships/trends in the data visualization 
  • Reimagining other ways that relationships/trends could be highlighted or visualized  
  • What is the relationship between the variables in this visualization? 
  • What do you think of the difference between the two categories? 
  • What other patterns/trends do you see in the data? 
  • What new information did we just learn?  
  • How do the relationships displayed here compare to your own experiences? 
  • How has the author created the data visualization to highlight relationships/trends?  
  • How could the data visualization be changed to highlight this relationship instead?   
  • How else could you visualize this relationship? 
  • Why do you think the author chose to highlight this relationship? 

41 of 67

Professional Learning Community

  • Community of Practice -- Situated Cognition (Lave & Wenger, 1999)
  • We went back to Freire’s (1974) literacy work
  • Cultural circles
  • Generative themes

42 of 67

  • Representative/Unrepresentative
  • Signal/Noise
  • Certainty/Chance

43 of 67

Study Summer 1: Context

  • 2-week in-person PD summer of 2023 with 8 secondary mathematics teachers
  • focused on critical statistical literacy development 
  • Engaged in a series of DV activities embedded in the PD 
  • “What’s Going on in this Graph” (New York Times, n.d.) 
  • Slow Reveal (Laib, n.d.) instructional routine where aspects of the DV are slowly reveal one slide at a time. 
  • Data sources: teachers’ work samples, transcript from a debrief of the slow reveal DV activity, and written reflections from the end of the sixth day.

44 of 67

Data Visualization Activity 1

45 of 67

Analysis Leads to Revisions

  • In analyzing the data from the first summer we found our framework to be insufficient in places
  • In particular, there seemed to be more dimensionality to reading the world.
  • We went into the literature to make connections

46 of 67

47 of 67

Reading Types 

Reading the Word Practices  

Reading the World  

Personal/Community Practices 

Reading the World   

 Sociopolitical Practices 

Reading the data 

 

Extract information from the data (Friel et al., 2001) 

 

  • To recognize the components of graphs, the interrelationships among these components, and the effect of these components on the presentation of information in graphs (Friel et al., 2001) 
  • To speak the language of specific graphs when reasoning about information displayed in graphical form (Friel et al., 2001) 
  • Looking for oneself in the data (Rubel et al., 2016) 
  • Look for source of data 
  • Look for author/affiliation of visualization 
  • Questioning why an author has highlighted particular aspects of a graph or left them absent  

48 of 67

Reading Types 

Reading the Word Practices  

Reading the World  

Personal/Community Practices 

Reading the World   

 Sociopolitical Practices 

Reading between the data  

 

Find relationships in the data (Friel et al., 2001) 

 

  • To understand the relationships among a table, a graph, and the data being analyzed (Friel et al., 2001).  
  • Finding relationships or trends in the data visualized 
  • Recognizing the types of relationships (correlational or causal) can be claimed based on the data collection methods (Utts, 2003) 
  • Identifying the relationships highlighted in the graph (Rubel et al. 2021) 
  • Making sense of the data visualization in relation to one’s own personal experiences 
  • Questioning how and why the author has highlighted particular relationships in the graph (Rubel et al. 2021) 

 

49 of 67

Reading Types 

Reading the Word Practices  

Reading the World  

Personal/Community Practices 

Reading the World   

 Sociopolitical Practices 

Reading beyond the data 

 

Move beyond the data (Friel et al., 2001) 

  

  • Interpreting information in a graph and answering questions about it (Shaughnessy, 2007) 
  • Predicting outcomes based on reasonable claims made from the graph (Shaughnessy, 2007) 
  • Making claims/inferences based on patterns and trends in the data to a population beyond what is represented in the data.  
  • Making predictions/ claims/ inferences from the data visualizations by drawing upon one’s own personal experiences 
  • Recognition of one’s bias and its impact on interpreting data (modified from Bailey & McCulloch, 2023; Weiland, 2017) 
  • Acknowledging possible Alternate Explanations (Bailey & McCulloch, 2023) 
  • Drawing upon personal experiences facing inequities in the interpretation of the data visualization (Bailey & McCulloch, 2023)  
  • Connecting to one’s feelings/emotions related to the data visualization (Kahn et al. 2022) 
  • Making connections to  alternate explanations of others (Bailey & McCulloch, 2023) 
  • Recognizing the story, the author is trying to tell with this data (Rubel, 2021) 
  • Questioning the author’s motives for telling this story (Rubel et al., 2021) 
  • Identifying structural inequities at play in the interpretation of the data visualization (Bailey & McCulloch, 2023) 

50 of 67

Reading Types 

Reading the Word Practices  

Reading the World  

Personal/Community Practices

Reading the World   

 Sociopolitical Practices

Reading behind the data  

 

Making connections between the context and the data (Shaughnessy, 2007) 

  • Looking for possible causes of variation (Shaughnessy, 2007), based on the context being measured and the way the data was collected 
  • Looking for relationships between variables based on the context 
  • Recognizing appropriate graphs for a given data set and its context (Shaughnessy, 2007) 
  • Recognizing Appropriate Statistics & Appropriate Representations (Bailey & McCulloch, 2023) 
  • Using your knowledge of the context of the data to interpret why particular patterns exist in data as well as data generation process  
  • Using knowledge of one’s community to interpret why particular patterns exist in the data to question aspects of the data generations process  
  • Questioning the investigative process undertaken based on personal experiences/identity 
  • Recognition of the gaps in one’s knowledge [of the context] needed to interpret the statistical message. (Bailey & McCulloch, 2023)  
  • Questioning sample size and methods (Bailey & McCulloch, 2023) and their impacts on inferences (i.e. practical significance vs. statistical significant; effect vs. no effect) (Utts, 2003) 
  • Recognizing when common sources of bias are present in the data collection (Utts, 2003) 
  • Recognizing and questioning the source of the data including what is quantified and how it was measured (Rubel et al., 2021; Weiland, 2017) 

51 of 67

Word

World Personal/Community

World Sociopolitical

Reading the Data 

Reading Between the Data 

Reading Beyond the Data 

Reading Behind the Data 

Reading the Data 

Reading Between the Data 

Reading Beyond the Data 

Reading Behind the Data 

Reading the Data 

Reading Between the Data 

Reading Beyond the Data 

Reading Behind the Data 

Notice, Wonder, Community

9

1

0

3

1

1

5

5

3

9

10

10

Read the Data

0

0

0

0

5

2

3

2

0

2

4

1

Read between the Data

5

1

0

0

0

2

7

4

0

0

4

4

Read Beyond the Data

0

1

0

7

0

0

6

3

0

2

5

2

Read Behind the Data

0

0

0

3

0

0

0

1

0

3

3

5

Reflection

0

0

0

0

0

0

0

0

0

0

0

1

52 of 67

Data Visualization Thread

  • There were nine more data visualization activities thread throughout the week
  • Many were used as launches into data investigations
  • At the end of the second week, we provided guidance as to how to create their own activities

53 of 67

54 of 67

55 of 67

Findings

  • 7 of 8 teachers included ≥1 question associated with each reading type. 
  • All teachers started with, “what do you notice?” and “what do you wonder?”
  • All teachers included questions outside of what we provided

56 of 67

Findings

  • All teachers created a slow reveal DV activity and reported them as a useful activity for their teaching
  • “I like how it built curiosity […] I felt like that that curiosity kept building.”
  • “if a student got that much information at once like they may gloss over it because it's too much to digest at one time. So the fact that it like forced them to analyze like each piece.”

57 of 67

Findings

  • teachers all drew from contexts that were national or global
  • All the teachers pick graphs that were similar to the types of graphs they typically teach in a mathematics class

58 of 67

Study School Year 1

  • Monthly virtual PLC meetings during the 23-24 school year
  • We focused heavily on maintaining and building the community
  • We also focused heavily on translating data visualizations into practice
  • Based on polling our teachers some used data visualization activities but it was spotty

59 of 67

60 of 67

61 of 67

62 of 67

Study Summer 2

  • Delved deep into a locally relevant theme food access identified by a teacher from discussion with her students
  • Invited a local activist/community organizer/expert to discuss the local context of the issue
  • Research team created a spatial data visualization in CODAP to read and then explore

63 of 67

64 of 67

65 of 67

Challenges

  • Collecting data, our data is sporadic for different participants
  • Designing, analyzing, and redesigning all simultaneously
  • Making research-based design frameworks explicit to teachers in useable ways
  • Supporting teachers in translating professional learning to classroom practice
  • Teachers in the U.S. are so overwhelmed right now anything new or different is just another thing on top of everything else.

66 of 67

Thank You

Please reach out anytime for questions or resources

tweilan1@charlotte.edu

67 of 67

References

Bailey, N. G., & McCulloch, A. W. (2023). Describing critical statistical literacy habits of mind. Journal of Mathematical Behavior, 70. https://doi.org/10.1016/j.jmathb.2023.101063

da Silva, A. S., Barbosa, M. T. S., de Souza Velasque, L., da Silveira Barroso Alves, D., & Magalhães, M. N. (2021). The COVID-19 epidemic in Brazil: How statistics education may contribute to unravel the reality behind the charts. Educational Studies in Mathematics, 108(1–2), 269–289. https://doi.org/10.1007/s10649-021-10112-6

Freire, P. (1970). Pedagogy of the oppressed. Continuum.

Freire, P., & Macedo, D. (1987). Literacy: Reading the word and the world. Taylor and Francis.

Friel, S. N., Curcio, F. R., & Bright, G. W. (2001). Making sense of graphs: Critical factors influencing comprehension and instructional implications. Journal for Research in Mathematics Education, 32(2), 124–158. https://doi.org/10.2307/749671

Lee, V. R., Wilkerson, M. H., & Lanouette, K. (2021). A Call for a Humanistic Stance Toward K–12 Data Science Education. Educational Researcher, 50(9), 664–672. https://doi.org/10.3102/0013189X211048810

Lim, V. Y., Peralta, L. M. M., Rubel, L. H., Jiang, S., Kahn, J. B., & Herbel-Eisenmann, B. (2023). Keeping pace with innovations in data visualizations: A commentary for mathematics education in times of crisis. ZDM – Mathematics Education, 55(1), 109–118. https://doi.org/10.1007/s11858-022-01449-0

Rubel, L. H., Nicol, C., & Chronaki, A. (2021). A critical mathematics perspective on reading datavisualizations: Reimagining through reformatting,reframing, and renarrating. Educational Studies in Mathematics, 108, 249–268. https://doi.org/10.1007/s10649-021-10087-4

Shaughnessy, M. (2007). Research on statistics learning and reasoning. In F. K. Lester (Ed.), Second handbook of research on mathematics teaching and learning (pp. 957–1009). Information Age Publishing.

Weiland, T. (2017). Problematizing statistical literacy: An intersection of critical and statistical literacies. Educational Studies in Mathematics, 96(1), 33–47. https://doi.org/10.1007/s10649-017-9764-5