1 of 58

Process over Product in the Age of AI:

Making Thinking Visible in AP Classrooms

July 23, 2026,

To change the photo:

    • Select a brand-approved photo and copy it to your clipboard.
    • On this slide, delete the current photo.
    • Select the image placeholder.
    • Paste the new photo from your clipboard.
    • Right-click and choose Crop to adjust what part of the image shows through the window.
    • Delete these steps if you are sharing this presentation externally.

1

2 of 58

"How do you know learning occurred if AI helped create the final product?"

2

3 of 58

Dr. Marla James

  • Teaching 22 years ~ Online, F2F, Blended
  • Union Catholic H.S. (11-12, 6-16 program & dual enrollment)
  • VHS Learning ~ Instructor, Course Designer
  • Montclair State University
  • Mercer County & Brookdale Community Colleges
  • BA, MJ, MA, additional grad. work Ed. Technology
  • Ed. D., Online Learning Specialization
  • 2024 NJ Non-Public Co-Teacher of the Year
  • Author, Documented Learning: Process over

Product in the Age of AI

3

4 of 58

What if we make the entire learning journey part of the assessment?

Make visible the ecosystem of human thought & AI interaction

4

5 of 58

5

6 of 58

“Evaluate the extent to which the First Amendment protects controversial speech in the United States.”

  • "Which paper deserves the highest score?"

Student A: The First Amendment protects controversial speech because free expression is a cornerstone of American democracy. Supreme Court decisions such as Tinker v. Des Moines and Texas v. Johnson have reinforced the idea that speech cannot be restricted simply because it is unpopular. While there are limits to speech, including threats and incitement, most controversial expression remains protected. These protections encourage political participation and the exchange of ideas. Therefore, the First Amendment provides broad protections for controversial speech in the United States.

6

6

7 of 58

“Evaluate the extent to which the First Amendment protects controversial speech in the United States.”

  • "Which paper deserves the highest score?"

Student B:The First Amendment generally protects controversial speech, although the Supreme Court has identified specific exceptions. In Texas v. Johnson (1989), the Court ruled that flag burning constituted protected symbolic speech. Similarly, Tinker v. Des Moines (1969) affirmed that students retain constitutional rights in school settings. However, speech that creates a true threat or incites imminent lawless action may be restricted. By balancing individual liberty with public safety, the Court has maintained broad protections for controversial expression while recognizing necessary limitations.

7

7

8 of 58

“Evaluate the extent to which the First Amendment protects controversial speech in the United States.”

  • "Which paper deserves the highest score?"

Student C: Controversial speech receives substantial protection under the First Amendment because democratic governments depend on open debate. Supreme Court decisions such as Texas v. Johnson demonstrate that even speech many citizens find offensive remains protected. However, the Court has distinguished controversial speech from speech that presents immediate danger, including incitement and true threats. These distinctions attempt to preserve both liberty and public order. As a result, the First Amendment protects most controversial speech while allowing limited restrictions in exceptional circumstances.

8

8

9 of 58

Which student appears to have learned the most?

Student A

Student B

Student C

  • Who will you vote for?
  • How confident are you?

9

10 of 58

What IF?

Student A:

✓ Final essay only

No notes

No draft history

No planning document

No reflection

No evidence of process

Student B:

✓ Final essay

✓ ChatGPT-generated outline

✓ One draft

✓ Reflection:

"I used AI to generate an outline and then rewrote the response in my own words.“

Limited evidence of thinking or revision.

Student C:

✓ Final essay

✓ Initial handwritten brainstorm

✓ AI conversation showing question refinement

✓ Source evaluation notes

✓ Three drafts

✓ Revision commentary

✓ Two-minute video reflection explaining changes

Excerpt from reflection:

"My first draft focused only on free speech protections. After reviewing the cases, I realized the prompt required analysis of limitations as well. I revised my argument to address both constitutional protections and exceptions."

10

11 of 58

Which student provides the strongest evidence of learning?

  • The final product alone did not reveal who learned the most.
  • Documented learning makes thinking visible.
  • Learning becomes observable.
  • Assessment becomes evidence-based.

C

11

12 of 58

Process over Product in the Age of AI: Making Thinking Visible in AP Classrooms

Evidence Sorting Activity

AP Specific Applications

Redesign

Necessity of Alternatives to AI Bans

Assessment Framework

What Documented Learning Looks Like

*NOTE: This slide includes animation.

Once you enter your content into the text placeholders, you can see the animations in the Slide Show view.

Each mouse click will move the rolling agenda function forward.

Please delete these steps if you are sharing this presentation externally.

1.

2.

3.

4.

5.

6.

12

13 of 58

2024 Annual Work Trend Index

World Economic Forum, 2025

86% of kids 9-17 use or interact with AI; 52% use it weekly

Common Sense Media, 2026

13

14 of 58

AI readiness Report -- Pearson

14

15 of 58

AI in the Workforce:

15

16 of 58

16

17 of 58

17

18 of 58

What Documented Learning Looks Like:

Moving from the Product-Obsessed Assessment to

Process-Driven Learning

18

19 of 58

It captures three critical layers of cognition:

3. The Final Output & Reflection (Articulating how & why decisions were made.)

2. The AI Interactions & Edits (Prompting, Vetting, Refining)

1. The Human Ideation & Strategy (Brainstorming & Early Drafting)

19

20 of 58

20

21 of 58

21

22 of 58

Students document the process as they work—not afterward.

Teachers sample evidence rather than grading every artifact.

Rubrics shift emphasis from policing AI to evaluating thinking.

22

23 of 58

23

24 of 58

Research Log:

24

25 of 58

AI Iteration Trail:

25

26 of 58

Synthesis Matrix:

quotes, summaries, key points, paraphrases

26

27 of 58

Summative/Reflective Videos:

For Paper 3, you created two research questions in 11-1 and refined them in 11-2. In your research journals, you analyzed 6 sources and identified key points and quotes/paraphrases and summarized the authors' ideas. In your synthesis matrix, you determined the information in each source that aligned with your paper's themes. In paper 3, you used that information to help support your claim (composed along with your synthesis matrix).

For this assessment, you will add audio/video narration to your 14-2A slide presentation. The narration should analyze your research journey. Subsequently, you will end by responding to a set of digital defense questions in Canvas using Lockdown Browser.

  • Slide 1: Title Slide
  • Slide 2: Research questions
  • Slide 3: Search Terms
  • Slide 4: Thesis Statement (show revision sequence)
  • Slides 5, 6, 7, 8: Evidence from each source to support your claim
  • Slides 9, 10: Two different comparisons between sources (use points from your synthesis matrix)
  • Slide 11: Works Cited/Reference List

27

28 of 58

Provide Rubric

Excerpt: Scale to 0

Also includes:

  • Use of Evidence in Narration
  • Comparative Reasoning
  • Clarity, Pacing & Professional Tone
  • Length & Timeliness

28

29 of 58

Process Portfolios

Artifacts to include: (Vary by YOUR requirements)

□ Initial brainstorming notes

□ AI conversation screenshots

□ Research matrix

□ Annotated bibliography

□ Teacher conference notes

□ Draft 1

□ Draft 2 with peer comments

□ Final paper

□ Revision reflection

□ MLA Works Cited

"What evidence of learning do you see here?"

29

30 of 58

30

31 of 58

Does this mean everything has to be a “research paper”?

31

32 of 58

“Documented Learning” can culminate in many different products while preserving rigorous research expectations. ��

The research process remains constant.

The final product changes.

32

33 of 58

**We are assessing the quality of the research process—not loyalty to a single product.

Projects should require students to:

  • Develop a research question
  • Locate and evaluate primary and secondary sources
  • Document AI interactions and revisions
  • Fact-check AI-generated content
  • Reflect on research decisions and learning
  • Cite evidence using appropriate academic conventions

Possible final products:

  • Interactive website or digital exhibit
  • Comic strip with historical annotations
  • Book Creator multimedia book
  • Podcast or audio documentary
  • Guided virtual tour
  • Interview or discussion panel
  • Interactive slide presentation
  • Digital story or documentary

33

34 of 58

Students Use AI as a Collaborative Partner—not a Substitute

Historical Discussion Panel

  • Use Gemini to generate an initial dialogue among historical figures.
  • Research primary and secondary sources to verify every claim.
  • Revise inaccurate or unsupported statements.
  • Ask AI to generate counterarguments from opposing perspectives.
  • Annotate every revision and explain why changes were made.
  • Finish with a written or video reflection.

Interactive Historical Tour

  • Become a tour guide for a historical location or event.
  • Build the tour in Slides, Book Creator, or Adobe Express.
  • Create narration with NotebookLM Audio Overview or Soundtrap.
  • Include maps, artifacts, images, and source citations.

Digital Comic or Graphic Narrative

  • Tell a historical event through sequential art.
  • Research before illustrating.
  • Include evidence callouts or source annotations.
  • Explain how historical accuracy shaped creative decision

34

35 of 58

Innovative Ways Students Can Demonstrate Learning

Research That Students Can Hear, Watch, Experience, and Interact With

Audio Experiences

  • Historical podcast
  • Interview with a historical figure
  • Museum audio guide
  • Soundtrap production
  • NotebookLM-generated audio (analyzed and revised by students)

Interactive & Multimedia Projects

  • Adobe Express (formerly Adobe Spark)
  • Adobe Express with Firefly image generation
  • Book Creator
  • Interactive timelines
  • Digital museum exhibits
  • Google Earth storytelling

Cross-Disciplinary Research

  • Investigate the cultural history of a traditional recipe.

Examples:

    • Trace the journey of the black-eyed pea through the African diaspora using Google Earth.
    • Research the historical origins of haggis and connect it to the Battle of Culloden.
    • Create an interactive story combining geography, history, food culture, and primary sources.

35

36 of 58

What to include:

  • Research log
  • AI interaction log
  • Annotated revisions
  • Reflection on learning
  • Bibliography

36

37 of 58

The Product May Change......The Research Process Does Not.

The paper is no longer the assignment. Research is. The paper is simply one possible expression of documented learning.

Question

Research

Evaluate Sources

Use AI Critically

Fact Check

Revise

Reflect

Choose the Best Medium

Share Learning

37

38 of 58

38

39 of 58

By Discipline:

  • APUSH
    • annotated DBQ sourcing
    • AI-assisted contextualization
  • AP Literature
    • AI-generated alternate thesis
    • student critique
  • AP Biology
    • documenting hypothesis revisions
  • AP Seminar
    • source vetting log

39

40 of 58

40

41 of 58

LEQs & SAQs: Scaffolding Process

Fact Check & ANNOTATE!

Sarah’s CCOT Map:

41

42 of 58

Excerpt from Sarah’s Reflection: “…AI argued that the 'domestic sphere’

stayed the same for everyone. This is historically inaccurate; poor and

immigrant women couldn't afford to remain in a home sphere. I revised my

1860 map to emphasize class differences…"

Sarah’s AI stress-test critique demonstrates authentic historical analysis. She identified an inaccuracy in the AI's generalization on the “Cult of Domesticity” and contrasted it with the reality of working-class immigrants.

42

43 of 58

Stimulus-Based Writing Assessment >>

We’re not grading AI use; we’re grading evidence of thinking!

43

44 of 58

44

45 of 58

12-Minute Challenge >> “If students are assigned rigorous research, but do not write a traditional paper, what could they create instead?” (Work with someone near you)

  • What could students create instead of a paper?
  • Which format would best showcase their learning?
  • How could AI support, but not replace, the thinking?
  • What documentation would make the learning process visible?

Step 1: Together, identify 1 research assignment you currently teach (or have taught).

Step 2: Reimagine the Product, Without reducing the academic rigor, redesign the final product.

45

46 of 58

15-Minute Challenge >> “If students are assigned rigorous research, but do not write a traditional paper, what could they create instead?” (Work with someone near you)

Examples of evidence:

  • Research log
  • AI conversation log
  • Annotated bibliography
  • Source evaluation notes
  • Draft history
  • Reflection Video
  • Peer feedback
  • Revision annotations
  • Oral defense

Step 3: Identify 3 pieces of evidence students would submit to document their learning.

Step 4: Share with everyone. Post your idea to Padlet.

46

47 of 58

Padlet QR Code

47

48 of 58

Review Colleagues Posts on Padlet:

Which idea could you implement tomorrow?

Which products naturally encourage deeper thinking?

Which documentation strategies would give you greater confidence that students actually learned?

“If students can demonstrate deep learning through many different products, should the research paper remain our default—or simply become one option among many?”

48

49 of 58

49

50 of 58

50

51 of 58

51

52 of 58

52

53 of 58

53

54 of 58

54

55 of 58

55

56 of 58

“To succeed in this ever-changing world, each student needs to be dynamic.

Their capacity to embody adaptability and enthusiastically create will be their

life raft in the sea of change” (James, 2026).

56

57 of 58

We cannot continue assessing

invisible thinking in an age

when visible products can be

generated instantly.

57

58 of 58

Thank You!�Marla

Dr. Marla James

mjames@unioncatholic.org

QR Code

Google File Link

To learn more::

All original images created using NotebookLM and Google Gemini. Stock images courtesy of Pixabay.

58