1 of 22

Turning Students into Scholars

A New Pedagogical Approach with AI

ETS AI Symposium | University of San Francisco

Mana Azarm, Nicolas Barsi-Rhyne, Andrew Hoang, and Johnathan Cromwell

April 6, 2026

2 of 22

2

Metacognition

Awareness or analysis of one’s own learning or thinking processes

3 of 22

2

Constructing Problems

Generating Ideas (15+ techniques)

Prototyping Ideas

Pitching

Ideas

Simplified Creative Process

4 of 22

2

Generating Ideas (15+ techniques)

  1. Activation
  2. Analogy
  3. Combination
  4. Recategorization
  5. Substitution
  6. Adaptation
  7. Magnification
  8. Putting to another use
  9. Elimination

10. Reversing

11. Subtraction

12. Multiplication

13. Division

14. Trait Dependency

15. Task Unification

16. Exploiting value

17. Expanding value

18. Exploring value

5 of 22

3

OLD: Problem-Solving Exam

3 Major Sections

  • Recall: terms & definitions
  • Analyze: identify concepts in situations
  • Apply: Recognize when to use best techniques

(Following Bloom’s taxonomy)

1 Major Goal

  • Design a creative process that systematically produces higher-quality ideas

(Facilitating Bloom’s taxonomy)

NEW: Theory Competition

6 of 22

8

Our New Tool: PsycSim

www.psycsim.com

Simulation

Interactive whiteboard to design study procedures step-by-step. Control temperature, models, and measures per step.

Measures

Create custom scales with named anchor points. Reusable across simulations for consistency.

Samples

Build AI participant pools from 250+ characteristics: demographics, health, beliefs, and more.

Dashboard

Monitor and manage simulations. Download full datasets as Excel spreadsheets.

7 of 22

9

Example: Creative Process Simulation

Rapid Experiment

8 of 22

10

Example: Designing Measures

Independent Variables

Dependent Variables

9 of 22

11

Example: Designing Samples

10 of 22

12

Example: Designing Samples

11 of 22

13

Example: Data - Personas

12 of 22

14

Example: Data - Problem Formulation

13 of 22

15

Example: Data – Generate Ideas

14 of 22

16

Example: Data – Evaluate Ideas

15 of 22

17

Example: Data – Choose Solution

16 of 22

9d

Example: Results – Step 2 Generating Ideas

Idea Breadth & Depth by Condition

(Step 2: Generate Ideas)

17 of 22

9d

Example: Results – Step 2 Generating Ideas

Idea Novelty & Usefulness by Condition

(Step 2: Generate Ideas)

Idea Novelty

Idea Usefulness

18 of 22

9d

Student Submissions

19 of 22

9d

Student Feedback (Anonymous)

Average: 6.14 / 10

(7.00 / 10)

20 of 22

9d

Student Feedback (Anonymous)

Average: 6.85 / 10

(7.83 / 10)

21 of 22

9d

Student Feedback (Anonymous)

Average: 6.85 / 10

(7.83 / 10)

Average: 7.14 / 10

(8.17 / 10)

22 of 22

10

Key Questions & Feedback

1

How could this tool be useful in your teaching?

2

What features would you like to see to be more useful?

3

Anyone interested in using as a trial next semester?

www.psycsim.com