1 of 74

Unit 2

Unit 2: Ideation and Spatial Storyboarding in AR/VR Experience Design

2 of 74

Syllabus

  • Visual thinking with Mind maps, brainstorming, and collaborative ideation using digital whiteboards
  • Digital whiteboards - Jamboard, Miro, FigJam, Gravity Sketch
  • Creation of spatial storyboards and immersive user journey maps
  • Paper/diorama prototyping to explore scale, reach, and occlusion; translating stories to spatial UI sketches
  • Summarizing concepts into testable use cases and tasks
  • Evaluating ideas based on AR/VR feasibility and user immersion

3 of 74

Learning Outcomes

After completing this unit, students will be able to:

  • Understand ideation in AR/VR experience design
  • Apply visual thinking techniques to generate innovative ideas
  • Use digital whiteboards for collaborative brainstorming
  • Create spatial storyboards and immersive user journey maps
  • Develop paper and diorama prototypes.
  • Translate storyboards into spatial UI sketches
  • Prepare testable use cases for AR/VR applications
  • Evaluate AR/VR ideas based on feasibility and immersion

4 of 74

1. Introduction to Ideation

Ideation is the process of generating, exploring, and refining ideas before developing an AR/VR application.

It helps designers discover creative solutions to user problems.

Definition

Ideation is the creative process of generating multiple ideas to solve a user-centered design problem.

5 of 74

1. Introduction to Ideation: Problem Statement

Problem: Many people cannot visit famous places due to distance, cost, or physical limitations.

User-Centered Ideation

6 of 74

1. Introduction to Ideation: Users

User 1: Tourist

Problem: Wants to explore places before planning a trip.

User 2: Student

Problem: Cannot visit historical places during studies.

User 3: Teacher

Problem: Difficult to explain historical concepts only through textbooks.

User 4: Elderly Person / Physically Challenged User

Problem: Cannot travel easily.

User 5: Tourism Department

Problem: Need to promote tourist destinations.

7 of 74

1. Introduction to Ideation: Generating Possible AR/VR Solutions

User 1: Tourist

Ideas Generated:

  • VR virtual tour of historical places
  • AR navigation guide for tourist locations
  • 360° virtual experience of monuments

User 2: Student

Ideas Generated:

  • VR history classroom
  • AR-based 3D models of monuments
  • Interactive storytelling of historical events

8 of 74

1. Introduction to Ideation: Generating Possible AR/VR Solutions

User 3: Teacher

Ideas Generated:

  • Virtual field trips
  • Immersive history lessons
  • AR-based classroom activities

User 4: Elderly Person / Physically Challenged User

Ideas Generated:

  • VR travel experience from home
  • Virtual museum visits
  • Interactive cultural experiences

9 of 74

1. Introduction to Ideation: Generating Possible AR/VR Solutions

User 5: Tourism Department

Ideas Generated:

  • Digital tourism platform
  • VR promotional tours
  • AR-based tourist information system

Problem: People cannot easily visit tourist places.

Different Users Think Differently

Multiple Ideas Generated:

10 of 74

Why Ideation is Important?

  • Encourages innovation
  • Finds multiple possible solutions
  • Improves user experience
  • Reduces development cost
  • Saves development time
  • Identifies better interaction methods

11 of 74

AR/VR Example

Problem:

Students find machine learning concepts difficult.

Possible ideas:

  • VR classroom
  • Interactive AI laboratory
  • AR textbook
  • 3D visualization
  • AI chatbot inside VR

After ideation, the best solution is selected.

12 of 74

AR/VR Example

13 of 74

2. Visual Thinking

Definition

Visual thinking means representing ideas through diagrams, sketches, flowcharts, sticky notes, or drawings instead of long text.

It makes communication easier.

14 of 74

2. Visual Thinking

Benefits

  • Faster understanding
  • Better communication
  • Easy collaboration
  • Encourages creativity
  • Organizes ideas

15 of 74

2. Visual Thinking: Tools

  • Mind Maps
  • Flowcharts
  • Sketches
  • Sticky Notes
  • Wireframes
  • Concept Maps

16 of 74

3. Brainstorming

Definition

Brainstorming is a technique used to generate many ideas without judging them.

Rules

  • No criticism
  • Encourage wild ideas
  • Quantity over quality
  • Build on others' ideas
  • One conversation at a time

17 of 74

3. Brainstorming

Types

Individual Brainstorming

One person generates ideas.

Group Brainstorming

Multiple members generate ideas.

Reverse Brainstorming

Think about how to create the problem.

Then solve it.

18 of 74

3. Brainstorming

Crazy 8s

Fold paper into eight sections.

Draw one idea in each section.

Time: 8 minutes.

19 of 74

Example

Problem

Improve classroom learning.

Ideas

  • Virtual teacher
  • VR classroom
  • AI tutor
  • Gamification
  • AR books
  • Virtual experiments
  • Smart assessment

20 of 74

4. Digital Whiteboards

Digital whiteboards help teams collaborate remotely.

21 of 74

4. Digital Whiteboards

A) Jamboard (Google)

Features

  • Sticky notes
  • Drawing
  • Images
  • Google Drive integration
  • Collaboration

Advantages

  • Easy to use
  • Good for education

22 of 74

4. Digital Whiteboards

B) Miro

Features

  • Infinite canvas
  • Templates
  • User journey maps
  • Mind maps
  • Voting
  • Collaboration

Applications

  • UX Design
  • Product Design
  • AR/VR Planning

23 of 74

4. Digital Whiteboards

C) FigJam

Created by Figma.

Features

  • Sticky notes
  • Flowcharts
  • Brainstorming
  • Wireframes
  • Team collaboration

24 of 74

4. Digital Whiteboards

D) Gravity Sketch

Special software for designing directly inside VR.

Applications

  • Product Design
  • Automotive
  • Architecture
  • Animation

Advantages

  • 3D sketching
  • Immersive design
  • Natural interaction

25 of 74

Tool

Purpose

Jamboard

Simple collaboration

Miro

Professional brainstorming

FigJam

UX collaboration

Gravity Sketch

3D VR ideation

26 of 74

5. Spatial Storyboarding

What is Storyboarding?

Storyboarding is the visual representation of a user's journey using sequential scenes.

Instead of movie frames, AR/VR storyboards represent immersive interactions.

27 of 74

5. Spatial Storyboarding

Components

  • Environment
  • User Position
  • User Movement
  • Object Interaction
  • Camera View
  • Audio
  • Feedback

28 of 74

Example

VR Shopping

Frame 1: User enters store

Frame 2: Looks at products

Frame 3: Picks product

Frame 4: Examines in 3D

Frame 5: Purchases item

29 of 74

5. Storyboarding

Advantages

  • Better planning
  • Detects usability issues
  • Improves interaction
  • Saves development effort

30 of 74

6. Immersive User Journey Map

User journey map describes every interaction from beginning to end.

31 of 74

32 of 74

33 of 74

34 of 74

35 of 74

36 of 74

37 of 74

38 of 74

39 of 74

Wireframes in Experience Design

  • Definition: A wireframe is a simplified, schematic representation of a digital product’s interface.

Wireframes are a design deliverable used in UX to visualize product interfaces

  • Role: Helps communicate layout, hierarchy, and navigation before investing in full design.
  • Examples: Sketches of a mobile app screen showing buttons, menus, and content placement.
  • Benefit: Allows quick feedback and iteration on usability without heavy design costs

40 of 74

41 of 74

42 of 74

43 of 74

44 of 74

Concept

Meaning

Purpose

Example

Whiteboard

A visual workspace for brainstorming and organizing ideas.

Generate and organize ideas.

Drawing the flow of a food delivery app (Login → Browse → Order → Payment).

Persona

A fictional profile representing a target user.

Understand user needs and behaviors.

Amit, 30, busy office worker, wants to order food quickly with minimal effort.

Spatial

Organizing information based on physical location or layout.

Show where things are located.

Displaying nearby restaurants on a map based on the user's location.

Storyboarding

A sequence of sketches or frames showing how a user interacts with a product over time.

Visualize the user's journey step by step.

Frame 1: Amit is hungry after work. → Frame 2: Opens the app. → Frame 3: Selects a nearby restaurant. → Frame 4: Pays online. → Frame 5: Food is delivered.

45 of 74

One Example: Food Delivery App

  1. Whiteboard (Planning)
    • The team brainstorms and draws the app flow:� Login → Browse Restaurants → Select Food → Payment → Order Tracking�
  2. Persona (Who is the User?)
    • Name: Amit
    • Age: 30
    • Occupation: Software Engineer
    • Goal: Order dinner in under 5 minutes.
    • Pain Point: Doesn't want to spend time searching for restaurants.
  3. Spatial (Where are Things?)
    • The app shows restaurants on a map.
    • Nearby restaurants appear first based on Amit's location.

46 of 74

One Example: Food Delivery App

4. Storyboarding (How Does the User Experience It?)

    • Scene 1: Amit finishes work and feels hungry.
    • Scene 2: He opens the food delivery app.
    • Scene 3: The app shows nearby restaurants on a map.
    • He selects a restaurant and orders a burger.
    • He pays online.
    • He tracks the delivery.
    • The food arrives, and Amit enjoys his meal.

47 of 74

Technique

Key Question

Simple Example

Whiteboard

What ideas do we have?

Drawing the app flow: Login → Search → Order → Pay → Delivery

Persona

Who is the user?

Amit, a busy office worker who wants fast food delivery

Spatial

Where are things located?

Showing nearby restaurants and delivery routes on a map

Storyboarding

How does the user's experience unfold step by step?

A sequence of scenes showing Amit ordering food from start to finish

48 of 74

Aspect

Persona

Mind Map

Definition

A fictional profile representing a target user based on research.

A visual diagram that organizes ideas and their relationships around a central topic.

Purpose

To understand the user's needs, goals, behaviors, and pain points.

To brainstorm, organize, and connect ideas related to a topic.

Focus

The user.

The topic or problem.

Format

User profile with details like name, age, occupation, goals, frustrations, etc.

Central concept with branches and sub-branches of related ideas.

Question it answers

Who is the user?

What ideas or concepts are related?

Stage in Design Thinking

Empathize

Ideate

49 of 74

Tools Information in design Thinking

Relationship Between Persona and Mind Map

50 of 74

Tool

Type

Purpose in UX

Mind map

Ideation tool

Organizes ideas, features, or user needs in a branching structure to show relationships.

Storyboard

Narrative visualization

Illustrates user journeys or scenarios step by step, often like comic panels.

Whiteboard

Collaboration space

Used for brainstorming, sketching flows, and group problem-solving in workshops.

51 of 74

Summary

In simple terms:

  • Whiteboard = Brainstorming ideas.
  • Persona = Understanding the user.
  • Spatial = Organizing by location or space.
  • Storyboarding = Showing the user's journey from start to finish.

52 of 74

Paper/Diorama Prototyping

Paper prototyping is the process of creating a physical model using inexpensive materials before building the actual digital AR/VR application.

Instead of immediately creating a 3D model in Unity or Unreal Engine, designers first build simple paper versions to understand:

  • Space
  • User movement
  • Object placement
  • Interaction flow��👉 Diorama = A small 3D model of a scene or environment.

53 of 74

54 of 74

55 of 74

Why Do Designers Use Paper Prototypes?

Professional companies like Meta, Google, Apple, and Microsoft often begin with paper prototypes before creating digital experiences.

Because they are:

  • Fast
  • Cheap
  • Easy to modify
  • Encourage creativity
  • Reduce development cost

56 of 74

What is a Diorama?

A diorama is a miniature 3D scene that represents a virtual environment.

Example:

Imagine designing a VR classroom.

Solution:

1. Digital

2. Create manually:

  • Classroom walls
  • Desk
  • Teacher
  • Whiteboard
  • Virtual objects

using cardboard and paper.

This allows them to visualize the experience quickly.

57 of 74

58 of 74

Understanding Three Important Concepts

1. Scale

Question: How large should virtual objects appear?

Example:

Should a holographic keyboard be:

  • Hand-sized?
  • Table-sized?
  • Wall-sized?

https://www.youtube.com/watch?v=zNbF006Y5x4&t=2s

https://kholdstare.github.io/technical/2013/10/06/sense-of-scale-vr.html

59 of 74

2. Reach

Reach means:

Can the user comfortably interact with the object?

Example:

In VR,

  • if a button is placed too high, users cannot press it.
  • If placed too far, interaction becomes uncomfortable.��https://www.youtube.com/watch?v=RpcS-NksQnA

60 of 74

61 of 74

3. Occlusion

Occlusion means:

One object blocks another.

Example:

A virtual menu appears behind a table.

The user cannot see it.

This is poor design.

62 of 74

63 of 74

Understanding Three Important Concepts

Activity

Provide students with paper cutouts of:

  • Smartphone
  • TV
  • Door
  • Chair

Ask them:

"Arrange these inside the diorama."

Questions

  • Is the chair too big?
  • Is the TV too small?
  • Can the user comfortably see everything?

Students begin understanding spatial scale.

64 of 74

Activity

Design a VR Museum

Materials:

  • Cardboard
  • Paper
  • Scissors
  • Tape
  • Sticky Notes

Students create:

  • Museum room
  • Art objects
  • Visitor path
  • Information panels

Evaluate:

  • Scale
  • Reach
  • Occlusion

65 of 74

Part 2: Translating Stories into Spatial UI Sketches

A user story describes what the user wants to achieve.

Example:

"As a student,� I want to pick up a virtual book� so that I can read it."

66 of 74

What is Spatial UI?

Unlike mobile apps,

AR/VR interfaces exist in 3D space.

Instead of flat buttons,

we have:

  • Floating menus
  • Holographic windows
  • Voice controls
  • Gesture controls
  • Hand tracking

67 of 74

68 of 74

"A doctor wants to view patient information while performing surgery."

Where should the information appear?

Possible answers:

  • Above the patient
  • Near the doctor's hand
  • Floating beside the bed

Which location is easiest to use?

69 of 74

Part 3: Converting Concepts into Testable Use Cases

A concept is only useful if it can be tested.

Example Concept

"A virtual classroom."

Too broad.

Convert it into use cases.

70 of 74

Use Case 1

Student joins classroom.

Tasks:

  • Wear headset
  • Enter room
  • Select avatar
  • Sit at desk

71 of 74

Use Case 2

Student answers question.

Tasks:

  • Raise virtual hand
  • Receive permission
  • Speak
  • Submit answer

72 of 74

Use Case 3

Student writes on board.

Tasks:

  • Walk to board
  • Pick virtual marker
  • Write
  • Save notes

73 of 74

Criterion

Excellent (5)

Good (4)

Average (3)

Needs Improvement (2)

Scale

Reach

Occlusion

UI Placement

Feasibility

Immersion

Evaluation Activity

74 of 74