1 of 12

SIXTH SENSE

when reality constantly shifts

2 of 12

Sixth Sense Team

Lucas: Programmer/Designer/�SME

Julia: Biosensors/SME

Yiting: Programmer/Designer/�Sound Designer

Destiny: Programmer/Designer/ SME

Tina: Producer/Programmer

3 of 12

Objective

To simulate schizophrenia symptoms in an authentic and respectful way to foster understanding and empathy.

Motivation

Understanding psychosis is critical to effective allyship and interfacing safely with affected persons.

4 of 12

Embodied Schizophrenia Experience

UX: The player takes a walk in the shoes of someone with schizophrenia under the guidance of a benevolent friend. Typical encounters of daily life trigger auditory hallucinations. The player turns to their friend to help find their way through.

Tools:

Platform: Magic Leap 1 (spatial audio, digital objects)

Dynamic dialogue: Google Dialogflow v2

Pulse Sensor: Heart rate monitor

5 of 12

Trigger Scenarios

Everyday �Events

Trigger Hallucinations

Paranoid Thoughts

Self-Deprecating Thoughts

Subliminal Messages

Reality Check

Alarm is real, but non-threatening. Affirms that the player is safe.

Asserts that tools are healthy, juxtaposing voices. Reassures and encourages the player.

Video is real, the targeted messages is not personal. Contextualizes the clip and comforts the player.

6 of 12

Experience Mock Up

7 of 12

The Immersant Experience

8 of 12

From Concept to Application

  • Expand library of trigger events
    • Diversify scenarios for the AR experience
  • Spatial audio + Visual FX
    • Incorporate visual hallucinations
  • Hard coded dialogue → Conversational AI
    • Integrate Dialogflow for dynamic dialogue between the player and companion
  • Postgame biofeedback → Real time visualization
    • Improved design of the heart rate graph for easier readability and engagement

9 of 12

Radical Empathy

Who this is for:

  • First responders
  • Mental health professionals
  • Community members�

Impact on practice:

  • Increased understanding of the daily challenges
  • Greater awareness of the disorder as a lived experience
  • Validate the personal experience for those with schizophrenia

10 of 12

Thank you! <3

11 of 12

References

Academic

12 of 12

References

Firsthand Accounts

Other Resources + Inspiration