1 of 89

HACKATHON

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

2 of 89

The Brief

01.

HACKATHON

DOGSTUDIO

2023

3 of 89

Immersive and Accessible

We’re looking for an experience that leverages AI for the Apple Vision Pro headset, and provides an accessible entertaining experience to users with low mobility.

THE BRIEF

Our brief was short and sweet, giving us so many opportunities for a cool and usable experience.

But to fully grasp the concept and create something new, we began with an initial research phase to understand the product and empathize with our users.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

4 of 89

Research

02.

HACKATHON

DOGSTUDIO

2023

5 of 89

Apple Vision Pro

02.1

HACKATHON

DOGSTUDIO

2023

6 of 89

Dazzling Displays

RESEARCH

Of course the Apple Vision Pro (AVP) will be no different than it’s competitors in offering stunning visual displays. But where AVP shines is how easy it is to integrate into your daily life using the apps you love.

Unlike other AR/VR headsets, AVP will enhance apps by seamlessly adapting with your surroundings. That means goodbye to those dual monitors and hello to infinite display possibilities.

AVP immerses your field of vision in three ways:

  • Windows – aka standard app usage
  • Volumes – aka 3D object interaction
  • Immersive Spaces – aka your surroundings are transformed

Fig.1. Several ways to display 3D content

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

7 of 89

Precise Inputs

RESEARCH

When we want to interact with something, we look at it – and APV is harnessing this concept with indirect inputs to make that ‘click’ action. However for users that might find it tricky, we can always use the good ‘ol keyboard, trackpad or mouse in tandem with AVP.

There are three different ways to interact with AVP:

  • Indirect Input – aka your eyes and hands are the ‘mouse’
  • Direct Input – aka you are ‘touching’ the items displayed… like typing on a virtual keyboard
  • Keyboard Input – aka you are using a regular keyboard, mouse or trackpad to interact

Fig.2. Icons on AVP

Fig.3., Fig.4., Fig.5., Input types on AVP

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

8 of 89

Intuitive Gestures

RESEARCH

The Apple Vision Pro is going to be a revolutionary tool. But Apple is making it easy to pick up and play by utilizing current gestures from their suite of products. Those gestures combined with your eyes to make selections are where the magic happens in interactions.

You can utilize the following gestures in visionOS:

  • Touch
  • Touch and hold
  • Touch and drag
  • Double touch
  • Swipe
  • With two hands, pinch and drag together or apart
  • With two hands, pinch and drag in a circular motion
  • Custom

Fig.6., fig.7., Intuitive gestures in action on AVP

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

9 of 89

Immersive Audio

RESEARCH

AVP has perfected how sounds are heard in any experience. With Spatial Audio, sounds feel like they’re coming from your surroundings. And with audio raytracing, AVP analyzes your room’s acoustic properties — including the physical materials — to adapt and match sound to your space.

Fig.8. Spatial Audio System of the AVP

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

10 of 89

Advanced Mapping

RESEARCH

The high-resolution cameras built into the bottom of the Apple Vision Pro goggles hold key detecting technologies to understand what is around you. The LiDAR Scanner and TrueDepth camera work together to create a fused 3D map of your surroundings, enabling AVP to render digital content accurately in your space.

Fig.9. AVP 3D mapping technology

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

11 of 89

And so much more

RESEARCH

More exciting features to be aware of – even if we aren’t utilizing them in our proposal:

  • Works seamlessly with Mac/Macbook to bring apps into your space
  • Engage with 3D files using your hands
  • Environments magically transform your surroundings with stunning landscapes
  • Immersive Videos are 180-degree 3D 8K recordings captured with Spatial Audio — putting you inside the action.
  • Persona is a dynamic, natural representation of your face and hand movements while you’re using FaceTime.
  • Shareplay lets you use facetime and other apps together seamlessly.

Shareplay

Fig.10. Shareplay within the AVP

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

12 of 89

Audience

02.2

HACKATHON

DOGSTUDIO

2023

13 of 89

Low-Mobility Functionality Focus

RESEARCH

AVP’s accessibility goes above and beyond for multiple types of disabled users – vision, hearing, cognitive and/or mobility.

VisionOS will be released with these practical mobility features aimed to specific motor needs:

  • Dwell Control – allows the user to activate specific touch controls with their eyes
  • Pointer Controls – allows users to to switch the trigger from their eyes to their head, wrist or index finger
  • Switch Control – lets you switch the control from eyes/hands to just a regular keyboard to navigate
  • AssistiveTouch – provides alternative navigation methods and touch gestures for people with physical impairments.

Dwell Control Menu

Pointer Control Menu

Fig.11., Fig.12. Dwell and Pointer Control Menu on AVP

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

14 of 89

Immersive Tech on User Mentality

RESEARCH

There’s been some good studies conducted on what AR/VR provides for users – and this tech hits users on an emotional, educational, physical and/or geographical level:

  • Users feel very attached to their realistic avatars, making it easier to empathize with them in the experience.
  • Users can now get a taste of exciting experiences that they might not be able to attend due to their location or physical limitations
  • Users in immersive experiences have higher retention rates and feel a greater impact from the experience.
  • Immersive technologies are uniquely positioned to overcome the limitations of physical space to create more accessible, equitable experiences to users

Fig.13. AVP Immersive 3D

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

15 of 89

Feeling included is important!

RESEARCH

Whilst web-accessibility standards are struggling to get better year on year - a personal device such as the AVP should do better from day one.

Everyday someone with a disability will face challenges the abled take for granted. For example

  • How do I get to and from work?
  • Does the store have a ramp and elevator access?
  • How long will this take with the extra assistance I need?
  • Will my chair fit under the table?

In the end, these users want (and deserve) to get the same enjoyments of life as everyone else.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

16 of 89

Ideation

03.

HACKATHON

DOGSTUDIO

2023

17 of 89

💞

UX Considerations

IDEATION

01

Empathy

Really putting ourselves in the users shoes as to how they are feeling when they are interacting with idea

♿️

02

Accessibility

Utilizing best standards and built in functionality/accessibility options for the tech used for the idea

⚙️

03

Practicality

Understanding the goal the user want to achieve with the idea

🏗

04

Usability

Focusing on the potential flow or navigation of the idea

😌

05

Simplicity

Making sure that the idea is easy-to-use with limited functions

During the ideation phase, we kept in mind:

HACKATHON

DOGSTUDIO

2023

18 of 89

🤩

Design Considerations

IDEATION

01

Visual

Maintaining consistency with Apple's design language while embracing the opportunity to create an immersive experience. We have to keep the target audience in mind, keeping a user-friendly feel.

🎧

02

Audio

Considering how we use the spatial audio feature to our advantage, while ensuring easy and intuitive interaction.

🦄

03

AI & Technology

Acknowledging the power of AI for utilizing algorithms to adapt the app's behavior and interface based on the individual needs and preferences of users with low mobility.

🥽

04

AVP Technology

Leverage the LiDAR scanner and TrueDepth camera capabilities of the Apple Vision Pro headset to accurately detect and interpret user gestures and movements.

☝️

05

Interaction

Explore different interaction methods beyond traditional touch gestures,

And how this affects the design.

During the ideation phase, we kept in mind:

HACKATHON

DOGSTUDIO

2023

19 of 89

ChatGPT to get the ball rolling

IDEATION

With all that research, it was time to put on our thinking hats and figure out where we were going to go. We had a handful of initial thoughts, but want to make sure we exhausted more possibilities…

Cue ChatGPT! We asked for ideas around apps for people with specific disabilities like vision, hearing, cognitive and low mobility to gain insight.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

20 of 89

Validation with Who/What/Why/How

IDEATION

Together we did a little voting on the prompts, then we went right into expanded on the most loved ones to check the validity of the idea.

To relate back to our user and technology research, we expanded with the WWWH format:

  • Who – more precise user demographics on who interacts with the app
  • Why – inklings as to why the user wants to interact with the app
  • What – predefining what the app actually does
  • How – how does the user physically interact with the app

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

21 of 89

Picking one path

IDEATION

The hardest part was picking just one idea to continue to building upon. We had a good chunk of ideas in the entertainment category, but we wanted to provide more to these users.

Looking at where we were, we all loved the concept of visually manipulating sounds, as it showcases the AVP and a lot of its features. But what about our users? What do they want to do with this concept?

This is where we started to do a little extra research into WWWH the user would be interested in visualizing sounds. That’s when it hit us… we had been talking about music this whole time.

Once we identified this musical concept, more ideas started unravelling and paving a clear path forward.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

22 of 89

Proposal

04.

HACKATHON

DOGSTUDIO

2023

23 of 89

Who

04.1

HACKATHON

DOGSTUDIO

2023

24 of 89

Youths interested

in starting music

Ace

PROPOSAL

First and foremost, AVP is rated for users 13+ so we’re talking about teens when we say youths 😉

But to set the scene, imagine yourself as Ace. He’s an only-child with a stay-at-home single mom and he’s just doing his best with the circumstances his short life has given him. Being bound to a wheelchair since childhood has made life already difficult to navigate, and making friends not any easier. Especially now with being home-schooled to help with his autism and easing the added stress from classmates, he feels alone and out of place in this world.

Music has always been an escape for him – whether to de-stress or get happy, he feels a connection with it. Deep down, he’s always wanted to get more musically involved, but with his life the way it is, he’s never been able to pursuit it further.

Age

15 years old

Identifies as

Male

Location

Memphis, Tennessee

Family

Has a single-mother, no siblings

Profession

Student, home-schooled since COVID-19

Disability

Paraplegia and partial paralysis of left arm,

Mild autism (ASD Level 1)

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

25 of 89

Adults who have musical know-how

Clarie

PROPOSAL

Adults can also engage whether they are beginners or have a little experience.

But to set the scene, imagine yourself as Claire. She works remotely as a Sr Customer Service Rep. She likes her job, as she’s always enjoyed people, but as her Multiple Sclerosis (MS) progresses doing an on-site job becomes more and more challenging. So she working with what she’s able to do to keep her independence.

Claire has a handful of close friends that support her and are able to assist her when she needs it. But even with the support, having ways to unwind, and entertain herself are a struggle. Before her MS diagnosis, she used to play clarinet in the school band… and it’s something she misses a lot.

Age

30 years old

Identifies as

Female

Location

Phoenix, Arizona

Family

Single, never married

Profession

Senior Customer Service Rep, Remote

Disability

Beginnings of paralysis due to

Multiple Sclerosis

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

26 of 89

Why

04.2

HACKATHON

DOGSTUDIO

2023

27 of 89

Music is emotional

PROPOSAL

Music effects humans in a very deep way. Research has suggested that music can aid people in longevity and intensity of strenuous exercise, promote relaxation, and refine motor skills.

It alters the body’s response to physical tasks… aka get us feeling any which way – and that’s the best part of it. Whether you’re someone who uses music to concentrate or boost your mood, there’s no wrong answer here. It’s a universal language that doesn’t even need words.

=

❤️‍🔥

🎶

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

28 of 89

Music is creative

PROPOSAL

Playing a dual lens with emotions is the concept of creativity. Music provides a creative, expressive outlet to help relieve stress and anxiety – it’s freeing.

Music also aids in developing imagination which helps develop innovative and creative thinking – as it helps to visualize images and scenarios in the mind while listening.

=

🎨

🎶

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

29 of 89

Music is educational

PROPOSAL

Research has also found a causal link between music and spatial intelligence, which means that understanding music can help children visualize various elements that should go together, like they would do when solving a math problem.

There is also the case of music aiding to brain stimulation to support memorization skills. Why do we all remember lyrics to songs? This is why.

=

📚

🎶

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

30 of 89

What

04.3

HACKATHON

DOGSTUDIO

2023

31 of 89

It’s learning through focused mini-games

PROPOSAL

For those not knowing where to begin, a series of 5-15 minute long mini-games are available for a variety of topics.

Some mini-game examples:

  • Timing focus – user taps to the beat on the music
  • Pitch focus – user hears a note then guesses it
  • History focus – multi-choice trivia on the musical greats
  • Harmony focus – listen to the harmony and identify which layer is missing
  • Instrument focus – get the ins-n-outs on a specific instrument

Completing games leads to accomplishments, badges and streaks that awards the user on their learnings – as well as, encouraging them to come back and play.

💡

🥁

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

32 of 89

It’s creating layered sounds into visual compositions

PROPOSAL

Users will have access to a library of sounds that they can apply into their space. When multiple sounds become layered, they will auto adjust their parameters to follow the same time signature.

Additionally to creating as many layers of sounds as the user likes, they will also be able to play with the tempo and tone for the entity they are seeing.

🎺

🎻

🎤

🥁

🎹

🎷

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

33 of 89

It’s enjoying visualized sounds in your personal space

PROPOSAL

For those that don’t want to create music but still engage, the app provides a visual oasis for the user to enjoy.

Users can choose to enjoy with a mood or instrument focus – then watch the world build around them. We also give the users the ability to generate new visuals and sounds within the chosen mood or instrument.

🎷

🎻

🎺

🥁

🎹

🎤

😎

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

34 of 89

It’s a way to share with family and friends

PROPOSAL

Users can invite loved ones to enjoy the app with them. Whether it’s relaxing in a tranquil piano melody, or showcasing your latest layered creation – users can get the sense of community that music is all about.

😎

🎷

🎻

🎺

🥁

🎹

🎤

😁

😁

😁

😁

😁

😁

😁

😁

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

35 of 89

How

04.4

HACKATHON

DOGSTUDIO

2023

36 of 89

Indirect touch for everything

PROPOSAL

To keep it easy for everyone, everything in the app is driven with looking and selecting with a tap of your thumb and index finger.

As the game grows and the controls become more advanced, we will stick to keeping accessibility first and have additional buttons to continue engaging via indirect touch.

Look to ‘hover’ over selection

Two fingers to ‘click’ to select

Fig.2. Icons on Apple Vision Pro

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

37 of 89

Support from other Apple Apps

PROPOSAL

As an app that’s provided by Apple, we aim to partner with additional apps to give the users the most power with this tool.

GarageBand – Supporting the creation and layering elements of the app. With this support, users will get a taste to the starts of music production and mixing. Then when ready, they can jump into GarageBand as a natural next step.

Apple Music – Supporting the sound library. In the future users will be able to search for new sounds via Apple Music. There’s also a potential to provide samples for artist tracks in the future too.

+

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

38 of 89

AI, but with parameters

PROPOSAL

AI applied to the creation of new harmonies will greatly aid in saving time on behind the scenes work while giving users that magical, personal WOW effect. But of course, AI works a little harder if you give it a few defined presets.

For the entire app usage, sound categories each have their own visual effects. Individual notes are also given a color to represent them inside the effect to get dazzling textures and colors mixing together.

=

🥁

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

39 of 89

Application

05.

HACKATHON

DOGSTUDIO

2023

40 of 89

HACKATHON

DOGSTUDIO

2023

41 of 89

HACKATHON

DOGSTUDIO

2023

42 of 89

HACKATHON

DOGSTUDIO

2023

43 of 89

HACKATHON

DOGSTUDIO

2023

44 of 89

Functionality

05.1

HACKATHON

DOGSTUDIO

2023

45 of 89

Four ways to play

APPLICATION

From the Home screen, users can choose four paths to engage with:

  • Create – layering sounds to create visual soundscapes
  • Vibe – choose a mood or instrument and enjoy the generated soundscape
  • Learn – select a mini-game to hone your musical knowledge
  • Share – sharing and inviting others to enjoys soundscape together

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

46 of 89

Create Flow

APPLICATION

HACKATHON

DOGSTUDIO

2023

47 of 89

Create Flow

APPLICATION

HACKATHON

DOGSTUDIO

2023

48 of 89

HACKATHON

DOGSTUDIO

2023

49 of 89

Recap of

selection

Return to

Home Menu

Quick

Mute Volume

Start adding sounds

right away

HACKATHON

DOGSTUDIO

2023

50 of 89

HACKATHON

DOGSTUDIO

2023

51 of 89

Menu expands for

next selection

Toggle to

collapse menu

Search

available

Select a tab

to continue

HACKATHON

DOGSTUDIO

2023

52 of 89

HACKATHON

DOGSTUDIO

2023

53 of 89

Menu expands for

final selection

Select a sound to preview

Pagination for long

menu items

HACKATHON

DOGSTUDIO

2023

54 of 89

HACKATHON

DOGSTUDIO

2023

55 of 89

This is why we

have the toggle

HACKATHON

DOGSTUDIO

2023

56 of 89

User can

apply the sound

Or keep selecting

sounds to preview

HACKATHON

DOGSTUDIO

2023

57 of 89

HACKATHON

DOGSTUDIO

2023

58 of 89

Applied sound

recapped

Tone slider

now available

Tempo slider

now available

Continue adding

sounds

HACKATHON

DOGSTUDIO

2023

59 of 89

HACKATHON

DOGSTUDIO

2023

60 of 89

Vibe Flow

APPLICATION

HACKATHON

DOGSTUDIO

2023

61 of 89

Vibe Flow

APPLICATION

HACKATHON

DOGSTUDIO

2023

62 of 89

HACKATHON

DOGSTUDIO

2023

63 of 89

HACKATHON

DOGSTUDIO

2023

64 of 89

Select a mood

to preview

Search

available

Pagination for long

menu items

HACKATHON

DOGSTUDIO

2023

65 of 89

HACKATHON

DOGSTUDIO

2023

66 of 89

User can

apply the sound

Or keep selecting

sounds to preview

HACKATHON

DOGSTUDIO

2023

67 of 89

HACKATHON

DOGSTUDIO

2023

68 of 89

Get back to

first screen

User can generate new visuals within parameters

HACKATHON

DOGSTUDIO

2023

69 of 89

Building the stage

05.1

HACKATHON

DOGSTUDIO

2023

70 of 89

Visualizing sound

APPLICATION

When visualizing sound, we need to map certain parameters.

We use different audio parameters like timbre, level, pitch, and instrument types as the basic elements of music. Each note played is like adding a stroke to an imaginary canvas.

By carefully linking visual elements to their corresponding audio qualities, we create a seamless connection between what you hear and what you see. Colors come alive, expressing the emotions of the melody. Heights rise and fall, following the changes in pitch and rhythm.

The combination of audio and visual elements in ARythm creates a strong bond between the creator and their musical landscape. It allows users to explore a wide range of sonic possibilities, breaking free from the usual limits of perception. Immerse yourself in an experience where music and visuals blend together harmoniously.

Fig.14., Fig. 15. Visualizing Sound

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

71 of 89

Color theory

APPLICATION

Color theory in sound is the idea of connecting specific colors with different aspects of music. For example, a high piano note might be seen as blue, while a low guitar note could be red. This adds visual richness to the music, allowing you to see colors as you play different notes. It brings an extra layer of visual expression to your musical journey.

.

Fig.16. Algorithmic Chromo-synesthesia chart

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

72 of 89

Sounds vs shapes

APPLICATION

Each sound possesses its own unique set of visual characteristics that we carefully explore. With the aid of AI, we unravel the relationship between sound and shape, allowing us to create visually fascinating representations.

We created several sound groups like:

  • Brass
  • Winds
  • Strings
  • Percussion
  • Keyboard
  • Vocals

Through Midjourney, we generated images that showcase the marriage of sound and shape.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

73 of 89

Brass

APPLICATION

The brass instruments are visualised as a vibrant spiral emanating from the source. This spiral expands outward, symbolizing the energetic and resonant nature of the brass sound. As the powerful sound waves travel through the air, they create captivating ripples that shimmer and glisten, adding a visual representation of the instrument's dynamic presence and harmonics.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

74 of 89

Winds

APPLICATION

The wind instruments are visualised with mesmerizing swirling ribbons that reflect melodies and phrasing. They adjust to the music, forming captivating patterns. Alternatively, use pulsating bubbles that expand and contract in sync with wind instruments, showcasing their breath-driven nature and enchanting melodies.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

75 of 89

Strings

APPLICATION

The string instruments are visualized as a particle effect like a melodious string sound, such as a flowing violin melody or a delicate harp arpeggio. The particles follow the contours of the melody gracefully, creating elegant trails that match the rise and fall of the notes. The colors can be vibrant and harmonious, representing the emotional depth and beauty of the strings.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

76 of 89

Percussion

APPLICATION

The percussion instruments are visualised with explosive particle effects for the snare drum and a dense floor-filling effect for the bass drum. A Tambourine sound can be represented by shimmering particles radiating in a lively circular pattern, capturing its jingling and rattling.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

77 of 89

Keyboard

APPLICATION

The keyboard or piano sound is visualised as falling particles representing played notes. Varying in size, color, and intensity to match key dynamics. Creating shimmering trails symbolizing note sustain and decay.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

78 of 89

Combined

APPLICATION

Combining different sounds and therefore different colorful particle effects will create a magical immersive experience.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

79 of 89

Spatial audio

APPLICATION

By incorporating spatial audio techniques into this AR experience, you can create a more realistic and immersive environment, where the placement of sounds and accompanying particle effects seamlessly align with the player's physical surroundings, enhancing the overall melodic experience.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

80 of 89

Bonus: Our Hackathon Feedback

06.

HACKATHON

DOGSTUDIO

2023

81 of 89

Communicating strategically

OUR HACKATHON FEEDBACK

With a small team still split between the Atlantic Ocean, we seized the overlapping hours we had to align and move forward every day. Here’s how it worked:

  1. Each end of Americas day, they would leave an update on Slack so Europes could get started right away in their morning.
  2. Then we would Huddle up in Europes afternoon the next day to walk through what they created that morning, while Americas double checked the clarity of their sign off message from last night.
  3. By the end of the Huddle, we would be clear about what Americas are accomplishing with their remaining day and what Europes will work on in their morning.
  4. RINSE AND REPEAT

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

82 of 89

Hackathon +

Client Projects + Meetings

OUR HACKATHON FEEDBACK

One of the challenges was dedicating just the right amount of time to the Hackathon on top of other client work and meetings.

With the three of us meeting every day and having a sync with the leads every other day, the meeting time started eating into the 4 hours available for us each day…

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

83 of 89

Hackathon Deliverables

OUR HACKATHON FEEDBACK

Similar to the scheduling, we got mixed feedback on expectations for this projects. At first, it felt very loose – but then it quickly became something bigger.

The bigger it got the more we all felt we needed more time to prepare something solid to share for external Dogstudio usage. AND HERE WE ARE 😘

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

84 of 89

Utilizing AI to make good sh*t fast

OUR HACKATHON FEEDBACK

Rather than continuing to dig up ideas on the internet, we made use of the following AI tools to speed up creating the concept:

ChatGPT

  • Inspiration
  • Texts
  • Research

Midjourney

  • Concept Art… but even we admit it was hard to control the outcome sometimes

Even though we loved AI for this hackathon, we had to talk it out as humans to move forward. We all noticed that after a few inputs (especially as we got more precise with our information) the results started to duplicate.

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

85 of 89

Having a moment to discover new tech

OUR HACKATHON FEEDBACK

Honestly, it was super nice to have scheduled time to research and investigate this new tech. It was even more helpful to have some kind of deliverable with this concept to, so the research didnt go to waste.

So Rico + Nico how many AVP’s are we getting? 😅

Fig.17. Apple Vision Pro

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

86 of 89

Having a moment to shine a light on users with disabilities

OUR HACKATHON FEEDBACK

We’ve heard the term ‘accessibility’ over and over again in web design and our client projects… But it was nice having the time to investigate deeper into the subject on a few fronts.

Not only does it help with that emotional bond to our users, but it makes us better designers being able to problem solve on their behalf

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

87 of 89

UX💕3D

OUR HACKATHON FEEDBACK

Jax – I think we overall enjoyed each others idea, opinions, skills, and company in general on this one. Eva and Maya really got in tune with the user info quickly and I can’t appreciate that enough.

Eva – I really enjoyed working with Jax and Maya. I felt we all shared similar visions and ideas. We did a lot in a short time and progressed smoothly.

Maya – Agreeing with both of you! I think it is indeed amazing how much we accomplished in such a short time, and I genuinely think we had a great time together bouncing off each other’s ideas, opinions, skills and company! Lovely teammates <3

APPLE VISION PRO

HACKATHON

DOGSTUDIO

2023

88 of 89

THANK YOU!

Chicago. Namur. Amsterdam. Paris. Mexico.

2023

HACKATHON

DOGSTUDIO

2023

89 of 89

Figures

Fig. 1. Several ways to display 3D content, https://developer.apple.com/documentation/visionos/adding-3d-content-to-your-app, Apple Inc.,2023……………………………………….

6

Fig. 2. Icons on AVP, Retrieved from https://www.hudsandguis.com/home/2023/apple-vision-pro, Apple Inc., 2023……………………………………………………………………..

7

Fig. 3. Direct Input on AVP, https://developer.apple.com/documentation/visionos/creating-your-first-visionos-app, Apple Inc., 2023………………………………………………………

7, 36

Fig. 4. Indirect Input on AVP, https://developer.apple.com/documentation/visionos/creating-your-first-visionos-app, Apple Inc., 2023………………………………………………………

7

Fig. 5. Keyboard Input on AVP, https://developer.apple.com/documentation/visionos/creating-your-first-visionos-app, Apple Inc., 2023……………………………………………………

7

Fig. 6. Intuitive gestures in action on AVP, https://www.apple.com/apple-vision-pro/, Apple Inc., 2023……………………………………………………………………………………………

8

Fig. 7. Intuitive gestures in action on AVP, https://www.apple.com/apple-vision-pro/, Apple Inc., 2023……………………………………………………………………………………………

8

Fig. 8. Spatial Audio System of the AVP, https://www.apple.com/apple-vision-pro/, Apple Inc., 2023……………………………………………………………………………………………..

9

Fig. 9. AVP 3D mapping technology, https://www.apple.com/apple-vision-pro/, Apple Inc., 2023………………………………………………………………………………………………….

10

Fig. 10. Shareplay within the AVP, https://www.apple.com/apple-vision-pro/, Apple Inc., 2023……………………………………………………………………………………………………

11

Fig. 11. Dwell Control Menu on AVP, retrieved from https://abilitynet.org.uk/news-blogs/apple-vision-pro-has-vision-disabled-inclusion, Apple Inc, 2023……………………………….

13

Fig. 12. Pointer Control Menu on AVP, retrieved from https://abilitynet.org.uk/news-blogs/apple-vision-pro-has-vision-disabled-inclusion, Apple Inc, 2023………………………………

13

Fig. 13. AVP Immersive 3D, https://www.apple.com/apple-vision-pro/, Apple Inc., 2023…………………………………………………………………………………………………………….

14

Fig. 14. Visualizing sound as a sound wave, https://tenor.com/view/sound-wave-wave-sound-gif-3535566, 2014……………………………………………………………………………….

70

Fig. 15. Visualizing sound, https://tenor.com/view/moving-formation-weaving-pattern-optical-illusion-art-gif-17177862, 2020………………………………………………………………

70

Fig. 16. Algorithmic Chromo-synesthesia chart,, https://rhythmiclight.com/, Fred Collopy, 2004……………………………………………………………………………………………………

71

Fig. 17. Apple Vision Pro, https://www.apple.com/apple-vision-pro/, Apple Inc., 2023………………………………………………………………………………………………………………

85

HACKATHON

DOGSTUDIO

2023