1 of 6

VISUALIZING OCEAN SOUNDSCAPES �FINAL PRESENTATION

TONGYU ZHOU

2 of 6

WIKI CONTRIBUTIONS

Tutorials

1. “Testing in VR”: walkthrough on three common ways to test your Unity project in VR, depending on available OS and hardware

Build Android apk

Oculus Link

XR Device Simulator

3 of 6

WIKI CONTRIBUTIONS (CONT.)

2. “Unity Real-time Audio Visualization”: a tutorial demonstrating how I built my visualizer

Tutorials

Extract spectrum data from audio

Generate procedural mesh

Mesh gen based on audio

Add gradient based on amplitude + skybox

Add color gradient based on amplitude

4 of 6

WIKI CONTRIBUTIONS (CONT.)

Unity Multiplayer Plugin Comparison Review of Other VR Audio Visualizers

3. Pages for “Mirror” and “Fishnet,” respectively 4. “VR in Audio Visualization”

​

although Fishnet was so new that no one posts about in (on StackOverflow) so I went with Photon Pun in the end…

Chromesthesia:

“seeing colors”

Phonon tracing

5 of 6

ADDITIONAL DELIVERABLES + TAKEAWAYS

  • Originally wanted to explore annotations of audio in VR 🡪 writing text continuously in VR sucks
  • Debugging XR interactions specifically in Unity was frustrating
  • Do I sync audio or not?

6 of 6

SECOND PROJECT IDEAS

  • Continuing to explore sound:
    • Incorporate suggestions from the class activity
    • Look into visualizing what happens when different sound sources interact with the environment (like the above image, but with added audio input in multiplayer settings)

​

  • Exploring the visualization of other types of signal-based data:
    • Gravitational wave signals
    • Light waves

​

​

​