3D VR / AR system.

John Sokol  Jan 2011

I am just planning to keep this one really really simple.  Either they fund it or they don't.  But just take what's off the shelf and bridge it to what already exists in the software world.

As they say "Flip it" meaning just do one thing, make money and sell it off, go on to the next. Not get too emotionally involved.  

Yes some passion, it's very cool stuff.  I think a low cost 3D display device that's cheaper than buying a home 3D setup and more flexible in its capabilities.  But this is just a small stepping stone to where I want to get.

The unit consists of 2 Micro LCD display with 3D graphics, and can be embedded into a pair of video glasses.  Specifically the display would be the:  http://www.kopin.com/bdm-922k/  driven by an NVIDIA Tegra 3 chip.

The device should be able to play 3D movies and render 3D graphics for games and other applications located on people PC’s or Phone as well as be able to run applications stand alone.

Back in the late 80’s Virtual Reality was the next big thing.  Companies like VPL were able to partner with Sun and SGI in making commercial Virtual Reality systems. Some companies even tried to bring this technology to consumers with 3D VR gaming systems that people would pay $20 just to try for 10 minutes.

It’s has also been the centerpiece of many TV shows from the Star Trek Holodeck to the more recent Battlestar Galactica spin off Caprica and for movies like Lawnmower man, Tron and Avatar.

Since then Augmented reality has also come into popularity. This is where the virtual world and the real world are mixed also known as Mixed reality.  This allow you to see the real world with computer graphics superimposed over it, like showing in Terminator, Robocop and the binoculars used in Star wars. Today this is primarily in the form of smartphone apps that display animated characters over QR codes.

We are starting to see some of the first signed of this technology begin to reach the market with the Wii Mote and the XBox Kinect and other gesture recognition systems that have yet to reach the market.

Here we are today in 2011, and with Moore’s law, the prices of technology have dropped while the capabilities have soared to new heights since  1990’s.

Today there is not one consumer level 3D headsets, although 3D Glasses are common that work in conjunction with special displays and TV’s.

Not  one company makes a mass consumer VR or AR products.

What I propose is to make a $300 to $500 retail price, portable, mobile VR / AR / 3D Video headset.

Using off the shelf optics assembly and doing a custom PCB with CPU’s it is possible to take one of these video goggles to a whole new level.

With such a device 3D immersion into existing PC based games can be done.

Support for 3D graphics in HTML5 on the display, allowing for a 3D web experience.

Support for existing VR/AR applications.

To define a standard for the next generation of these applications to run on.


SPECS

Hardware

2x  720x480 full color displays.    http://www.kopin.com/bdm-922k/ 

Nvidia Tegra 2 or Tegra 3 GPU. Multi Core Arm Processor with Graphic Acceleration.

Stereo Audio & Video

Support of WiFi and BlueTooth.

2 Camera Modules  (option to provide Stereo Video Input for AR applications, improved tracking etc.)

3 Axis motion and gyro

ADXL330 3-axis accelerometer

MPU-6000/6050: World’s First Integrated 3-Axis Gyro, 3-Axis Accel and 9-Axis MotionFusion http://invensense.com/mems/gyro/mpu6000.html

Lithium Ion Batteries.

* Possible inclusion of separate external 3D spatial Controller, like Wii Mote or similar. with BlueTooth Interface.

Initial prototype could be build with off the shelf Tegra 2 dev board:

http://www.toradex.com/files/media/modules/Colibri-T20-Datasheet-Preliminary.pdf

Software

Webkit

HTML5

OpenGL, WebGL

Arm Linux

LLVM

Video Streaming in and out of Stereo Video in MPEG2 and MPEG4 AVC, H.264

The main software is designed to run stand along to the web using WiFi or act as a slave device to a cell phone or PC that is doing graphics rendering.

Surfing a 3D web experience with 3D icons is already possible with current 3D setups on PC, this will all work on this device also and could make for a much richer 3D web experience.