1 of 11

© 2018 MediaMonks. All rights reserved. Any copying or use of this confidential information is strictly prohibited without the express written permission of MediaMonks.

DECEMBER 2018

MediaMonks Labs

2 of 11

As part of Creative Content, we steer and drive MediaMonks’ global solutions focused on technology and design evolution, and we pay our learnings forward with results oriented solutions that delight and add value in any medium.

By tackling and testing emerging tech, we consistently deliver fresh, exciting and delightful experiences that redefine what is possible.

MediaMonks Labs is an

R&D and innovation group.

3 of 11

3

MMLABS | DECEMBER 2018

Every year, top creative web content creators make experiments, and add them to the Christmas web advent calendar.

Digital artist advent calendar

What everybody is talking about

It’s hard to keep up with what’s possible with AI. We can now look in the dark, and create even more realistic faces. To get grips on how fast this is going, The Verge wrote an interesting article about it.

More and More AI

Even though the concept of Voice is clear, it can still be challenging coming up with a clever and useful concept.

Amazon collected the most appreciated ones.

Best Alexa Skills of 2018

READ MORE

fake

4 of 11

1/2

Images like these take a lot of effort to create.

What if we can create an automated production pipeline that can generate these images based on a single photo?

With less time per image, production cost will lower significantly.

Smart Photography @ Scale

4

MMLABS | DECEMBER 2018

Depth map

Labs Project #1

5 of 11

2/2

In this work in progress update we showcase the automated steps to go from one photo to one edited asset:

  1. Offset images: Calculate perspective to retrieve spatial information
  2. Depth map: Determine the distance of each element in the scene
  3. Segmentation: Define the object, floor, and background
  4. 2D effects: Defocus the background segment to emphasize depth, and create more focus on the subject
  5. 3D effects: Use shaders to generate floor effects
  6. Object detection: Understand the subject, to contextually select targeted effects
  7. Object targeted effects: Augment 3D models and animation on top of the image, complementing depth and perspective

The goal is to get an automated example process in place, adding detail on the amount of effort (or better worded, how little effort) that went into creating each asset.

5

MMLABS | DECEMBER 2018

Smart Photography @ Scale

Labs Project #1

6 of 11

Tracking the position of your face relative to the screen provides enough data to create a false sense of depth.

Based on the trick of Johnny Lee’s Wii hack, we mimicked the result with nothing more than the built-in webcam of your laptop.

Using openCV’s face tracking (also available for Web use), we draw a scene through a parallax, and view the virtual space without the use of depth data.

Use case: The solution is purely based on software, no expensive hardware is required. You can use this for installations, or product viewing.

Fake 3D

Without additional hardware

6

MMLABS | DECEMBER 2018

Labs Project #2

7 of 11

Every month, we look at a project that did something amazing, that might not be noticable from the surface.

The Mill - a VR experience that tells the textile industry’s story to the visitor in a way that will make other visitors wonder what they are doing The angle that makes it special is how it seamlessly transitions between the physical and virtual world.

Mapping real objects in VR is not new to us. The real challenge was to create a 1:1 replica of the physical space in VR, and to consistently put the user in exactly the right location inside it.

We made use of HTC Vive Pro’s new feature to use 4 lighthouses. Which gave us 3 (+1 extra) reference points to align our virtual space with. No additional trackers, or funny procedures required. This installation will work for years to come, realised in a very cost-effective way.

And the spotlight

is on...

7

MMLABS | DECEMBER 2018

Depth map

René Bokhorst�Technical Director

Singapore�

8 of 11

Introducing a new MMLabs ambassador

We welcome

Caio!

Ron LeeTechnical Director

Singapore�

8

MMLABS | DECEMBER 2018

Caio Cesar Velenosi, CT, is our new ambassador from the São Paulo office.

I've been working with the São Paulo office for the last 7,5 years, two and a half of them as part of the MediaMonks monastery, first as a developer (flash, then frontend) and as a CT since early 2018.

I had an early start at coding when I was around 12, Visual Basic and other boring stuff, which made me realize that the normal business kind of job wasn't what I wanted to do. Diving into web and then Flash opened a new world of possibilities for me.

That peaked when I discovered the world of creative coding and experiential projects. From then on, it's been quite a ride, going from guitar playing urinals to chicken sandwiches flying into the stratosphere.

I usually look away from coding in search of inspiration. I went to college for an animation major, consume unhealthy levels of music and I'm also constantly studying art and art history. When it comes to tech I'm always in search of new languages, tools and frameworks. I believe that keeping yourself open to different possibilities is the key to do great work in an ever evolving environment such as the tech and experiential world.

9 of 11

Google Zoo

Immersion Days

Caio’s

Involvement

KFC

Zinger 1 Space Mission

Google

Music Generator

10 of 11

If you enjoy these monthly updates, but you’re not on our mailing list, be sure to reach out. You will receive a fresh chunk of news and demos about emerging tech, straight to your digital doorstep.

Stay

updated

Test your concepts

Inspiration Sessions

Join one of our group sessions in a MediaMonks office near you. We host regular inspiration sessions where we deep-dive, explain, and do hands-on experimenting. Contact your favorite monk to sign up.

Not sure if your digital dreams are possible? We’re here to help. Let us know what you’re trying to achieve, and we can bump it in the right direction. Crazy concepts and impossible ideas are more than welcome.

10

MMLABS | JANUARY 2019

Stay in touch

11 of 11

Thank You!

We’re sending you off with a remarkable choir that you can control by pulling on lips. Weird, but wonderful. Try it out here:

http://www.adultswim.com/etcetera/choir/