1 of 36

I/O Extended Web Edition of Pacific Region GDGs

GDG Cloud Fremont

GDG Fremont

GDG Fresno

GDG Cloud Silicon Valley

GDG Houston

GDG Los Angeles

GDG San Diego

GDG Modesto

GDG Oahu

GDG Sonoma

WTM Fresno

2 of 36

AR Maps and ARCore Geospatial API

�GDG Fresno / WTM Fresno, Director of Product Engineering at SportsBoard

he/him�

@tocsa2

linkedin.com/in/csabatothdev/

csaba.page

Csaba Toth

3 of 36

Indoor AR Maps with ARCore + SceneForm

Design augmented objects
Activation via Augmented Images

Selection of a good enough activation image
Processing the image to use in an Augmented Image Database
ARCore recognizes the image and it’s precise orientation

Place all the augmented objects relative to the augmented image
ARCore monitors to the accelerator sensor stream and tries to minimize drift

Drift is perfectly corrected if the activation image comes into view again
Other distinct feature of the reality space are recognized by ARCore (carry over and continuation of from the Project Tango AR features)

4 of 36

Indoor AR Maps: designing objects

Sceneform: a higher level library and API on top of ARCore

Collision detection
Interaction support such as grabbing and moving objects
Supported several 3D formats, compiler could transform them into sfa, sfb

My first objects were designed with Blender (FOSS CAD and 3D modeler software)
Sceneform also contains a ShapeFactory: I can build AR objects runtime

Better suited if the object library can change (for example billboard signs)

5 of 36

Indoor AR Maps: designing objects

Sceneform is discontinued but there’s a maintained fork:

https://csaba.page/blog/sceneform-good-news.html https://github.com/ThomasGorisse/sceneform-android-sdk

ARCore is able to load certain 3D object formats
Unfortunately https://poly.google.com which was an open 3D model collection is shut down, but there are other market places

6 of 36

Indoor AR Maps: example

Goal: DevFest conference venue has 6 class rooms, help attendees orientation
DevFest ARMap (a.k.a. BWSS ARMap - Bitwise South Stadium conference venue)
As I described before: activation image, relatively placed billboards
Demo Video: https://www.youtube.com/watch?v=vHz358sAPLM
PlayStore: https://play.google.com/store/apps/details?id=com.valleydevfest.armap
Open Source: https://github.com/gdgfresno/DevfestARMap

7 of 36

Indoor AR Maps

Positives:

It works indoors, no GPS needed
Cutting edge technology
Doesn’t need special 3D sensor like Project Tango had, ARCore works with most phones

Possible downsides:

Only works indoors
Drifting might be too much in very large indoor venues

Multiple activation images needed for venue section

8 of 36

Outdoor AR Maps with ARCore Geospatial APIs

9 of 36

Use-case: create an AR Map which orientates students towards the closest recycling trash cans at the CSU Fresno Campus

Image activation is not feasible: image can be removed, turned, rotated
But we are outside!

Location of the trash cans
Location of the user

GPS cloud anchors didn’t exist for a long time

10 of 36

Use-case: create an AR Map which orientates students towards the closest recycling trash cans at the CSU Fresno Campus

DIY solution? How to determine the orientation?

Please walk straight 2 yards?
Phone still shakes
Exact GPS position (A-GPS, dual band)

Even larger distances than in a large indoor venue
https://recyclingtrashcans.github.io/

360 website with mono photos and videos
Not as immersive as an AR app

11 of 36

ARCore Geospatial API to the rescue!!!

Allows placing AR objects with GPS coordinates
https://developers.googleblog.com/2022/05/Make-the-world-your-canvas-ARCore-Geospatial-API.html
Takes advantage of several technologies such as:

ARCore’s AI algorithms
Street View data
Google Earth 3D models
Google's Visual Positioning System (VPS)

12 of 36

ARCore Geospatial API to the rescue!!!

https://developers.google.com/ar/develop/geospatial
Example app: Recycling Trashcan ARMap
https://play.google.com/store/apps/details?id=dev.csaba.armap.recyclingtrashcans
Source code: https://github.com/RecyclingTrashCans/recycling-trashcan-armap/
Video demo: https://www.youtube.com/watch?v=w3dUH4fB68Y

13 of 36

Experiences

Magic!
Drift can still happen
Mid range phone may struggle in 100F+ (42C+)
Elevation is tricky!

108m vs 77m: pins are in the air up above 30m
Should I offset everything? What if it’s only my phone?

14 of 36

Experiences

Elevation is tricky!

108m vs 77m: pins are in the air up above 30m
Should I offset everything? What if it’s only my phone?

15 of 36

Possible solution to elevation problem?

Terrain anchors

https://developers.google.com/ar/develop/java/geospatial/terrain-anchors

16 of 36

Project Tango

Phone/tablet with special 3D sensor + AR software

Development Kit tablet
Lenovo Phab2 Pro smartphone
Asus ZenFone AR

https://www.youtube.com/watch?v=Qe10ExwzCqk

https://www.globallogic.com/insights/blogs/tango-augmented-reality-platform-by-google/

17 of 36

Project Tango

Tango Components

Motion tracking camera
3D depth sensing: Structured Light, Time of Flight, and Stereo. Latter two require the use of an infrared (IR) projector and IR sensor.
Accelerometer, barometer, and gyroscope
Ambient light sensor (ALS)

18 of 36

Project Tango

Key Concepts

Motion Tracking
Area Learning
Depth Perception

19 of 36

Thank you!

GDG Cloud Fremont

GDG Cloud Silicon Valley

GDG Fremont

GDG Fresno

GDG Modesto

GDG Houston

GDG Los Angeles

GDG Oahu

WTM Fresno

GDG San Diego

GDG Sonoma

20 of 36

This is a headline

Followed by the subhead

This text is set in Google Sans.

Download on google.com/fonts

All titles and copy should live within these margins.

21 of 36

This is a headline

Followed by the subhead

goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna.

Header

goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna.

Header

goes here

Lorem ipsum

33 of 36

Accessibility

Expand

Late

Credit card

Extension

Thumb Up

Remove

Verified

Q&A

Finance

Android

Turn in

Trash

Actions

Download

History

Store

List

Wallet

Announcement

Backup

Document

Favorite 1

Open

Home

Swap

Account

Ratio

Tag

Server

Favorite 2

Grade/rate

Lock

Language

Receipt

Add shopping

Chart

Bug

Event

Find Page

Page view

Basket

Time

Work

Source: Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis non erat sem

Icon library��Modify color of the icon by clicking on the icon and select fill from the menu

Icons can be scaled to any size

Additional Material icons can be found, here

34 of 36

Alarm

Assessment

Sync

Exit App

Movie

Visibility

Trolley

Open

Location

Settings

Assignment

Check

Explore

Thumb Down

Today

Perm Media

People

Airplane

Signal

Photo

Play 1

Block

Send

Smartphone

Style

Walk

Bluetooth

WiFi

Upload

Play 2

Laptop

iPhone

Controls

Bike

Pie Chart

Money

Attachment

Video

Business

Chromebook

Security

Notification

Bus

Source: Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis non erat sem

Icon library��Modify color of the icon by clicking on the icon and select fill from the menu

Icons can be scaled to any size

Additional Material icons can be found, here

35 of 36

Developer

Write

Cloud

Audio

Key

Desktop Mac

Watch

Person

Car

Devices

Quote

Folder

Web Page

36 of 36

Social Icons

Cafe

Theatre

Gaming

Florist

Restaurant

Gas

Delivery

Hospital

Taxi

Radio

Stream

Source: Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis non erat sem

Icon library��Modify color of the icon by clicking on the icon and select fill from the menu

Icons can be scaled to any size

Additional Material icons can be found, here