1 of 31

��XR Data

Andy Fawkes | Reality Reimagined Expo 2025�Battlelab, Dorset | 26 June 2025

2 of 31

Outline

  • Context

​

  • XR Data Framework

​

  • XR Standards

​

  • XR Security

​

  • Looking Forward

3 of 31

My XR Journey …

2019

2022

2023

2025 ...

2025

2025 …

4 of 31

5 of 31

XR and AI

https://youtu.be/T-sbHvDF6Bw?si=6BBJmWnWPJRXtM-U

https://github.com/sebastianstarke/AI4Animation

6 of 31

�Smart Glasses

7 of 31

Keeping Up With AI Developments …

8 of 31

XR Data Framework

9 of 31

XR and Simulation�are (Prolific) Data Generators!

10 of 31

Inferred Data

*****

11 of 31

XR Data Framework

Principal XR Interface

Augmented Reality HMD

Mixed Reality HMD

Virtual Reality HMD

Neuro Reality

XR Interactivity Enablers

Handheld Devices

Limb-Worn Devices

Haptics

Movement Simulators

Electro-myography Devices/EEG

Sensors/

Data

After Processing

MR Cameras

Audio

Eye Tracking

LiDAR

Face Tracking

Data Storage/

Network

Volatile

On-Device

Local

Cloud

Room Dimensions

Hand Tracking

User Body Dimensions

Inferred Data e.g. Age, Gender, Fitness, Disability

Photorealistic User Avatars

User Avatar Dynamics

5G

External 3D Capture Devices

IoT

IR

Body-

suits

Pulse

Biometrics

Smart-glasses

Smart Contact Lens

Voice

Spatial Sound positioning/ presence

Implants/ Prosthetics

Biological Motion/ Gait

Presence

12 of 31

XR (Data) Standards

13 of 31

Warfighter Data Here, There, Everywhere

14 of 31

“(Personal) Data is hard to access, technology is ageing, and processes and culture are not suited to the information age. ��A fractured ecosystem has created the need for manual workarounds and interventions across the force�…��With many systems in play that either speak different data languages or are unable to communicate at all, there is no single view of data across the Armed Forces.”

15 of 31

Call for Action – Collect Data!

“ … Data analysis is essential for us to understand how we change training in the future.

​

We need to be recording data in our training systems far more radically than we currently are.

​

If we had for the last 20 years recorded every single mission we've flown in a Typhoon simulator we could now use AI to analyse that data and think about for example how many times did the pilot make a particular manoeuvre? … ”

IT2EC 2025 (Oslo)

AVM Ian Townsend, Director of Training for the UK RAF

16 of 31

Training Systems Interoperability

17 of 31

NATO MSG-234 – Training Data Analytics and Standards�- Our Mission -

18 of 31

Uniting Human Data�–�Warfighter Digital Twins

19 of 31

XR Technology Standards

WebXR-Compliant XR Hardware

WebXR API

Web-Based Content

Pixabay

Khronos Group

xAPI

Pixabay 

WikiMedia

20 of 31

(XR/Metaverse) Enterprise Standards Framework

Theme

Sub-Themes

Example Standards

3D Content

Objects, Materials, Rendering

glTF, OpenUSD, OpenPBR, MaterialX, OpenFlight, Digital Twins

3D Worlds

Geospatial, Human-Built, Biomes

CDB, CityGML, 3D Tiles, BIM, ISO 19107, OGC API - 3D GeoVolumes

Sim-Sim Interoperability

Models, Comms

HLA, DIS, DSEEP, SpaceFOM, TENA

Sim-Others Interoperability

Software, Hardware

Cyber DEM, C2-SIM, CIGI, UCATT, Link 11/16, WebLVC, OpenXR, WebXR

Networking

Performance, Wireless, Security

5G/6G, WiFi 7, ISO/IEC 27033

User Experience

Safety, UX, Performance Tracking

ISO 45001, ISO/IEC 5927:2024, ISO 25010, xAPI, Caliper Analytics

Governance

Security, VV&A, Privacy, Ethics

ISO/IEC 27001, IEEE 1012, ISO/IEC 27701, GDPR, IEEE 7000

21 of 31

�UK MoD�6 Data Rules

  • Exercise sovereignty over data, including accountability and ownership

​

  • Standardise data across the Defence landscape

​

  • Exploit data at the most effective and relevant point in the value chain

​

  • Secure digital data at creation, curation, when handling, storing and transmitting

​

  • Curate data, ensuring it is assured, discoverable and interoperable

​

  • Endure data as an asset beyond individual projects

22 of 31

XR Security

23 of 31

XR Security�-�3 Dimensions

Data�Sensitivity

Location

Tethered

Higher

Sensitivity

but tethered,

Medium risk

Off site but

Tethered,

Medium risk

Untethered

Lower

Sensitivity,

Secure location

Lowest Risk

Off site

untethered

High risk

Higher Sensitivity

untethered,

High risk

Connectivity

24 of 31

Looking Forward

25 of 31

AI, Data and XR

Data Category

AI Applications

Sensor & Tracking Data

Motion prediction, gaze-based rendering, gesture recognition, avatar animation

Environmental & Spatial Data

Scene understanding, spatial mapping, occlusion handling, environmental labeling

User State & Biometric Data

Adaptive interfaces, cognitive load estimation, stress detection

Behavioural & Usage Data

Personalisation, usage analytics, experience optimisation

Content & System Data

Asset optimisation, adaptive streaming, intelligent content delivery

26 of 31

OpenAI Sora�& Roblox��Text to Video & 3D Worlds

27 of 31

The Metaverse Signifies the Trend�from 2D Digital Worlds to 3D Digital Worlds

The Real World is 3 Dimensional (!)

28 of 31

Seizing the 3D (Data) Future

The Mirror Domain

Shared Worlds

The Learning Arena

The Cognitive Terrain

29 of 31

Innovation�…��Rift Drone�(2014)��AR.Drone 2.0�Oculus Rift�Unity�Xbox 360 Controller�Open-Source Software�https://github.com/daraosn/oculus-drone�

https://youtu.be/3WmQ1_8ytaM?si=nsmukHRH8lEMll33

30 of 31

31 of 31

�Questions?��XR Data�A Strategic Asset

Andy Fawkes | Reality Reimagined Expo 2025�Battlelab, Dorset | 26 June 2025

andy.fawkes@thinke.co.uk