1 of 54

Military Simulation Trajectories�–�Past, Present & Future?

Andy Fawkes | Joint Military Training & Simulation Conference | Bristol |

5/6 March 2024

2 of 54

Career

  • 1985 - 2000 - RCNC/MoD - Submarines

  • 2000 - 2012 - MoD - Simulation & Training

  • 2012 - Now - Industry/Media - Simulation & Training

3 of 54

What are We Seeking in Training?

Faster

Cheaper

Better

Flexible

Multi-Domain

Greener

4 of 54

The Requirement

There is a need to bring teams and teams of teams together to experiment, train and collaborate in complex multi-domain (and Joint) battlespace operations …

the first time should not be in the face of an enemy

UK Multi-Domain Integration Guidance - Jan 22

5 of 54

Past

6 of 54

Dome Trainer Portsmouth�1951��Pathé

7 of 54

USAF Capt Jack Thorpe’s White Paper (1978)

"advances which are seen on the horizon are not simple improvements in teaching techniques or higher fidelity simulators, but rather bold concepts which tightly align training systems with real combat readiness and make them indistinguishable.“

4

Mission execution with real time observation

3

Air crews rehearse the plan and planners assess suitability

2

Planning a response using the holographic electronic sand table

1

Enemy aggression detected by overhead sensor

Ref. I/ITSEC 2010 “Trends in Modelling, Simulation and Gaming: Personal observations about the past 30 years and speculating about the next 10” Jack Thorpe PhD & SIMNET: An Insider’s Perspective: Neale Cosby - March 1995

8 of 54

Still Relevant …��DARPA (Cybernetics�Technology�Office�1977-1980)�-�J. Dextor Fletcher

  • Fletcher proposed a Tank Team Gunnery Trainer (TTGT) for tank gunnery training, where both live training and traditional simulators ($18m) were high cost.

  • DARPA tank gunnery trainer objectives:
    1. Procured in quantity for $10,000 or less each;
    2. accessible, for example as a stand-alone "game" in military barracks or dayrooms;
    3. motivating, for example in supporting competitive score keeping;
    4. of sufficient fidelity to satisfy the training objectives, within the cost constraints; and
    5. suitable for documenting training effectiveness in terms of transfer-of-training data”.

  • The TTGT concept was based on networked trainers viewing a single videodisc-generated scene, with the trainees competing to the first to sight and fire at an "enemy" tank.

8

An Historical Review Of Selected

DARPA Projects 1991

9 of 54

SIMNET�1980s��SIMulator NETworking

SIMNET: An Insider’s Perspective: Neale Cosby - March 1995

10 of 54

SIMNET M1 Tank Simulator�1986��https://catalog.archives.gov/id/6596895

11 of 54

SIMNET & Battle Force In-Port Trainer (BFIT) (1990/91)

“We had Army, Navy and Marines all playing in the same network on their own systems, that's the first time that has ever been done.

Right now we can put on a very complex battalion level battle and have your new weapons system or your new tactical organisation try to operate in that environment.

See how it works out, with real soldiers driving, real sergeants gunning, real soldiers trying to command and control your new force out there on the battlefield.

One of the neat things we're able to do, for example, would be to have naval call for fire being called for by the Marine crewman in the tanks here at Fort Knox and by the aviation crewmen who were flying the helicopters.

As we flew over the USS Wasp icon that we saw in our screens our signal showed up on their radar screens, which is an amazing feat when you think of that.

It's actually going to be a revolution.“

www.jimmillar.net/BBN.html

12 of 54

US Senate Armed Services Committee Hearing on Advanced M&S (21 May 1992)�Dr Victor H. Reis, Director Defense Research & Engineering

“Network simulation is a technology that elevates and strengthens the collective problem-solving abilities of human beings.

People acting as teams, learning and getting better, and this is true whether they are design teams, manufacturing teams, education teams, training teams, acquisition teams or warfighting teams.

Network simulation with modern information technology can connect people together in an aligned, coherent, integrated enterprise.

It is at the very heart of the department's technology strategy.”

Video

www.youtube.com/@mikezyda/videos

13 of 54

Thorpe’s SIMNET Distributed Simulation Vision (early 1990s)

Ref. I/ITSEC 2010 “Trends in Modelling, Simulation and Gaming: Personal observations about the past 30 years and speculating about the next 10” Jack Thorpe PhD

14 of 54

DIVE�UK Dismounted Infantry Virtual Environment (2002)��(QinetiQ)

15 of 54

2002 - Training Cost Effectiveness?

16 of 54

NATO�Exercise First WAVE�2004

  • Aimed at enhancing the readiness of aviators and supporting staff
  • A collaboration of seven nations - Canada, France, Germany, Italy, the Netherlands, UK, and the US
  • Distributed international collective training leveraging national simulation resources and expertise

Aircrew Mission Training via Distributed Simulation (MTDS) – Development of the Multi-Country Complex Synthetic Environment;

David A. Greschke; Dr. Stefano Cerutti; NATO/RTO

17 of 54

Fleet Synthetic Training�FST-J��2006 ish

“This is the way we are going to train in future”

Type 23 Operations Room (simulator)

Type 22 Frigate, Type 23 Frigate, Type 42 Destroyer

+ Flight Sim (Bedford)

Combined Tactical Trainer

HMS Dryad

www.computinghistory.org.uk/pages/16755/History-of-the-Cook-Building-at-MoD-Southwick-Park-(Formerly-HMS-Dryad)

USN Carrier Group

German Navy

18 of 54

MoD Journey�-�Joint Training & Simulation

  • 2005 – Common/Joint Simulation Infrastructure (JCNTC)
    • Project funding line established; Op JCOVE

  • TELIC/HERRICK

  • 2008 - UK MoD Simulation Strategy
    • More Adaptive, Responsive and Cost Effective Simulation
    • Common Network, Open Standards, COTS/GOTS, Common URD/SRD Statements

  • 2010 – SDSR (Strategic Review)
    • Save Money!
    • Targets to Transfer Live Training to Simulation and Instrument Live Training

  • 2012 - Defence Training & Education Capability (DTEC)
    • Training System Investment BOI (e.g. iPad v Big Sim); Common M&S Catalogue and DSC

19 of 54

what if in future we could simulate the world such that we could not tell the difference between the simulation and the real world?�

20 of 54

���UK Virtual Reality in Land Training�(VRLT) Pilot��2019

The aim of the VRLT pilot was to identify the opportunities that Virtual Reality technology offered the CTTP Future Collective Training System

21 of 54

RAND Report (2019)

22 of 54

Present

23 of 54

XR

24 of 54

XR for Professional Use

25 of 54

Support

Credit – Kognitiv Spark

26 of 54

BAE Systems’ Striker® II Helmet-Mounted Display (HMD) – Late 2020s

27 of 54

Eye Tracking

28 of 54

User Interfaces

  • Gesture Interfaces

  • Tangible User Interface

  • Emotion Sensing

  • Brain-Computer Interface

29 of 54

Human�Data

30 of 54

Data Exploitation in Military Training

  • USAF Pilot Training Next & Pilot Training Transformation initiatives
    • Explored wearable biometric devices to collect and monitor physiological data, such as changes in heart rate.
    • Instruction was assisted by data collection software and artificial intelligence-based applications designed to assist students in identifying training tasks for self-guided learning.

  • The British Army’s Collective Training Transformation Programme (CTTP) has placed emphasis on training data exploitation:
    • “data will be captured and exploited to drive change and efficiency … creating the ability to dynamically control the training environment to set an appropriate level of complexity and challenge … and bring data to a single place for analysis, with common data standards enabling an ambitious use of data analytics pan-Army”

  • UK Royal Air Force (RAF) Project iDAS (immersive Data driven Airmanship Simulator)
    • Aimed at helping the explore the benefits of data analysis to assess pilot behaviour and identify characteristics of good airmanship.

US Congressional Research Service Report - U.S. Air Force Pilot Training Transformation (PTT) - Jan 23

Future Collective Training System Blueprint Iteration 1.5 (Releasable to Industry)

31 of 54

UK Air Training Capabilities - Data Stovepipes?

WIST

MSHTF

STARS

MFTS

TyTan

TFST

Gladiator

F-35

iASTC

(JFST)

C17

UAV

E-3

A400M

C-130

P-8

Apache

LTPA

32 of 54

Warfighter Data Here, There, Everywhere

33 of 54

“(Personal) Data is hard to access, technology is ageing, and processes and culture are not suited to the information age. ��A fractured ecosystem has created the need for manual workarounds and interventions across the force�…��With many systems in play that either speak different data languages or are unable to communicate at all, there is no single view of data across the Armed Forces.”

34 of 54

Warfighter Digital Twin?�-�Uniting Warfighter Data across multiple applications including training & education, operations, health, research, acquisition, & career management��Digihuman?

35 of 54

Defence Acquisition Strategies?

  • CTTP/ACTS – 2018 … ?

  • Gladiator … Contract 2019

  • Spartan?

  • Strat Com? – 4 CASTs?

Compete or Collaborate?

The underlying technology is become more common and more commoditised

Networks, software, hardware

36 of 54

Future?

37 of 54

Recent Work

  • Home Office
    • XR Headset Data Framework
    • Learning from Computer Games
  • Dstl
    • Gaming Ecosystem Study
    • Military Metaverse study
    • Military Metaverse Sandpit
    • Simulation Enterprise Analysis Study
    • Novel Simulation
    • XR Standards and Security
    • Data and Evaluation
    • Learning Futures

38 of 54

Learning�Futures

  • AI-Supported Learning

  • Holodeck in Every Barracks

  • Ubiquitous Learning

  • Brain-Computer Interfaces

  • Persistent LVC

39 of 54

But … Do This First

Sep 2021

May 2021

Feb 2023

40 of 54

Holodeck?

41 of 54

AI …

Interactive World/Game Generation

Text to Video

42 of 54

In Vogue�Tech Speak

Metaverse

….

“Spatial Computing”

Metaverse?

43 of 54

It’s All Science Fiction

1984 – Created by Gibson, the word “Cyberspace” is popularised and “had no real semantic meaning

a "mass consensual hallucination" in computer networks

1992 – Stephenson creates the word “Metaverse” a portmanteau of "meta" (meaning beyond) and “universe”

“ … a computer-generated universe …”

Physical World

Digital World

44 of 54

Some Contemporary Metaverse Descriptions …

“The metaverse is a seamless convergence of our physical and digital lives, creating a unified, virtual community where we can work, play, relax, transact and socialize.’

“Opportunities in the metaverse” 2022

“The metaverse enables us to embed computing into the real world and to embed the real world into computing ...”

Satya Nadella, CEO Microsoft, Microsoft Ignite Nov 2021

45 of 54

A Defence Perspective on the Metaverse

For defence, the metaverse signifies a convergence of technologies and cultures,

representing the next evolution of computing, a trend from 2D to 3D interaction and immersion between humans, machines and the digital world.

The real world is three-dimensional, and increasingly the digital world will be too.

46 of 54

Military Metaverse

Computing Hardware

Software

Networking & Security

Human-Computing Interfaces

Data & Digital Twins

AI, Data & Analytics

Automation & Robotics

It’s Bringing Everything Together that Matters the Most

Defence Digital Backbone

47 of 54

MILITARY METAVERSE�CONOPS�2035��aka�Persistent Secure Networked Distributed LVC Simulation

48 of 54

Converging Domains

49 of 54

�NATO�Allied Command Transformation Strategic Foresight Analysis 2023

  • Within two decades, an overwhelming majority of the population will have access to the internet and mobile devices, along with virtually a limitless amount of information, while the distinction between the physical and virtual dimensions will decrease.

  • Infinite alternative worlds may emerge in the virtual dimension, unbounded by physical limitations, and eventually the convergence of physical and non-physical (virtual) realities fused into metaverses will further increase variations of realities and perceptions. The expansion of competition from the physical to virtual and cognitive dimensions significantly impacts the continuum and character of conflict…

50 of 54

Dual-Domain?

The convergence of virtual and physical spaces

Virtual infiltration could precede physical entry

A dual-domain approach allows for the creation of new tactics, techniques, and procedures to navigate and control the multi-domain battlefield

51 of 54

�War is Virtual Hell: Bruce Sterling Reports Back from the Electronic Battlefield 1-1-1993

The whole massive, lethal superpower infrastructure comes unfolding out of 21st-century cyberspace

The Reserve guys from the bowling leagues suddenly reveal themselves to be digitally assisted Top Gun veterans from a hundred weekend cyberspace campaigns

52 of 54

“All but �War is�Simulation”

53 of 54

Still the Ultimate Simulator?

Wikipedia

54 of 54

Questions?

Andy Fawkes

Joint Military Training & Simulation Conference Bristol

5/6 March 2024

andy.fawkes@thinke.co.uk