1 of 16

2 of 16

3 of 16

RGB Cameras

Keyboard

Mediapipe

Retargeter

Hand Controller

Arm Controller

2D hand keypoints

3D hand landmark

Wrist pose

Joint angles

Operation mode

RGB

image

2D hand keypoints

RGB

image

Triangulation

4 of 16

5 of 16

6 of 16

ARIA Glasses

Paddle

Mediapipe

Hamba

Head Rotation Compensation

Retargeter

Hand Controller

Arm Controller

RGB

image

Cropped hand image

Hand mesh

Corrected hand keypoints

Corrected wrist pose

Joint angles

Operation mode

IMU Data

7 of 16

8 of 16

9 of 16

10 of 16

11 of 16

12 of 16

13 of 16

14 of 16

15 of 16

16 of 16