AR & Hand Tracking
EXTENDED REALITY
Rickman Roedavan
Rikman Aherliwan Rudawan, S.T., M.Kom�
EXTENDED REALITY
Extended reality (XR or Cross Reality) is a term referring to all real-and-virtual combined environments and human-machine interactions generated by computer technology and wearables. It includes representative forms such as augmented reality (AR), virtual reality (VR) and combined both in Mixed Reality (MR). and the areas interpolated among them.
Extended Reality (XR)
VR
(Virtual Reality)
AR
(Augmented
Reality)
MR
(Mixed
Reality)
XR
Extended Reality (XR)
Virtual Reality (VR)
Augmented Reality (AR)
Mixed Reality (MR)
Virtual Reality (VR)
Virtual Reality (VR) is an interactive computer-generated experience taking place within a simulated environment, that incorporates mainly auditory and visual, but also other types of sensory feedback like haptic. This immersive environment can be similar to the real world or it can be fantastical, creating an experience that is not possible in ordinary physical reality. Augmented reality systems may also be considered a form of VR that layers virtual information over a live camera feed into a headset or through a smartphone or tablet device giving the user the ability to view three-dimensional images.
Augmented Reality (AR)
Augmented Reality (AR) is an interactive experience of a real-world environment whereby the objects that reside in the real-world are "augmented" by computer-generated perceptual information, sometimes across multiple sensory modalities, including visual, auditory, haptic, somatosensory, and olfactory.In this way, augmented reality alters one’s ongoing perception of a real world environment, whereas virtual reality completely replaces the user's real world environment with a simulated one.
Mixed Reality (MR)
Mixed reality (MR) sometimes referred to as hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations where physical and digital objects co-exist and interact in real time. Mixed reality takes place not only in the physical world or the virtual world, but is a mix of reality and virtual reality, encompassing both augmented reality and augmented virtuality via immersive technology.
Augmented Reality Interaction
Augmented Reality (AR) interaction methods enable users to engage with digital content in immersive and intuitive ways. The main types of AR interaction include: Marker-based; Markerless; Projection-based; Geolocation-based; Gesture-based and Object-based Interaction
Marker-Based Interaction
Marker-based interaction in Augmented Reality (AR) involves using a predefined visual marker, such as a QR code, image, or specific pattern, to trigger and anchor digital content in the real world. The AR system detects the marker through a camera, analyzes its position and orientation, and overlays virtual objects or information on top of it. This method is highly effective for applications requiring precise alignment of digital elements with physical environments, such as in education, advertising, or product visualization.
Marker-Less Interaction
Markerless interaction in Augmented Reality (AR) relies on spatial awareness and environmental understanding rather than predefined visual markers. Using technologies accelerometers, gyroscopes, and advanced computer vision, AR systems can detect flat surfaces, depth, and positions in the real world. This allows users to place and interact with digital objects anywhere in their environment. Markerless AR is widely used in applications like navigation, gaming, interior design, and immersive learning experiences.
Geolocation-Based Interaction
Geolocation-based interaction in Augmented Reality (AR) utilizes GPS, Wi-Fi, or cellular network data to determine a user's location and anchor AR content to specific geographical coordinates. This type of interaction enables users to experience location-specific digital content, such as virtual landmarks, interactive tours, or real-time navigation. It is commonly used in applications like location-based gaming, outdoor exploration, and tourism.
Face Tracking Based Interaction
Face-tracking-based interaction in Augmented Reality (AR) utilizes advanced facial detection and tracking technologies to map and follow the movements of a user’s face in real time. This allows AR systems to overlay virtual content, such as masks, animations, or filters, directly onto facial features, adapting dynamically as the user moves or changes expressions. It is widely used in applications like social media effects, virtual makeup testing, and immersive gaming experiences.
Gesture-Based Interaction
Gesture-based interaction in Augmented Reality (AR) allows users to control and interact with virtual content through natural hand or body movements. Using technologies like motion sensors, depth cameras, or computer vision, the AR system detects and interprets gestures such as swiping, pinching, pointing, or waving. This form of interaction provides an intuitive and immersive experience, often used in applications like gaming, virtual try-ons, and interactive learning environments.
Case Study: ARMazing
ARMazing Animal & Dino Play is an AR (Augmented Reality) based application that allows you to create exciting scenes with virtual animals. You can choose your favorite animal, add trees, flowers, or other cool visual effects, then arrange everything according to your wishes.
ARMazing (Animal Management)
ARMazing (Object Management)
ARMazing for Medsos
ARMazing for Storytelling
TERIMA KASIH