RV - AULA 06 - PSI3502/2023
Input Devices and Tracking
Outline
Talk about properties of input devices in general and designed specifically for VE interaction.
Focus on the problem of motion tracking, discussing the basic principles of motion tracking and property of tracking systems.
Purpose of Input Devices
Input Devices
Purpose of Input Devices
The first part of any human computer interaction feedback loop.
Purpose: to convey the user’s action to the system where it can be interpreted.
Active and passive input.
Input Feedback
Multimodal feedback: active and passive feedback.
Some devices use only active feedback, i.e. Microsoft Kinect or Leap Motion.
Leap Motion
Microsoft Kinect
Human Related Issues
Encumbrance (desconforto): the level of physical discomfort resulting from interaction with an input device (uncomfortable or unnatural positions).
Time to disengage: users need to interact with the system only at certain moments in time. The time to disengage from a computer keyboard is different than a data glove.
Degrees of Freedom
Number of independent variables that can be controlled directly by the device.
Computer mouse: two degrees of freedom - translation of a pointer in the X and Y plane.
Single object in 3D space: six degrees of freedom.
Degrees of Freedom
http://www.leadingones.com/assets/img/articles-illu/intro-to-vr/degrees-of-freedom.jpg
Data Gloves
Pinch (pinça)
Data Gloves
Sayre Glove, by Electronic Visualization Laboratory at University of Illinois at Chicago in 1977.
https://www.evl.uic.edu/resizedImages/1280x720-sayreglove_sm.png
Data Gloves
Nintendo + Mattel Power Glove.
https://upload.wikimedia.org/wikipedia/commons/thumb/d/d3/NES-Power-Glove.jpg/1200px-NES-Power-Glove.jpg
Data Gloves
Cyber Glove - 1990.
http://www.cyberglovesystems.com/cyberglove-iii/
Pinch Glove
Pinch Glove by PINCH System.
https://br.pinterest.com/pin/761038037001828005/
Tracking
Motion tracking: denotes the tracking of a change of the position and orientation of an object in reference to some point in the 3D space.
http://mobilemotiontracking.blogspot.com/2012/10/how-do-i-choose-best-motion-tracking.html
Optical Tracking
Tracker Properties
Resolution (3d point in Space)
Accuracy
Jitter (noise associated with 3D Points)
Latency (delay capturing and transmitting data)
Drift (yes, in time 3d points are not the same)
Update Rate (frame rate)
Tracking Technology
Two large classes: contact-based trackers and contactless trackers. (wireless and wired)
Inertial tracking devices based on microelectro-mechanical sensors (MEMS) have seen a recent surge in applications for motion tracking and similar tasks. (gyroscopes and accelerometers)
Mechanical Trackers
https://electronics.howstuffworks.com/gadgets/other-gadgets/VR-gear6.htm
Embedded inertial platform
Electromagnetic Trackers, AC and DC Electromagnetic Trackers
Two components: transmitter and receiver.
Three orthogonal electromagnetic fields.
AC-based systems use time multiplexing and frequency multiplexing methods.
DC trackers use static magnetic fields to avoid environmental interference that affects AC-based trackers.
Acoustic Trackers
https://www.roadtovr.com/overview-of-positional-tracking-technologies-virtual-reality/
Optical Trackers
Optical Trackers can have two system configurations:
Eyetracking
References: www.eyegaze.com www.smi.de
Consumer Products
Motion Capture
Motion Capture implies following the change in the position and orientation of multiples points simultaneously in order to determinate the posture of the whole human body.
Face Tracking
https://www.youtube.com/watch?v=pHosTbKOAxg
Locomotion Platforms
Reference:
References: http://www.media.mit.edu/affect/
Referências
Virtual Reality and Virtual Environments in 10 Lectures - Stanislav Stankovic
D. A. Bowman, C. A. Wingrave, J. M. Campbell, V. Q. Ly, “Using Pinch Gloves for both Natural and Abstract Interaction Techniques in Virtual Environments,” Proc. HCI International, 2001.
G. Burdea, P. Coffet, Virtual Reality Technology, Second Edition, Wiley-IEEE Press, June, 2003.
E. Foxilin, “Motion tracking requirements and technologies,”, in K. Stanny (ed.), Handbook on Virtual Environments, Elrbaum, Mahwah, NJ, pp. 163-210.
P. Viola, M. J. Jones, “Robust real-time face detection,” International Journal of Computer Vision, Vol. 57, No. 2, 2004, pp. 137-154.