Hand Gesture Based Interactive Control (HGIC) for Multi-UAV Operations

Hand gesture recognition is a technology that achieves interaction by recognizing human gesture actions. This questionnaire is aimed at gathering feedback on a hand gesture recognition system designed for intuitive control of multi-rotor unmanned aerial vehicles. The system features a mode-based gesture library for navigating, configuration, formation, and tasking, supported by a user-friendly interface for real-time human-mUAV interaction. 

After using  HGIC for multi-UAV control on the lab workstation, we invite you to evaluate the performance, regarding usability, intuitiveness, accuracy, UI design, and the rationality of gesture classification.

  • Address: Room AEB 057 Cognitive Robotics and AI lab(CRAI), College of Aeronautics and Engineering Kent State University,  1400 University Esplanade, Kent, OH  44242
  • PI: Dr. Rui Liu (rliu11@kent.edu). Google Scholar: https://scholar.google.com/citations?user=wAEi6FUAAAAJ&hl=en
  • Student responder: Mengsha Hu (mhu8@kent.edu), Runxiang Jin (rjin4@kent.edu)
  • Time estimated：10 minutes
  • This statement guarantees to the participants that their data will be kept confidential. Use only when ensuring the safety of the laboratory environment for testing or developing gesture recognition systems.
Test Volunteer Name *
Your answer
This picture shows a series of numbered gestures, each of which may represent a specific command or action. These gestures were designed for an interactive system communication in this article, which may be used to control drones or other types of machines.

How clear do you find the gestures presented in the images?
Captionless Image
If any of the gestures depicted in the images seem unclear or could be misunderstood, please identify those gestures and explain why you find them to be confusing.
Your answer
The gesture library images of drones, which refer from the military's task gestures are divided into 5 parts, each representing an operating mode, including navigation, configuration, formation, mission, and emergency situations. The design of gestures takes into account the ease of user understanding and memory, in order to achieve intuitive human-computer interaction.

Do you think the gesture design is reasonable, regarding assigning commands to gestures?
Captionless Image
If you find any gestures in the library to be unreasonable in terms of their assigned commands, could you please specify which gesture(s) and explain what makes them seem illogical or hard to understand?
Your answer
The image shows a set of gestures for swarm control and their corresponding effects on UAV swarm formations, including evolving from circles to lines, culminating in a V-shape, as well as expanding, merging, and splitting into three distinct groupings. 

How reasonable do you find the motion of each gesture about its intended action?
Captionless Image
If you identified any gestures that seemed less reasonable or not intuitive, could you please specify which ones and suggest how the gesture could be altered to better convey its intended action?
Your answer
How convenient do you find controlling the UAVs with the gesture system compared to traditional methods?
How fast is the recognition speed of the gesture system comparing with traditional input devices, e.g.,  mouse or keyboard?
How difficult did you find it to remember the commands associated with each gesture after a brief exposure to the image?
How user-friendly do you find the user interface of the gesture control system?
Captionless Image
Could you provide specific feedback on which aspects of the user interface can be improved？
Your answer
How efficient do you feel to switch between different modes (e.g., Navigation Mode, Formation Mode) when using the gesture UI?
How do you rate the overall efficiency of the gesture control system in terms of accuracy, speed, and ease of use?
Get link
Never submit passwords through Google Forms.
This form was created inside of Kent State University.

Does this form look suspicious? Report

Google Forms