Close

Presentation

Usable Without Touch? Revealing the Relationship Between Usability and Mid-Air Gestures
DescriptionMid-air gestures are an interaction method where the participant uses their hand(s) to perform a movement or sequence that represents control. This method of interaction is becoming more common for public use, yet the impact on usability lacks summarization. This systematic review explores themes of usability testing methods, applications, gesture design, multimodal combinations, and input comparisons. Findings reveal that usability depends on gesture design factors, context, and user characteristics. Currently, various usability methods are used to evaluate the usability of mid-air gestures. We found that user-generated gesture sets tend to be more usable than pre-chosen gesture sets. We also found that mid-air gesture interaction performs better when paired with a feedback method. Additionally, when mid-air gestures are compared to familiar interaction modalities like touch or voice, they are often less preferred, pointing to gaps in intuitiveness and learnability. Participant differences, familiarity, and training also influence the perceived usability, highlighting the need for inclusive and adaptive design. We propose design guidelines to improve gesture systems, feedback, contextual fit, and usability evaluations.