Touchless Hand Gesture Recognition System to Manipulate Digital Study Models

Objective: Touchless interactive system for the dentist to indirectly manipulate the digital image has the potential to address the sterility restrictions issues in the dental practice.In this paper, we present an evaluation of a hand gesture recognition system for interaction and manipulation of three dimensional (3D) digital images via the Kinect motion sensor to prevent cross infection within the clinical environment. Method:  A cross sectional study was conducted among healthcare personnel. The hand gesture system developed under the University of Malaya Research Grand project (RG401/12HTM) was assessed on selected participants using questionnaire that had been validated. This study involved assessing the accuracy and reliability of the hand gesture system using weighted kappa. The commands to control the system were evaluated. Friedman test followed by post hoc Wilcoxon test and average index value were used to assess participants’ acceptance of the proposed hand gestures. Summated scale and Pearson correlation were used to evaluate their awareness on cross infection issues and their opinion on the usability of the system for cross infection control. Result: The hand gesture system demonstrated moderate to good inter-rater reliability with weighted kappa values between 0.4 to 0.8. “Reset" command was significantly thought as the most comfortable motion whereas “Select menu” was the least comfortable motion. The average index values indicated that hand gestures for all the motions were suitable, should be maintained and inoffensive. In addition, a positive linear correlation was found between participants’ awareness on cross infection and perception on usability of the system for cross infection control (r=0.467, p<0.00). Conclusion: Touchless hand gesture user interface system has a high potential to be used in the clinical setting and may help improve cross infection control during clinical assessment of study models.