Abstract:This study implemented a ship navigation virtual simulation based on the Unity engine and constructed a virtual hand model driven by a data glove and orientation tracker. The spatial coordinates of the human hand were obtained and converted into virtual coordinates of the virtual hand model. Different hand gestures were used to control the ship's virtual navigation, including forward, backward, steering, and UI ray interactions. Six static hand gestures were tested in interaction experiments, with error calibration and Kalman filtering algorithms applied to enhance data stability. The experimental results showed that the average recognition success rate for the six gestures was 97%. Factors affecting gesture recognition accuracy include gesture complexity, sensor errors, VR device base station location, occlusion effects, and external interference. The experiment validated the feasibility and effectiveness of the ship navigation simulation interaction based on the Noitom data glove, providing technical support for improving the efficiency and convenience of human-machine interaction. Key words:Inertial sensors; Gesture recognition (HGR); Human Computer Interaction (HCI); Intelligent wearable devices; Static gestures; Kalman filter algorithm