基于单目视觉的虚拟鼠标方法

A technique of virtual mouse based on monocular vision

摘要:

自然的交互方式有利于提高增强现实系统的真实感和沉浸感，是增强现实技术的重要研究内容。针对这一问题，提出一种基于单目视觉的虚拟鼠标实现方法，只需要使用单个摄像头，即可对裸手手势进行识别进而模拟真实鼠标动作，最后基于该方法开发了基于单目视觉的虚拟鼠标系统。首先，根据色度信息，分割手部肤色区域；然后，基于指尖的形态学特征识别指尖点，并过滤以排除误检点；最后根据指尖点及其坐标控制光标模拟鼠标动作。实验结果表明，该系统设备简单、精度较高，完全可以实现各种鼠标动作的模拟。

Abstract:

Natural human-computer interaction, which helps to improve the sense of reality and immersive, is an important research issue of augmented reality. Therefore, a technique of virtual mouse based on monocular vision is presented. Bare hand gestures can be recognized only with a single camera. Firstly, chromatic information is used to segment hand area. Subsequently, according to morphological feature of fingers, fingertips are located using curvature, and error detection points are ruled out. Finally, cursor can be controlled to simulate mouse action. Experiment shows that all of the mouse actions can be simulate accurately. This method has advantages such as high precision, simple and cheap equipment, and so on.