基于HoloLens的飞机维修远程指导系统

Remote Guidance System for Aircraft Maintenance Based on Hololens

摘要:

针对飞机维修人员在遭遇棘手维修问题时难以快速处理的问题，提出一种基于HoloLens的飞机维修远程指导系统；采用改进的$P算法，对标注手势点序列进行时间标记，通过对专家端手绘笔划的快速识别，同时结合HoloLens设备的空间感知能力进行三维模型标注的放置；这种新型的索引标注方式，减少了专家端从模型库中调用标注的时间；同时结合二维标注，通过对圈选坐标信息和深度信息获取，对重点维修部位进行标注；在佩戴HoloLens设备时提高了维修人员对专家给出的特定维修部位和重点维修流程的理解程度；对改进$P算法速率进行了实验，实验验证了本文所改进的$P算法提升了手势识别速率，同时二维标注点的准确性也得到了保障，证明了维修远程指导系统的可用性。

Abstract:

Aiming at the problems that are difficult to deal with quickly when aircraft maintenance personnel encounter difficult maintenance problems, a remote guidance system for aircraft maintenance based on HoloLens is proposed. The improved $ P algorithm is used to mark the time of the marked gesture point sequence. Through the rapid recognition of the expert 's hand-painted strokes, combined with the spatial perception ability of the HoloLens device, the three-dimensional model annotation is placed. This new index annotation method reduces the time for the expert to call annotations from the model library. At the same time, combined with two-dimensional labeling, key maintenance parts are marked by obtaining the selected coordinate information and depth information. Increased understanding by maintenance personnel of specific repair areas and priority repair processes given by experts when wearing HoloLens equipment. Experiments are conducted on the improved $P algorithm rate. The experiments verify that the improved $P algorithm in this paper improves the gesture recognition rate, and the accuracy of two-dimensional annotation points is also guaranteed, which proves the availability of the maintenance remote guidance system.