适用宇航智能交互场景的混合现实技术研究

A Study of Mixed Reality Applied to Aerospace Intelligent Interaction[JZ)][HS)]

摘要:

随着中国空间站的逐步建成,航天员会面临执行诸如设备更换、空间实验和太空行走等在轨任务的挑战;但由于通讯延迟等影响,地面指挥中心难以对航天员提供全天候的技术支持,要求航天员具备独立获取信息支持的能力,混合现实技术可以较好地解决这一问题;首先介绍了混合现实技术的概念,并对该技术进行了宇航应用特点分析;利用Unity创建虚拟模型,在VS2015的开发平台下编写语音指令、手势操作及凝视等控制程序,基于HoloLens的混合现实头盔实现应用;重点对空间扫描构图进行了研究,通过HoloLens的深度摄像头扫描室内环境,对空间构图数据进行分析与处理,实现了将全息影像投影于真实世界的表面,并与全息影像开展多种形式的物理交互;证明了混合现实技术在航天员在轨辅助支持上实现的可行性。

Abstract:

As Chinese space station is being established,the astronaut will face a challenge of a long-term on-orbit task, such as the equipment replacement, the space test and the space walk. But for the communication delay,the mission control center can hardly offer all-weather technical supports for astronauts,so the astronauts must poccess the capability of getting information supports independently.The technology of mixed reality can solve this problem. At first, the concept of the mixed reality is introduced, the space application characteristics of this technique is also analyzed. The voice command, the gesture control and the gaze are accomplished under the development platform of the VS2015,the app is operated on HoloLens. Our study focuses on the spatial mapping, the paper take an analysis of the spatial mapping data by scanning the indoor environment. The application can project holograms on the surface of the real world.Users can also take some physics interactions with the holograms.The study demonstrates the feasibility of the mixed reality for the on-orbit support of the astronauts.