基于场景理解的人体动作识别模型

Human action recognition model based on scene understanding

摘要:

为了满足在复杂环境下对人体动作识别的需求，提出了一种基于场景理解的双流网络识别结构。将场景信息作为辅助信息加入了人体动作识别网络结构中，改善识别网络的识别准确率。对场景识别网络与人体动作识别网络不同的融合方式进行研究，确定了网络最佳识别结构。通过分析不同参数对识别准确率的影响，最终确定了双流网络的所有结构参数，设计并训练完成了双流网络结构。通过在UCF50，UCF101等公开数据集上实验，分别取得了95%,93%的准确率，高于典型的识别网络结果。对其他一些典型识别网络加入同样场景信息进行了研究，其实验结果证明了此方法可以有效改善识别准确率。

Abstract:

In order to meet the needs of human action recognition in complex environments, a dual-flow network recognition structure based on scene understanding is proposed. The scene information is added as auxiliary information to the human action recognition network structure to improve the recognition accuracy of the recognition network. The different fusion modes of the scene recognition network and the human action recognition network are studied, and the network optimal identification structure is determined. By analyzing the influence of different parameters on the recognition accuracy, all the structural parameters of the dual-flow network are finally determined. Through experiments on public data sets such as UCF50 and UCF101, 95% and 93% accuracy were obtained, respectively, which is higher than the typical identification network results. Some other typical identification networks have been studied by adding the same scene information. The experimental results show that this method can effectively improve the recognition accuracy. Key words: Dual stream network structure; Scene recognition; Human action recognition