基于大数据技术的网络异常行为检测模型

A Network Abnormal Behavior Detection Model Based on Big Data Technology

摘要:

针对传统的网络异常检测受数据存储、处理能力的限制,存在准确率较低、误报率较高以及无法检测未知攻击的问题。在Spark框架下结合改进的支持向量机和随机森林算法,提出了一种基于大数据技术的网络异常行为检测模型。使用NSL-KDD数据集进行了方法验证,表明该方法在准确率和误报率方面明显优于传统的检测算法,整体检测的准确率和误报率分别为96.61%和2.92%,DOS、Probe、R2L和U2R四种攻击类型的准确率分别达到98.01%、88.29%、94.03%和66.67%,验证了方法的有效性。

Abstract:

The traditional network anomaly detection is limited by data storage and processing capabilities,which has the problems of low accuracy rate,high false alarm rate and unable to detect unknown attacks.To resolve this,combined with the improved Support Vector Machine and Random Forest algorithm in Spark, a network abnormal behavior detection model based on big data technology is proposed.The method is verified by NSL-KDD data set,which shows that the method is superior to the traditional detection algorithm in accuracy and false positive rate.The accuracy and false positive rate of the overall detection are 96.61% and 2.92%,The accuracy rates of DOS, Probe, R2L and U2R respectively were 98.01%, 88.29%, 94.03% and 66.67%,which verified the effectiveness of the method.