This paper focuses on the intrusion classification of huge amounts of data in a network intrusion detection system. An intrusion detection model based on deep belief nets （DBN） is proposed to conduct intrusion detec...This paper focuses on the intrusion classification of huge amounts of data in a network intrusion detection system. An intrusion detection model based on deep belief nets （DBN） is proposed to conduct intrusion detection,and the principles regarding DBN are discussed.The DBN is composed of a multiple unsupervised restricted Boltzmann machine （RBM） and a supervised back propagation （BP）network.First,the DBN in the proposed model is pre-trained in a fast and greedy way,and each RBM is trained by the contrastive divergence algorithm.Secondly,the whole network is fine-tuned by the supervised BP algorithm,which is employed for classifying the low-dimensional features of the intrusion data generated by the last RBM layer simultaneously.The experimental results on the KDD CUP 1999 dataset demonstrate that the DBN using the RBM network with three or more layers outperforms the self-organizing maps （SOM）and neural network （NN）in intrusion classification.Therefore,the DBN is an efficient approach for intrusion detection in high-dimensional space.展开更多
In recent years, network traffic data have become larger and more complex, leading to higher possibilities of network intrusion. Traditional intrusion detection methods face difficulty in processing high-speed network...In recent years, network traffic data have become larger and more complex, leading to higher possibilities of network intrusion. Traditional intrusion detection methods face difficulty in processing high-speed network data and cannot detect currently unknown attacks. Therefore, this paper proposes a network attack detection method combining a flow calculation and deep learning. The method consists of two parts: a real-time detection algorithm based on flow calculations and frequent patterns and a classification algorithm based on the deep belief network and support vector machine(DBN-SVM). Sliding window(SW) stream data processing enables real-time detection, and the DBN-SVM algorithm can improve classification accuracy. Finally, to verify the proposed method, a system is implemented.Based on the CICIDS2017 open source data set, a series of comparative experiments are conducted. The method's real-time detection efficiency is higher than that of traditional machine learning algorithms. The attack classification accuracy is 0.7 percentage points higher than that of a DBN, which is 2 percentage points higher than that of the integrated algorithm boosting and bagging methods. Hence, it is suitable for the real-time detection of high-speed network intrusions.展开更多
An enhanced algorithm is proposed to recognize multi-channel electromyography(EMG) patterns using deep belief networks(DBNs). It is difficult to classify the EMG features because an EMG signal has nonlinear and time-v...An enhanced algorithm is proposed to recognize multi-channel electromyography(EMG) patterns using deep belief networks(DBNs). It is difficult to classify the EMG features because an EMG signal has nonlinear and time-varying characteristics.Therefore, in several previous studies, various machine-learning methods have been applied. A DBN is a fast, greedy learning algorithm that can find a fairly good set of weights rapidly, even in deep networks with a large number of parameters and many hidden layers. To evaluate this model, we acquired EMG signals, extracted their features, and then compared the model with the DBN and other conventional classifiers. The accuracy of the DBN is higher than that of the other algorithms. The classification performance of the DBN model designed is approximately 88.60%. It is 7.55%(p=9.82×10-12) higher than linear discriminant analysis(LDA) and 2.89%(p=1.94×10-5) higher than support vector machine(SVM). Further, the DBN is better than shallow learning algorithms or back propagation(BP), and this model is effective for an EMG-based user-interfaced system.展开更多
Soil moisture content （SMC） is a key hydrological parameter in agriculture,meteorology and climate change,and understanding of spatio-temporal distributions of SMC in farmlands is important to address the precise ir...Soil moisture content （SMC） is a key hydrological parameter in agriculture,meteorology and climate change,and understanding of spatio-temporal distributions of SMC in farmlands is important to address the precise irrigation scheduling.However,the hybrid interaction of static and dynamic environmental parameters makes it particularly difficult to accurately and reliably model the distribution of SMC.At present,deep learning wins numerous contests in machine learning and hence deep belief network （DBN） ,a breakthrough in deep learning is trained to extract the transition functions for the simulation of the cell state changes.In this study,we used a novel macroscopic cellular automata （MCA） model by combining DBN to predict the SMC over an irrigated corn field （an area of 22 km^2） in the Zhangye oasis,Northwest China.Static and dynamic environmental variables were prepared with regard to the complex hydrological processes.The widely used neural network,multi-layer perceptron （MLP） ,was utilized for comparison to DBN.The hybrid models （MLP-MCA and DBN-MCA） were calibrated and validated on SMC data within four months,i.e.June to September 2012,which were automatically observed by a wireless sensor network （WSN） .Compared with MLP-MCA,the DBN-MCA model led to a decrease in root mean squared error （RMSE） by 18%.Thus,the differences of prediction errors increased due to the propagating errors of variables,difficulties of knowing soil properties and recording irrigation amount in practice.The sequential Gaussian simulation （s Gs） was performed to assess the uncertainty of soil moisture estimations.Calculated with a threshold of SMC for each grid cell,the local uncertainty of simulated results in the post processing suggested that the probability of SMC less than 25% will be difference in different areas at different time periods.The current results showed that the DBN-MCA model performs better than the MLP-MCA model,and the DBN-MCA model provides a powerful tool for predicting SMC in highly non-linear forms.Moreover,because modeling soil moisture by using environmental variables is gaining increasing popularity,DBN techniques could contribute a lot to enhancing the calibration of MCA-based SMC estimations and hence provide an alternative approach for SMC monitoring in irrigation systems on the basis of canals.展开更多
传统的多模态过程故障等级评估方法对模态之间的共性特征考虑较少,导致当被评估模态故障信息不充分时,评估的准确性较低.针对此问题,首先,提出一种共性–个性深度置信网络(Common and specific deep belief network,CS-DBN),该网络充分...传统的多模态过程故障等级评估方法对模态之间的共性特征考虑较少,导致当被评估模态故障信息不充分时,评估的准确性较低.针对此问题,首先,提出一种共性–个性深度置信网络(Common and specific deep belief network,CS-DBN),该网络充分利用深度置信网络(Deep belief network,DBN)的深度分层特征提取能力,通过度量多模态数据间分布的相似性和差异性,进一步得到能够反映多模态过程共有信息的共性特征以及反映每个模态独有信息的个性特征;其次,基于CS-DBN,利用多模态过程的已知故障等级数据生成多模态共性–个性特征集,通过加权逻辑回归构建故障等级评估模型;最后,将所提方法应用于带钢热连轧生产过程的故障等级评估中.应用结果表明,随着多模态故障等级数据的增加,所提方法的评估准确率逐渐增加,当故障信息充足时,评估准确率可达98.75%;故障信息不足时,与传统方法相比,评估准确率提升近10%.展开更多
基金The National Key Technology R&D Program during the 12th Five-Year Plan Period(No.2013BAK01B02)the National Natural Science Foundation of China(No.61373176)the Scientific Research Projects of Shaanxi Educational Committee(No.14JK1693)
文摘This paper focuses on the intrusion classification of huge amounts of data in a network intrusion detection system. An intrusion detection model based on deep belief nets （DBN） is proposed to conduct intrusion detection,and the principles regarding DBN are discussed.The DBN is composed of a multiple unsupervised restricted Boltzmann machine （RBM） and a supervised back propagation （BP）network.First,the DBN in the proposed model is pre-trained in a fast and greedy way,and each RBM is trained by the contrastive divergence algorithm.Secondly,the whole network is fine-tuned by the supervised BP algorithm,which is employed for classifying the low-dimensional features of the intrusion data generated by the last RBM layer simultaneously.The experimental results on the KDD CUP 1999 dataset demonstrate that the DBN using the RBM network with three or more layers outperforms the self-organizing maps （SOM）and neural network （NN）in intrusion classification.Therefore,the DBN is an efficient approach for intrusion detection in high-dimensional space.
基金supported by the National Key Research and Development Program of China(2017YFB1401300,2017YFB1401304)the National Natural Science Foundation of China(61702211,L1724007,61902203)+3 种基金Hubei Provincial Science and Technology Program of China(2017AKA191)the Self-Determined Research Funds of Central China Normal University(CCNU)from the Colleges’Basic Research(CCNU17QD0004,CCNU17GF0002)the Natural Science Foundation of Shandong Province(ZR2017QF015)the Key Research and Development Plan–Major Scientific and Technological Innovation Projects of Shandong Province(2019JZZY020101)。
文摘In recent years, network traffic data have become larger and more complex, leading to higher possibilities of network intrusion. Traditional intrusion detection methods face difficulty in processing high-speed network data and cannot detect currently unknown attacks. Therefore, this paper proposes a network attack detection method combining a flow calculation and deep learning. The method consists of two parts: a real-time detection algorithm based on flow calculations and frequent patterns and a classification algorithm based on the deep belief network and support vector machine(DBN-SVM). Sliding window(SW) stream data processing enables real-time detection, and the DBN-SVM algorithm can improve classification accuracy. Finally, to verify the proposed method, a system is implemented.Based on the CICIDS2017 open source data set, a series of comparative experiments are conducted. The method's real-time detection efficiency is higher than that of traditional machine learning algorithms. The attack classification accuracy is 0.7 percentage points higher than that of a DBN, which is 2 percentage points higher than that of the integrated algorithm boosting and bagging methods. Hence, it is suitable for the real-time detection of high-speed network intrusions.
基金supported by Inha University Research Grant,Korea
文摘An enhanced algorithm is proposed to recognize multi-channel electromyography(EMG) patterns using deep belief networks(DBNs). It is difficult to classify the EMG features because an EMG signal has nonlinear and time-varying characteristics.Therefore, in several previous studies, various machine-learning methods have been applied. A DBN is a fast, greedy learning algorithm that can find a fairly good set of weights rapidly, even in deep networks with a large number of parameters and many hidden layers. To evaluate this model, we acquired EMG signals, extracted their features, and then compared the model with the DBN and other conventional classifiers. The accuracy of the DBN is higher than that of the other algorithms. The classification performance of the DBN model designed is approximately 88.60%. It is 7.55%(p=9.82×10-12) higher than linear discriminant analysis(LDA) and 2.89%(p=1.94×10-5) higher than support vector machine(SVM). Further, the DBN is better than shallow learning algorithms or back propagation(BP), and this model is effective for an EMG-based user-interfaced system.
基金supported by the National Natural Science Foundation of China (41130530,91325301,41401237,41571212,41371224)the Jiangsu Province Science Foundation for Youths (BK20141053)the Field Frontier Program of the Institute of Soil Science,Chinese Academy of Sciences (ISSASIP1624)
文摘Soil moisture content （SMC） is a key hydrological parameter in agriculture,meteorology and climate change,and understanding of spatio-temporal distributions of SMC in farmlands is important to address the precise irrigation scheduling.However,the hybrid interaction of static and dynamic environmental parameters makes it particularly difficult to accurately and reliably model the distribution of SMC.At present,deep learning wins numerous contests in machine learning and hence deep belief network （DBN） ,a breakthrough in deep learning is trained to extract the transition functions for the simulation of the cell state changes.In this study,we used a novel macroscopic cellular automata （MCA） model by combining DBN to predict the SMC over an irrigated corn field （an area of 22 km^2） in the Zhangye oasis,Northwest China.Static and dynamic environmental variables were prepared with regard to the complex hydrological processes.The widely used neural network,multi-layer perceptron （MLP） ,was utilized for comparison to DBN.The hybrid models （MLP-MCA and DBN-MCA） were calibrated and validated on SMC data within four months,i.e.June to September 2012,which were automatically observed by a wireless sensor network （WSN） .Compared with MLP-MCA,the DBN-MCA model led to a decrease in root mean squared error （RMSE） by 18%.Thus,the differences of prediction errors increased due to the propagating errors of variables,difficulties of knowing soil properties and recording irrigation amount in practice.The sequential Gaussian simulation （s Gs） was performed to assess the uncertainty of soil moisture estimations.Calculated with a threshold of SMC for each grid cell,the local uncertainty of simulated results in the post processing suggested that the probability of SMC less than 25% will be difference in different areas at different time periods.The current results showed that the DBN-MCA model performs better than the MLP-MCA model,and the DBN-MCA model provides a powerful tool for predicting SMC in highly non-linear forms.Moreover,because modeling soil moisture by using environmental variables is gaining increasing popularity,DBN techniques could contribute a lot to enhancing the calibration of MCA-based SMC estimations and hence provide an alternative approach for SMC monitoring in irrigation systems on the basis of canals.
文摘传统的多模态过程故障等级评估方法对模态之间的共性特征考虑较少,导致当被评估模态故障信息不充分时,评估的准确性较低.针对此问题,首先,提出一种共性–个性深度置信网络(Common and specific deep belief network,CS-DBN),该网络充分利用深度置信网络(Deep belief network,DBN)的深度分层特征提取能力,通过度量多模态数据间分布的相似性和差异性,进一步得到能够反映多模态过程共有信息的共性特征以及反映每个模态独有信息的个性特征;其次,基于CS-DBN,利用多模态过程的已知故障等级数据生成多模态共性–个性特征集,通过加权逻辑回归构建故障等级评估模型;最后,将所提方法应用于带钢热连轧生产过程的故障等级评估中.应用结果表明,随着多模态故障等级数据的增加,所提方法的评估准确率逐渐增加,当故障信息充足时,评估准确率可达98.75%;故障信息不足时,与传统方法相比,评估准确率提升近10%.
