In this paper, the global asymptotic stability is investigated for a class of Cohen-Grossberg neural networks with time-varying and distributed delays. By using the Lyapunov-Krasovskii functional and equivalent descri...In this paper, the global asymptotic stability is investigated for a class of Cohen-Grossberg neural networks with time-varying and distributed delays. By using the Lyapunov-Krasovskii functional and equivalent descriptor form of the considered system, several delay-dependent sufficient conditions are obtained to guarantee the asymptotic stability of the addressed systems. These conditions are dependent on both time-varying and distributed delays and presented in terms of LMIs and therefore, the stability criteria of such systems can be checked readily by resorting to the Matlab LMI toolbox. Finally, an example is given to show the effectiveness and less conservatism of the proposed methods.展开更多
The stability analysis of Cohen-Grossberg neural networks with multiple delays is given. An approach combining the Lyapunov functional with the linear matrix inequality （LMI） is taken to obtain the sufficient condit...The stability analysis of Cohen-Grossberg neural networks with multiple delays is given. An approach combining the Lyapunov functional with the linear matrix inequality （LMI） is taken to obtain the sufficient conditions for the globally asymptotic stability of equilibrium point. By using the properties of matrix norm, a practical corollary is derived. All results are established without assuming the differentiability and monotonicity of activation functions. The simulation samples have proved the effectiveness of the conclusions.展开更多
In this paper, the Cohen-Grossberg neural networks with time-varying delays and impulses are considered. New sufficient conditions for the existence and global exponential stability of a unique equilibrium point are e...In this paper, the Cohen-Grossberg neural networks with time-varying delays and impulses are considered. New sufficient conditions for the existence and global exponential stability of a unique equilibrium point are established by using the fixed point theorem and Lyapunov functional. An example is given to demonstrate the effectiveness of our results.展开更多
The global exponential stability of Cohen-Grossberg neural networks with time-varying delays is studied. By constructing several suitable Lyapunov functionals and utilizing differential in-equality techniques, some su...The global exponential stability of Cohen-Grossberg neural networks with time-varying delays is studied. By constructing several suitable Lyapunov functionals and utilizing differential in-equality techniques, some sufficient criteria for the global exponential stability and the exponential convergence rate of the equilibrium point of the system are obtained. The criteria do not require the activation functions to be differentiable or monotone nondecreasing. Some stability results from previous works are extended and improved. Comparisons are made to demonstrate the advantage of our results.展开更多
A class of generalized Cohen-Grossberg neural networks（CGNNs） with variable de- lays are investigated. By introducing a new type of Lyapunov functional and applying the homeomorphism theory and inequality technique,...A class of generalized Cohen-Grossberg neural networks（CGNNs） with variable de- lays are investigated. By introducing a new type of Lyapunov functional and applying the homeomorphism theory and inequality technique, some new conditions axe derived ensuring the existence and uniqueness of the equilibrium point and its global exponential stability for CGNNs. These results obtained are independent of delays, develop the existent outcome in the earlier literature and are very easily checked in practice.展开更多
This paper addresses the coexistence and local stability of multiple equilibrium points for fractional-order Cohen-Grossberg neural networks(FOCGNNs)with time delays.Based on Brouwer's fixed point theorem,sufficie...This paper addresses the coexistence and local stability of multiple equilibrium points for fractional-order Cohen-Grossberg neural networks(FOCGNNs)with time delays.Based on Brouwer's fixed point theorem,sufficient conditions are established to ensure the existence of Πi=1^n(2Ki+1)equilibrium points for FOCGNNs.Through the use of Hardy inequality,fractional Halanay inequality,and Lyapunov theory,some criteria are established to ensure the local Lagrange stability and the local Lyapunov asymptotical stability of Πi=1^n(Ki+1)equilibrium points for FOCGNNs.The obtained results encompass those of integer-order Hopfield neural networks with or without delay as special cases.The activation functions are nonlinear and nonmonotonic.There could be many corner points in this general class of activation functions.The structure of activation functions makes FOCGNNs could have a lot of stable equilibrium points.Coexistence of multiple stable equilibrium points is necessary when neural networks come to pattern recognition and associative memories.Finally,two numerical examples are provided to illustrate the effectiveness of the obtained results.展开更多
The increasing popularity of the Internet and the widespread use of information technology have led to a rise in the number and sophistication of network attacks and security threats.Intrusion detection systems are cr...The increasing popularity of the Internet and the widespread use of information technology have led to a rise in the number and sophistication of network attacks and security threats.Intrusion detection systems are crucial to network security,playing a pivotal role in safeguarding networks from potential threats.However,in the context of an evolving landscape of sophisticated and elusive attacks,existing intrusion detection methodologies often overlook critical aspects such as changes in network topology over time and interactions between hosts.To address these issues,this paper proposes a real-time network intrusion detection method based on graph neural networks.The proposedmethod leverages the advantages of graph neural networks and employs a straightforward graph construction method to represent network traffic as dynamic graph-structured data.Additionally,a graph convolution operation with a multi-head attention mechanism is utilized to enhance the model’s ability to capture the intricate relationships within the graph structure comprehensively.Furthermore,it uses an integrated graph neural network to address dynamic graphs’structural and topological changes at different time points and the challenges of edge embedding in intrusion detection data.The edge classification problem is effectively transformed into node classification by employing a line graph data representation,which facilitates fine-grained intrusion detection tasks on dynamic graph node feature representations.The efficacy of the proposed method is evaluated using two commonly used intrusion detection datasets,UNSW-NB15 and NF-ToN-IoT-v2,and results are compared with previous studies in this field.The experimental results demonstrate that our proposed method achieves 99.3%and 99.96%accuracy on the two datasets,respectively,and outperforms the benchmark model in several evaluation metrics.展开更多
BACKGROUND Mitochondrial genes are involved in tumor metabolism in ovarian cancer(OC)and affect immune cell infiltration and treatment responses.AIM To predict prognosis and immunotherapy response in patients diagnose...BACKGROUND Mitochondrial genes are involved in tumor metabolism in ovarian cancer(OC)and affect immune cell infiltration and treatment responses.AIM To predict prognosis and immunotherapy response in patients diagnosed with OC using mitochondrial genes and neural networks.METHODS Prognosis,immunotherapy efficacy,and next-generation sequencing data of patients with OC were downloaded from The Cancer Genome Atlas and Gene Expression Omnibus.Mitochondrial genes were sourced from the MitoCarta3.0 database.The discovery cohort for model construction was created from 70% of the patients,whereas the remaining 30% constituted the validation cohort.Using the expression of mitochondrial genes as the predictor variable and based on neural network algorithm,the overall survival time and immunotherapy efficacy(complete or partial response)of patients were predicted.RESULTS In total,375 patients with OC were included to construct the prognostic model,and 26 patients were included to construct the immune efficacy model.The average area under the receiver operating characteristic curve of the prognostic model was 0.7268[95% confidence interval(CI):0.7258-0.7278]in the discovery cohort and 0.6475(95%CI:0.6466-0.6484)in the validation cohort.The average area under the receiver operating characteristic curve of the immunotherapy efficacy model was 0.9444(95%CI:0.8333-1.0000)in the discovery cohort and 0.9167(95%CI:0.6667-1.0000)in the validation cohort.CONCLUSION The application of mitochondrial genes and neural networks has the potential to predict prognosis and immunotherapy response in patients with OC,providing valuable insights into personalized treatment strategies.展开更多
Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay di...Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay differential equations(DDEs)and delay integrodifferential equations(DIDEs)with constant delays,primarily due to their low regularity at delayinduced breaking points.In this paper,a DNN method that combines multi-task learning(MTL)which is proposed to solve both the forward and inverse problems of DIDEs.The core idea of this approach is to divide the original equation into multiple tasks based on the delay,using auxiliary outputs to represent the integral terms,followed by the use of MTL to seamlessly incorporate the properties at the breaking points into the loss function.Furthermore,given the increased training dificulty associated with multiple tasks and outputs,we employ a sequential training scheme to reduce training complexity and provide reference solutions for subsequent tasks.This approach significantly enhances the approximation accuracy of solving DIDEs with DNNs,as demonstrated by comparisons with traditional DNN methods.We validate the effectiveness of this method through several numerical experiments,test various parameter sharing structures in MTL and compare the testing results of these structures.Finally,this method is implemented to solve the inverse problem of nonlinear DIDE and the results show that the unknown parameters of DIDE can be discovered with sparse or noisy data.展开更多
In this paper,we propose a neural network approach to learn the parameters of a class of stochastic Lotka-Volterra systems.Approximations of the mean and covariance matrix of the observational variables are obtained f...In this paper,we propose a neural network approach to learn the parameters of a class of stochastic Lotka-Volterra systems.Approximations of the mean and covariance matrix of the observational variables are obtained from the Euler-Maruyama discretization of the underlying stochastic differential equations(SDEs),based on which the loss function is built.The stochastic gradient descent method is applied in the neural network training.Numerical experiments demonstrate the effectiveness of our method.展开更多
Objective:To explore a simple method for improving the diagnostic accuracy of malignant lung nodules based on imaging features of lung nodules.Methods:A retrospective analysis was conducted on the imaging data of 114 ...Objective:To explore a simple method for improving the diagnostic accuracy of malignant lung nodules based on imaging features of lung nodules.Methods:A retrospective analysis was conducted on the imaging data of 114 patients who underwent lung nodule surgery in the Thoracic Surgery Department of the First People’s Hospital of Huzhou from June to September 2024.Imaging features of lung nodules were summarized and trained using a BP neural network.Results:Training with the BP neural network increased the diagnostic accuracy for distinguishing between benign and malignant lung nodules based on imaging features from 84.2%(manual assessment)to 94.1%.Conclusion:Training with the BP neural network significantly improves the diagnostic accuracy of lung nodule malignancy based solely on imaging features.展开更多
Patients in intensive care units(ICUs)require rapid critical decision making.Modern ICUs are data rich,where information streams from diverse sources.Machine learning(ML)and neural networks(NN)can leverage the rich da...Patients in intensive care units(ICUs)require rapid critical decision making.Modern ICUs are data rich,where information streams from diverse sources.Machine learning(ML)and neural networks(NN)can leverage the rich data for prognostication and clinical care.They can handle complex nonlinear relation-ships in medical data and have advantages over traditional predictive methods.A number of models are used:(1)Feedforward networks;and(2)Recurrent NN and convolutional NN to predict key outcomes such as mortality,length of stay in the ICU and the likelihood of complications.Current NN models exist in silos;their integration into clinical workflow requires greater transparency on data that are analyzed.Most models that are accurate enough for use in clinical care operate as‘black-boxes’in which the logic behind their decision making is opaque.Advan-ces have occurred to see through the opacity and peer into the processing of the black-box.In the near future ML is positioned to help in clinical decision making far beyond what is currently possible.Transparency is the first step toward vali-dation which is followed by clinical trust and adoption.In summary,NNs have the transformative ability to enhance predictive accuracy and improve patient management in ICUs.The concept should soon be turning into reality.展开更多
The single event effects(SEEs)evaluations caused by atmospheric neutrons were conducted on three different convolutional neural network(CNN)models(Yolov3,MNIST,and ResNet50)in the atmospheric neutron irradiation spect...The single event effects(SEEs)evaluations caused by atmospheric neutrons were conducted on three different convolutional neural network(CNN)models(Yolov3,MNIST,and ResNet50)in the atmospheric neutron irradiation spectrometer(ANIS)at the China Spallation Neutron Source(CSNS).The Yolov3 and MNIST models were implemented on the XILINX28-nm system-on-chip(So C).Meanwhile,the Yolov3 and ResNet50 models were deployed on the XILINX 16-nm Fin FET Ultra Scale+MPSoC.The atmospheric neutron SEEs on the tested CNN systems were comprehensively evaluated from six aspects,including chip type,network architecture,deployment methods,inference time,datasets,and the position of the anchor boxes.The various types of SEE soft errors,SEE cross-sections,and their distribution were analyzed to explore the radiation sensitivities and rules of 28-nm and 16-nm SoC.The current research can provide the technology support of radiation-resistant design of CNN system for developing and applying high-reliability,long-lifespan domestic artificial intelligence chips.展开更多
This research introduces a spectrum-based physics-informed neural network(SP-PINN)model to significantly improve the accuracy of calculation of two-phase flow parameters,surpassing existing methods that have limitatio...This research introduces a spectrum-based physics-informed neural network(SP-PINN)model to significantly improve the accuracy of calculation of two-phase flow parameters,surpassing existing methods that have limitations in global and continuous data sampling.SP-PINNs address the challenges of traditional methods in terms of continuous sampling by integrating the spectral analysis and pressure correction into the Navier-Stokes(N-S)equations,enhancing the predictive accuracy especially in critical regions like gas-phase boundaries and velocity peaks.The novel introduction of a pressure-correction module within SP-PINNs mitigates prediction errors,achieving a substantial reduction to 1‰compared with the conventional physics-informed neural network(PINN)approaches.Experimental applications validate the model’s ability to accurately and rapidly predict flow parameters with different sampling time intervals,with the computation time of predicting unsampled data less than 0.01 s.Such advancements signify a 100-fold improvement over traditional DNS calculations,underscoring the model’s potential in the real-time calculation and analysis of multiphase flow dynamics.展开更多
The integration of image analysis through deep learning(DL)into rock classification represents a significant leap forward in geological research.While traditional methods remain invaluable for their expertise and hist...The integration of image analysis through deep learning(DL)into rock classification represents a significant leap forward in geological research.While traditional methods remain invaluable for their expertise and historical context,DL offers a powerful complement by enhancing the speed,objectivity,and precision of the classification process.This research explores the significance of image data augmentation techniques in optimizing the performance of convolutional neural networks(CNNs)for geological image analysis,particularly in the classification of igneous,metamorphic,and sedimentary rock types from rock thin section(RTS)images.This study primarily focuses on classic image augmentation techniques and evaluates their impact on model accuracy and precision.Results demonstrate that augmentation techniques like Equalize significantly enhance the model's classification capabilities,achieving an F1-Score of 0.9869 for igneous rocks,0.9884 for metamorphic rocks,and 0.9929 for sedimentary rocks,representing improvements compared to the baseline original results.Moreover,the weighted average F1-Score across all classes and techniques is 0.9886,indicating an enhancement.Conversely,methods like Distort lead to decreased accuracy and F1-Score,with an F1-Score of 0.949 for igneous rocks,0.954 for metamorphic rocks,and 0.9416 for sedimentary rocks,exacerbating the performance compared to the baseline.The study underscores the practicality of image data augmentation in geological image classification and advocates for the adoption of DL methods in this domain for automation and improved results.The findings of this study can benefit various fields,including remote sensing,mineral exploration,and environmental monitoring,by enhancing the accuracy of geological image analysis both for scientific research and industrial applications.展开更多
Optical neural networks have significant advantages in terms of power consumption,parallelism,and high computing speed,which has intrigued extensive attention in both academic and engineering communities.It has been c...Optical neural networks have significant advantages in terms of power consumption,parallelism,and high computing speed,which has intrigued extensive attention in both academic and engineering communities.It has been considered as one of the powerful tools in promoting the fields of imaging processing and object recognition.However,the existing optical system architecture cannot be reconstructed to the realization of multi-functional artificial intelligence systems simultaneously.To push the development of this issue,we propose the pluggable diffractive neural networks(P-DNN),a general paradigm resorting to the cascaded metasurfaces,which can be applied to recognize various tasks by switching internal plug-ins.As the proof-of-principle,the recognition functions of six types of handwritten digits and six types of fashions are numerical simulated and experimental demonstrated at near-infrared regimes.Encouragingly,the proposed paradigm not only improves the flexibility of the optical neural networks but paves the new route for achieving high-speed,low-power and versatile artificial intelligence systems.展开更多
The ability to accurately predict urban traffic flows is crucial for optimising city operations.Consequently,various methods for forecasting urban traffic have been developed,focusing on analysing historical data to u...The ability to accurately predict urban traffic flows is crucial for optimising city operations.Consequently,various methods for forecasting urban traffic have been developed,focusing on analysing historical data to understand complex mobility patterns.Deep learning techniques,such as graph neural networks(GNNs),are popular for their ability to capture spatio-temporal dependencies.However,these models often become overly complex due to the large number of hyper-parameters involved.In this study,we introduce Dynamic Multi-Graph Spatial-Temporal Graph Neural Ordinary Differential Equation Networks(DMST-GNODE),a framework based on ordinary differential equations(ODEs)that autonomously discovers effective spatial-temporal graph neural network(STGNN)architectures for traffic prediction tasks.The comparative analysis of DMST-GNODE and baseline models indicates that DMST-GNODE model demonstrates superior performance across multiple datasets,consistently achieving the lowest Root Mean Square Error(RMSE)and Mean Absolute Error(MAE)values,alongside the highest accuracy.On the BKK(Bangkok)dataset,it outperformed other models with an RMSE of 3.3165 and an accuracy of 0.9367 for a 20-min interval,maintaining this trend across 40 and 60 min.Similarly,on the PeMS08 dataset,DMST-GNODE achieved the best performance with an RMSE of 19.4863 and an accuracy of 0.9377 at 20 min,demonstrating its effectiveness over longer periods.The Los_Loop dataset results further emphasise this model’s advantage,with an RMSE of 3.3422 and an accuracy of 0.7643 at 20 min,consistently maintaining superiority across all time intervals.These numerical highlights indicate that DMST-GNODE not only outperforms baseline models but also achieves higher accuracy and lower errors across different time intervals and datasets.展开更多
This study directs the discussion of HIV disease with a novel kind of complex dynamical generalized and piecewise operator in the sense of classical and Atangana Baleanu(AB)derivatives having arbitrary order.The HIV i...This study directs the discussion of HIV disease with a novel kind of complex dynamical generalized and piecewise operator in the sense of classical and Atangana Baleanu(AB)derivatives having arbitrary order.The HIV infection model has a susceptible class,a recovered class,along with a case of infection divided into three sub-different levels or categories and the recovered class.The total time interval is converted into two,which are further investigated for ordinary and fractional order operators of the AB derivative,respectively.The proposed model is tested separately for unique solutions and existence on bi intervals.The numerical solution of the proposed model is treated by the piece-wise numerical iterative scheme of Newtons Polynomial.The proposed method is established for piece-wise derivatives under natural order and non-singular Mittag-Leffler Law.The cross-over or bending characteristics in the dynamical system of HIV are easily examined by the aspect of this research having a memory effect for controlling the said disease.This study uses the neural network(NN)technique to obtain a better set of weights with low residual errors,and the epochs number is considered 1000.The obtained figures represent the approximate solution and absolute error which are tested with NN to train the data accurately.展开更多
In this paper, the μ-stability of multiple equilibrium points(EPs) in the Cohen-Grossberg neural networks(CGNNs) is addressed by designing a kind of discontinuous activation function(AF). Under some criteria, CGNNs w...In this paper, the μ-stability of multiple equilibrium points(EPs) in the Cohen-Grossberg neural networks(CGNNs) is addressed by designing a kind of discontinuous activation function(AF). Under some criteria, CGNNs with this AF are shown to possess at least 5^(n)EPs, of which 3^(n)EPs are locally μ-stable. Compared with the saturated AF or the sigmoidal AF, CGNNs with the designed AF can produce many more total/stable EPs. Therefore, when CGNNs with the designed discontinuous AF are applied to associative memory, they can store more prototype patterns. Moreover, the AF is expanded to a more general version to further increase the number of total/stable equilibria. The CGNNs with the expanded AF are found to produce(2k+3)^(n)EPs, of which (k+2)^(n)EPs are locally μ-stable. By adjusting two parameters in the AF, the number of sufficient conditions ensuring the μ-stability of multiple equilibria can be decreased. This finding implies that the computational complexity can be greatly reduced.Two numerical examples and an application to associative memory are illustrated to verify the correctness of the obtained results.展开更多
Micro-expressions(ME)recognition is a complex task that requires advanced techniques to extract informative features fromfacial expressions.Numerous deep neural networks(DNNs)with convolutional structures have been pr...Micro-expressions(ME)recognition is a complex task that requires advanced techniques to extract informative features fromfacial expressions.Numerous deep neural networks(DNNs)with convolutional structures have been proposed.However,unlike DNNs,shallow convolutional neural networks often outperform deeper models in mitigating overfitting,particularly with small datasets.Still,many of these methods rely on a single feature for recognition,resulting in an insufficient ability to extract highly effective features.To address this limitation,in this paper,an Improved Dual-stream Shallow Convolutional Neural Network based on an Extreme Gradient Boosting Algorithm(IDSSCNN-XgBoost)is introduced for ME Recognition.The proposed method utilizes a dual-stream architecture where motion vectors(temporal features)are extracted using Optical Flow TV-L1 and amplify subtle changes(spatial features)via EulerianVideoMagnification(EVM).These features are processed by IDSSCNN,with an attention mechanism applied to refine the extracted effective features.The outputs are then fused,concatenated,and classified using the XgBoost algorithm.This comprehensive approach significantly improves recognition accuracy by leveraging the strengths of both temporal and spatial information,supported by the robust classification power of XgBoost.The proposed method is evaluated on three publicly available ME databases named Chinese Academy of Sciences Micro-expression Database(CASMEII),Spontaneous Micro-Expression Database(SMICHS),and Spontaneous Actions and Micro-Movements(SAMM).Experimental results indicate that the proposed model can achieve outstanding results compared to recent models.The accuracy results are 79.01%,69.22%,and 68.99%on CASMEII,SMIC-HS,and SAMM,and the F1-score are 75.47%,68.91%,and 63.84%,respectively.The proposed method has the advantage of operational efficiency and less computational time.展开更多
基金the National Natural Science Foundation of China (No.60574006).
文摘In this paper, the global asymptotic stability is investigated for a class of Cohen-Grossberg neural networks with time-varying and distributed delays. By using the Lyapunov-Krasovskii functional and equivalent descriptor form of the considered system, several delay-dependent sufficient conditions are obtained to guarantee the asymptotic stability of the addressed systems. These conditions are dependent on both time-varying and distributed delays and presented in terms of LMIs and therefore, the stability criteria of such systems can be checked readily by resorting to the Matlab LMI toolbox. Finally, an example is given to show the effectiveness and less conservatism of the proposed methods.
基金This work was supported by the National Natural Science Foundation of China(No. 60534010, 60572070), Liaoning Natural Science Foundation ofChina(No.20052027), and the Program for Changjiang Scholars and Innovative Research Team in University.
文摘The stability analysis of Cohen-Grossberg neural networks with multiple delays is given. An approach combining the Lyapunov functional with the linear matrix inequality （LMI） is taken to obtain the sufficient conditions for the globally asymptotic stability of equilibrium point. By using the properties of matrix norm, a practical corollary is derived. All results are established without assuming the differentiability and monotonicity of activation functions. The simulation samples have proved the effectiveness of the conclusions.
文摘In this paper, the Cohen-Grossberg neural networks with time-varying delays and impulses are considered. New sufficient conditions for the existence and global exponential stability of a unique equilibrium point are established by using the fixed point theorem and Lyapunov functional. An example is given to demonstrate the effectiveness of our results.
基金National Natural Science Foundation of China (No70471049)
文摘The global exponential stability of Cohen-Grossberg neural networks with time-varying delays is studied. By constructing several suitable Lyapunov functionals and utilizing differential in-equality techniques, some sufficient criteria for the global exponential stability and the exponential convergence rate of the equilibrium point of the system are obtained. The criteria do not require the activation functions to be differentiable or monotone nondecreasing. Some stability results from previous works are extended and improved. Comparisons are made to demonstrate the advantage of our results.
基金Supported by the Distinguished Expert Science Foundation of Naval Aeronautical Engineering Institutethe Younger Foundation of Yantai University (SX06Z9)
文摘A class of generalized Cohen-Grossberg neural networks（CGNNs） with variable de- lays are investigated. By introducing a new type of Lyapunov functional and applying the homeomorphism theory and inequality technique, some new conditions axe derived ensuring the existence and uniqueness of the equilibrium point and its global exponential stability for CGNNs. These results obtained are independent of delays, develop the existent outcome in the earlier literature and are very easily checked in practice.
基金Project supported by the Natural Science Foundation of Zhejiang Province of China(Grant Nos.LY18F030023,LY17F030016,LQ18F030015,and LY18F020028)the National Natural Science Foundation of China(Grant Nos.61503338,61773348,and 61972354).
文摘This paper addresses the coexistence and local stability of multiple equilibrium points for fractional-order Cohen-Grossberg neural networks(FOCGNNs)with time delays.Based on Brouwer's fixed point theorem,sufficient conditions are established to ensure the existence of Πi=1^n(2Ki+1)equilibrium points for FOCGNNs.Through the use of Hardy inequality,fractional Halanay inequality,and Lyapunov theory,some criteria are established to ensure the local Lagrange stability and the local Lyapunov asymptotical stability of Πi=1^n(Ki+1)equilibrium points for FOCGNNs.The obtained results encompass those of integer-order Hopfield neural networks with or without delay as special cases.The activation functions are nonlinear and nonmonotonic.There could be many corner points in this general class of activation functions.The structure of activation functions makes FOCGNNs could have a lot of stable equilibrium points.Coexistence of multiple stable equilibrium points is necessary when neural networks come to pattern recognition and associative memories.Finally,two numerical examples are provided to illustrate the effectiveness of the obtained results.
文摘The increasing popularity of the Internet and the widespread use of information technology have led to a rise in the number and sophistication of network attacks and security threats.Intrusion detection systems are crucial to network security,playing a pivotal role in safeguarding networks from potential threats.However,in the context of an evolving landscape of sophisticated and elusive attacks,existing intrusion detection methodologies often overlook critical aspects such as changes in network topology over time and interactions between hosts.To address these issues,this paper proposes a real-time network intrusion detection method based on graph neural networks.The proposedmethod leverages the advantages of graph neural networks and employs a straightforward graph construction method to represent network traffic as dynamic graph-structured data.Additionally,a graph convolution operation with a multi-head attention mechanism is utilized to enhance the model’s ability to capture the intricate relationships within the graph structure comprehensively.Furthermore,it uses an integrated graph neural network to address dynamic graphs’structural and topological changes at different time points and the challenges of edge embedding in intrusion detection data.The edge classification problem is effectively transformed into node classification by employing a line graph data representation,which facilitates fine-grained intrusion detection tasks on dynamic graph node feature representations.The efficacy of the proposed method is evaluated using two commonly used intrusion detection datasets,UNSW-NB15 and NF-ToN-IoT-v2,and results are compared with previous studies in this field.The experimental results demonstrate that our proposed method achieves 99.3%and 99.96%accuracy on the two datasets,respectively,and outperforms the benchmark model in several evaluation metrics.
基金Supported by National Key Technology Research and Developmental Program of China,No.2022YFC2704400 and No.2022YFC2704405.
文摘BACKGROUND Mitochondrial genes are involved in tumor metabolism in ovarian cancer(OC)and affect immune cell infiltration and treatment responses.AIM To predict prognosis and immunotherapy response in patients diagnosed with OC using mitochondrial genes and neural networks.METHODS Prognosis,immunotherapy efficacy,and next-generation sequencing data of patients with OC were downloaded from The Cancer Genome Atlas and Gene Expression Omnibus.Mitochondrial genes were sourced from the MitoCarta3.0 database.The discovery cohort for model construction was created from 70% of the patients,whereas the remaining 30% constituted the validation cohort.Using the expression of mitochondrial genes as the predictor variable and based on neural network algorithm,the overall survival time and immunotherapy efficacy(complete or partial response)of patients were predicted.RESULTS In total,375 patients with OC were included to construct the prognostic model,and 26 patients were included to construct the immune efficacy model.The average area under the receiver operating characteristic curve of the prognostic model was 0.7268[95% confidence interval(CI):0.7258-0.7278]in the discovery cohort and 0.6475(95%CI:0.6466-0.6484)in the validation cohort.The average area under the receiver operating characteristic curve of the immunotherapy efficacy model was 0.9444(95%CI:0.8333-1.0000)in the discovery cohort and 0.9167(95%CI:0.6667-1.0000)in the validation cohort.CONCLUSION The application of mitochondrial genes and neural networks has the potential to predict prognosis and immunotherapy response in patients with OC,providing valuable insights into personalized treatment strategies.
文摘Deep neural networks(DNNs)are effective in solving both forward and inverse problems for nonlinear partial differential equations(PDEs).However,conventional DNNs are not effective in handling problems such as delay differential equations(DDEs)and delay integrodifferential equations(DIDEs)with constant delays,primarily due to their low regularity at delayinduced breaking points.In this paper,a DNN method that combines multi-task learning(MTL)which is proposed to solve both the forward and inverse problems of DIDEs.The core idea of this approach is to divide the original equation into multiple tasks based on the delay,using auxiliary outputs to represent the integral terms,followed by the use of MTL to seamlessly incorporate the properties at the breaking points into the loss function.Furthermore,given the increased training dificulty associated with multiple tasks and outputs,we employ a sequential training scheme to reduce training complexity and provide reference solutions for subsequent tasks.This approach significantly enhances the approximation accuracy of solving DIDEs with DNNs,as demonstrated by comparisons with traditional DNN methods.We validate the effectiveness of this method through several numerical experiments,test various parameter sharing structures in MTL and compare the testing results of these structures.Finally,this method is implemented to solve the inverse problem of nonlinear DIDE and the results show that the unknown parameters of DIDE can be discovered with sparse or noisy data.
基金Supported by the National Natural Science Foundation of China(11971458,11471310)。
文摘In this paper,we propose a neural network approach to learn the parameters of a class of stochastic Lotka-Volterra systems.Approximations of the mean and covariance matrix of the observational variables are obtained from the Euler-Maruyama discretization of the underlying stochastic differential equations(SDEs),based on which the loss function is built.The stochastic gradient descent method is applied in the neural network training.Numerical experiments demonstrate the effectiveness of our method.
基金Zhejiang Medical and Health Technology Project(Project No.2020PY072)。
文摘Objective:To explore a simple method for improving the diagnostic accuracy of malignant lung nodules based on imaging features of lung nodules.Methods:A retrospective analysis was conducted on the imaging data of 114 patients who underwent lung nodule surgery in the Thoracic Surgery Department of the First People’s Hospital of Huzhou from June to September 2024.Imaging features of lung nodules were summarized and trained using a BP neural network.Results:Training with the BP neural network increased the diagnostic accuracy for distinguishing between benign and malignant lung nodules based on imaging features from 84.2%(manual assessment)to 94.1%.Conclusion:Training with the BP neural network significantly improves the diagnostic accuracy of lung nodule malignancy based solely on imaging features.
文摘Patients in intensive care units(ICUs)require rapid critical decision making.Modern ICUs are data rich,where information streams from diverse sources.Machine learning(ML)and neural networks(NN)can leverage the rich data for prognostication and clinical care.They can handle complex nonlinear relation-ships in medical data and have advantages over traditional predictive methods.A number of models are used:(1)Feedforward networks;and(2)Recurrent NN and convolutional NN to predict key outcomes such as mortality,length of stay in the ICU and the likelihood of complications.Current NN models exist in silos;their integration into clinical workflow requires greater transparency on data that are analyzed.Most models that are accurate enough for use in clinical care operate as‘black-boxes’in which the logic behind their decision making is opaque.Advan-ces have occurred to see through the opacity and peer into the processing of the black-box.In the near future ML is positioned to help in clinical decision making far beyond what is currently possible.Transparency is the first step toward vali-dation which is followed by clinical trust and adoption.In summary,NNs have the transformative ability to enhance predictive accuracy and improve patient management in ICUs.The concept should soon be turning into reality.
基金Project supported by the National Natural Science Foundation of China(Grant No.12305303)the Natural Science Foundation of Hunan Province of China(Grant Nos.2023JJ40520,2024JJ2044,and 2021JJ40444)+3 种基金the Science and Technology Innovation Program of Hunan Province,China(Grant No.2020RC3054)the Postgraduate Scientific Research Innovation Project of Hunan Province,China(Grant No.CX20240831)the Natural Science Basic Research Plan in the Shaanxi Province of China(Grant No.2023-JC-QN0015)the Doctoral Research Fund of University of South China(Grant No.200XQD033)。
文摘The single event effects(SEEs)evaluations caused by atmospheric neutrons were conducted on three different convolutional neural network(CNN)models(Yolov3,MNIST,and ResNet50)in the atmospheric neutron irradiation spectrometer(ANIS)at the China Spallation Neutron Source(CSNS).The Yolov3 and MNIST models were implemented on the XILINX28-nm system-on-chip(So C).Meanwhile,the Yolov3 and ResNet50 models were deployed on the XILINX 16-nm Fin FET Ultra Scale+MPSoC.The atmospheric neutron SEEs on the tested CNN systems were comprehensively evaluated from six aspects,including chip type,network architecture,deployment methods,inference time,datasets,and the position of the anchor boxes.The various types of SEE soft errors,SEE cross-sections,and their distribution were analyzed to explore the radiation sensitivities and rules of 28-nm and 16-nm SoC.The current research can provide the technology support of radiation-resistant design of CNN system for developing and applying high-reliability,long-lifespan domestic artificial intelligence chips.
基金Supported by the National Natural Science Foundation of China(No.62304022)。
文摘This research introduces a spectrum-based physics-informed neural network(SP-PINN)model to significantly improve the accuracy of calculation of two-phase flow parameters,surpassing existing methods that have limitations in global and continuous data sampling.SP-PINNs address the challenges of traditional methods in terms of continuous sampling by integrating the spectral analysis and pressure correction into the Navier-Stokes(N-S)equations,enhancing the predictive accuracy especially in critical regions like gas-phase boundaries and velocity peaks.The novel introduction of a pressure-correction module within SP-PINNs mitigates prediction errors,achieving a substantial reduction to 1‰compared with the conventional physics-informed neural network(PINN)approaches.Experimental applications validate the model’s ability to accurately and rapidly predict flow parameters with different sampling time intervals,with the computation time of predicting unsampled data less than 0.01 s.Such advancements signify a 100-fold improvement over traditional DNS calculations,underscoring the model’s potential in the real-time calculation and analysis of multiphase flow dynamics.
文摘The integration of image analysis through deep learning(DL)into rock classification represents a significant leap forward in geological research.While traditional methods remain invaluable for their expertise and historical context,DL offers a powerful complement by enhancing the speed,objectivity,and precision of the classification process.This research explores the significance of image data augmentation techniques in optimizing the performance of convolutional neural networks(CNNs)for geological image analysis,particularly in the classification of igneous,metamorphic,and sedimentary rock types from rock thin section(RTS)images.This study primarily focuses on classic image augmentation techniques and evaluates their impact on model accuracy and precision.Results demonstrate that augmentation techniques like Equalize significantly enhance the model's classification capabilities,achieving an F1-Score of 0.9869 for igneous rocks,0.9884 for metamorphic rocks,and 0.9929 for sedimentary rocks,representing improvements compared to the baseline original results.Moreover,the weighted average F1-Score across all classes and techniques is 0.9886,indicating an enhancement.Conversely,methods like Distort lead to decreased accuracy and F1-Score,with an F1-Score of 0.949 for igneous rocks,0.954 for metamorphic rocks,and 0.9416 for sedimentary rocks,exacerbating the performance compared to the baseline.The study underscores the practicality of image data augmentation in geological image classification and advocates for the adoption of DL methods in this domain for automation and improved results.The findings of this study can benefit various fields,including remote sensing,mineral exploration,and environmental monitoring,by enhancing the accuracy of geological image analysis both for scientific research and industrial applications.
基金The authors acknowledge the funding provided by the National Key R&D Program of China(2021YFA1401200)Beijing Outstanding Young Scientist Program(BJJWZYJH01201910007022)+2 种基金National Natural Science Foundation of China(No.U21A20140,No.92050117,No.62005017)programBeijing Municipal Science&Technology Commission,Administrative Commission of Zhongguancun Science Park(No.Z211100004821009)This work was supported by the Synergetic Extreme Condition User Facility(SECUF).
文摘Optical neural networks have significant advantages in terms of power consumption,parallelism,and high computing speed,which has intrigued extensive attention in both academic and engineering communities.It has been considered as one of the powerful tools in promoting the fields of imaging processing and object recognition.However,the existing optical system architecture cannot be reconstructed to the realization of multi-functional artificial intelligence systems simultaneously.To push the development of this issue,we propose the pluggable diffractive neural networks(P-DNN),a general paradigm resorting to the cascaded metasurfaces,which can be applied to recognize various tasks by switching internal plug-ins.As the proof-of-principle,the recognition functions of six types of handwritten digits and six types of fashions are numerical simulated and experimental demonstrated at near-infrared regimes.Encouragingly,the proposed paradigm not only improves the flexibility of the optical neural networks but paves the new route for achieving high-speed,low-power and versatile artificial intelligence systems.
文摘The ability to accurately predict urban traffic flows is crucial for optimising city operations.Consequently,various methods for forecasting urban traffic have been developed,focusing on analysing historical data to understand complex mobility patterns.Deep learning techniques,such as graph neural networks(GNNs),are popular for their ability to capture spatio-temporal dependencies.However,these models often become overly complex due to the large number of hyper-parameters involved.In this study,we introduce Dynamic Multi-Graph Spatial-Temporal Graph Neural Ordinary Differential Equation Networks(DMST-GNODE),a framework based on ordinary differential equations(ODEs)that autonomously discovers effective spatial-temporal graph neural network(STGNN)architectures for traffic prediction tasks.The comparative analysis of DMST-GNODE and baseline models indicates that DMST-GNODE model demonstrates superior performance across multiple datasets,consistently achieving the lowest Root Mean Square Error(RMSE)and Mean Absolute Error(MAE)values,alongside the highest accuracy.On the BKK(Bangkok)dataset,it outperformed other models with an RMSE of 3.3165 and an accuracy of 0.9367 for a 20-min interval,maintaining this trend across 40 and 60 min.Similarly,on the PeMS08 dataset,DMST-GNODE achieved the best performance with an RMSE of 19.4863 and an accuracy of 0.9377 at 20 min,demonstrating its effectiveness over longer periods.The Los_Loop dataset results further emphasise this model’s advantage,with an RMSE of 3.3422 and an accuracy of 0.7643 at 20 min,consistently maintaining superiority across all time intervals.These numerical highlights indicate that DMST-GNODE not only outperforms baseline models but also achieves higher accuracy and lower errors across different time intervals and datasets.
基金supported and funded by the Deanship of Scientific Research at Imam Mohammad Ibn Saud Islamic University(IMSIU)(grant number IMSIU-RP23066).
文摘This study directs the discussion of HIV disease with a novel kind of complex dynamical generalized and piecewise operator in the sense of classical and Atangana Baleanu(AB)derivatives having arbitrary order.The HIV infection model has a susceptible class,a recovered class,along with a case of infection divided into three sub-different levels or categories and the recovered class.The total time interval is converted into two,which are further investigated for ordinary and fractional order operators of the AB derivative,respectively.The proposed model is tested separately for unique solutions and existence on bi intervals.The numerical solution of the proposed model is treated by the piece-wise numerical iterative scheme of Newtons Polynomial.The proposed method is established for piece-wise derivatives under natural order and non-singular Mittag-Leffler Law.The cross-over or bending characteristics in the dynamical system of HIV are easily examined by the aspect of this research having a memory effect for controlling the said disease.This study uses the neural network(NN)technique to obtain a better set of weights with low residual errors,and the epochs number is considered 1000.The obtained figures represent the approximate solution and absolute error which are tested with NN to train the data accurately.
基金supported by the National Natural Science Foundation of China(Grant Nos.62173214 and 61973199)the Shandong Provincial Natural Science Foundation(Grant Nos.ZR2021MF003 and ZR2022MF324)the Major Technologies Research and Development Special Program of Anhui Province(Grant No.202003a05020001)。
文摘In this paper, the μ-stability of multiple equilibrium points(EPs) in the Cohen-Grossberg neural networks(CGNNs) is addressed by designing a kind of discontinuous activation function(AF). Under some criteria, CGNNs with this AF are shown to possess at least 5^(n)EPs, of which 3^(n)EPs are locally μ-stable. Compared with the saturated AF or the sigmoidal AF, CGNNs with the designed AF can produce many more total/stable EPs. Therefore, when CGNNs with the designed discontinuous AF are applied to associative memory, they can store more prototype patterns. Moreover, the AF is expanded to a more general version to further increase the number of total/stable equilibria. The CGNNs with the expanded AF are found to produce(2k+3)^(n)EPs, of which (k+2)^(n)EPs are locally μ-stable. By adjusting two parameters in the AF, the number of sufficient conditions ensuring the μ-stability of multiple equilibria can be decreased. This finding implies that the computational complexity can be greatly reduced.Two numerical examples and an application to associative memory are illustrated to verify the correctness of the obtained results.
基金supported by the Key Research and Development Program of Jiangsu Province under Grant BE2022059-3,CTBC Bank through the Industry-Academia Cooperation Project,as well as by the Ministry of Science and Technology of Taiwan through Grants MOST-108-2218-E-002-055,MOST-109-2223-E-009-002-MY3,MOST-109-2218-E-009-025,and MOST431109-2218-E-002-015.
文摘Micro-expressions(ME)recognition is a complex task that requires advanced techniques to extract informative features fromfacial expressions.Numerous deep neural networks(DNNs)with convolutional structures have been proposed.However,unlike DNNs,shallow convolutional neural networks often outperform deeper models in mitigating overfitting,particularly with small datasets.Still,many of these methods rely on a single feature for recognition,resulting in an insufficient ability to extract highly effective features.To address this limitation,in this paper,an Improved Dual-stream Shallow Convolutional Neural Network based on an Extreme Gradient Boosting Algorithm(IDSSCNN-XgBoost)is introduced for ME Recognition.The proposed method utilizes a dual-stream architecture where motion vectors(temporal features)are extracted using Optical Flow TV-L1 and amplify subtle changes(spatial features)via EulerianVideoMagnification(EVM).These features are processed by IDSSCNN,with an attention mechanism applied to refine the extracted effective features.The outputs are then fused,concatenated,and classified using the XgBoost algorithm.This comprehensive approach significantly improves recognition accuracy by leveraging the strengths of both temporal and spatial information,supported by the robust classification power of XgBoost.The proposed method is evaluated on three publicly available ME databases named Chinese Academy of Sciences Micro-expression Database(CASMEII),Spontaneous Micro-Expression Database(SMICHS),and Spontaneous Actions and Micro-Movements(SAMM).Experimental results indicate that the proposed model can achieve outstanding results compared to recent models.The accuracy results are 79.01%,69.22%,and 68.99%on CASMEII,SMIC-HS,and SAMM,and the F1-score are 75.47%,68.91%,and 63.84%,respectively.The proposed method has the advantage of operational efficiency and less computational time.
