scholarly journals A Method for Estimating the Entropy of Time Series Using Artificial Neural Networks

Entropy ◽  
2021 ◽  
Vol 23 (11) ◽  
pp. 1432
Author(s):  
Andrei Velichko ◽  
Hanif Heidari
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Classification Accuracy ◽  
Strong Dependence ◽  
Entropy Measure ◽  
Entropy Estimation ◽  
The Neural Network ◽  
Classification Of Images

Measuring the predictability and complexity of time series using entropy is essential tool designing and controlling a nonlinear system. However, the existing methods have some drawbacks related to the strong dependence of entropy on the parameters of the methods. To overcome these difficulties, this study proposes a new method for estimating the entropy of a time series using the LogNNet neural network model. The LogNNet reservoir matrix is filled with time series elements according to our algorithm. The accuracy of the classification of images from the MNIST-10 database is considered as the entropy measure and denoted by NNetEn. The novelty of entropy calculation is that the time series is involved in mixing the input information in the reservoir. Greater complexity in the time series leads to a higher classification accuracy and higher NNetEn values. We introduce a new time series characteristic called time series learning inertia that determines the learning rate of the neural network. The robustness and efficiency of the method is verified on chaotic, periodic, random, binary, and constant time series. The comparison of NNetEn with other methods of entropy estimation demonstrates that our method is more robust and accurate and can be widely used in practice.

Classification of Alloys with an Artificial Neural Network and Multivariate Calibration of Glow-Discharge Emission Spectra

1991 ◽  
Vol 45 (10) ◽  
pp. 1706-1716 ◽  
Author(s):  
Mark Glick ◽  
Gary M. Hieftje
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Glow Discharge ◽  
Multivariate Calibration ◽  
Emission Spectra ◽  
K Nearest Neighbor ◽  
The Neural Network ◽  
Calibration Sets ◽  
Artificial Neural

Artificial neural networks were constructed for the classification of metal alloys based on their elemental constituents. Glow discharge-atomic emission spectra obtained with a photodiode array spectrometer were used in multivariate calibrations for 7 elements in 37 Ni-based alloys (different types) and 15 Fe-based alloys. Subsets of the two major classes formed calibration sets for stepwise multiple linear regression. The remaining samples were used to validate the calibration models. Reference data from the calibration sets were then pooled into a single set to train neural networks with different architectures and different training parameters. After the neural networks learned to discriminate correctly among alloy classes in the training set, their ability to classify samples in the testing set was measured. In general, the neural network approach performed slightly better than the K-nearest neighbor method, but it suffered from a hidden classification mechanism and nonunique solutions. The neural network methodology is discussed and compared with conventional sample-classification techniques, and multivariate calibration of glow discharge spectra is compared with conventional univariate calibration.

scholarly journals A Novel Method for Sea-Land Clutter Separation Using Regularized Randomized and Kernel Ridge Neural Networks

Sensors ◽  
2020 ◽  
Vol 20 (22) ◽  
pp. 6491
Author(s):  
Le Zhang ◽  
Jeyan Thiyagalingam ◽  
Anke Xue ◽  
Shuwen Xu
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Classification Accuracy ◽  
Signal Amplitude ◽  
Statistical Characteristics ◽  
Support Vector ◽  
Amplitude Change ◽  
Novel Method

Classification of clutter, especially in the context of shore based radars, plays a crucial role in several applications. However, the task of distinguishing and classifying the sea clutter from land clutter has been historically performed using clutter models and/or coastal maps. In this paper, we propose two machine learning, particularly neural network, based approaches for sea-land clutter separation, namely the regularized randomized neural network (RRNN) and the kernel ridge regression neural network (KRR). We use a number of features, such as energy variation, discrete signal amplitude change frequency, autocorrelation performance, and other statistical characteristics of the respective clutter distributions, to improve the performance of the classification. Our evaluation based on a unique mixed dataset, which is comprised of partially synthetic clutter data for land and real clutter data from sea, offers improved classification accuracy. More specifically, the RRNN and KRR methods offer 98.50% and 98.75% accuracy, outperforming the conventional support vector machine and extreme learning based solutions.

Identifying User Suitability in sEMG Based Hand Prosthesis Using Neural Networks

2019 ◽  
Vol 14 (2) ◽  
pp. 158-164 ◽  
Author(s):  
G. Emayavaramban ◽  
A. Amudha ◽  
T. Rajendran ◽  
M. Sivaramkumar ◽  
K. Balachandar ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Pattern Recognition ◽  
Feature Extraction ◽  
Classification Accuracy ◽  
Network Models ◽  
Prosthetic Hand ◽  
Neural Network Models ◽  
The Neural Network ◽  
Semg Signals

Background: Identifying user suitability plays a vital role in various modalities like neuromuscular system research, rehabilitation engineering and movement biomechanics. This paper analysis the user suitability based on neural networks (NN), subjects, age groups and gender for surface electromyogram (sEMG) pattern recognition system to control the myoelectric hand. Six parametric feature extraction algorithms are used to extract the features from sEMG signals such as AR (Autoregressive) Burg, AR Yule Walker, AR Covariance, AR Modified Covariance, Levinson Durbin Recursion and Linear Prediction Coefficient. The sEMG signals are modeled using Cascade Forward Back propagation Neural Network (CFBNN) and Pattern Recognition Neural Network. Methods: sEMG signals generated from forearm muscles of the participants are collected through an sEMG acquisition system. Based on the sEMG signals, the type of movement attempted by the user is identified in the sEMG recognition module using signal processing, feature extraction and machine learning techniques. The information about the identified movement is passed to microcontroller wherein a control is developed to command the prosthetic hand to emulate the identified movement. Results: From the six feature extraction algorithms and two neural network models used in the study, the maximum classification accuracy of 95.13% was obtained using AR Burg with Pattern Recognition Neural Network. This justifies that the Pattern Recognition Neural Network is best suited for this study as the neural network model is specially designed for pattern matching problem. Moreover, it has simple architecture and low computational complexity. AR Burg is found to be the best feature extraction technique in this study due to its high resolution for short data records and its ability to always produce a stable model. In all the neural network models, the maximum classification accuracy is obtained for subject 10 as a result of his better muscle fitness and his maximum involvement in training sessions. Subjects in the age group of 26-30 years are best suited for the study due to their better muscle contractions. Better muscle fatigue resistance has contributed for better performance of female subjects as compared to male subjects. From the single trial analysis, it can be observed that the hand close movement has achieved best recognition rate for all neural network models. Conclusion: In this paper a study was conducted to identify user suitability for designing hand prosthesis. Data were collected from ten subjects for twelve tasks related to finger movements. The suitability of the user was identified using two neural networks with six parametric features. From the result, it was concluded thatfit women doing regular physical exercises aged between 26-30 years are best suitable for developing HMI for designing a prosthetic hand. Pattern Recognition Neural Network with AR Burg extraction features using extension movements will be a better way to design the HMI. However, Signal acquisition based on wireless method is worth considering for the future.

scholarly journals Convolutional Neural Network Classification of Telematics Car Driving Data

Risks ◽  
2019 ◽  
Vol 7 (1) ◽  
pp. 6 ◽  
Author(s):  
Guangyuan Gao ◽  
Mario Wüthrich
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Convolutional Neural Network ◽  
High Frequency ◽  
Location Data ◽  
Neural Network Classification ◽  
Feature Information ◽  
Car Driving

The aim of this project is to analyze high-frequency GPS location data (second per second) of individual car drivers (and trips). We extract feature information about speeds, acceleration, deceleration, and changes of direction from this high-frequency GPS location data. Time series of this feature information allow us to appropriately allocate individual car driving trips to selected drivers using convolutional neural networks.

scholarly journals ESTIMATION OF THE LYAPUNOV SPECTRUM FROM ONE-DIMENSIONAL OBSERVATIONS USING NEURAL NETWORKS

2014 ◽  
pp. 30-34
Author(s):  
Vladimir Golovko
Keyword(s):  
Neural Network ◽  
Dynamical System ◽  
Neural Networks ◽  
Time Series ◽  
Lyapunov Spectrum ◽  
Network Approach ◽  
Neural Network Approach ◽  
One Dimensional ◽  
The Neural Network ◽  
Attractor Dynamics

This paper discusses the neural network approach for computing of Lyapunov spectrum using one dimensional time series from unknown dynamical system. Such an approach is based on the reconstruction of attractor dynamics and applying of multilayer perceptron (MLP) for forecasting the next state of dynamical system from the previous one. It allows for evaluating the Lyapunov spectrum of unknown dynamical system accurately and efficiently only by using one observation. The results of experiments are discussed.

scholarly journals NEURAL NETWORK FORECASTING OF ENERGY CONSUMPTION OF A METALLURGICAL ENTERPRISE

2021 ◽  
pp. 14-22
Author(s):  
Anna Bakurova ◽  
Olesia Yuskiv ◽  
Dima Shyrokorad ◽  
Anton Riabenko ◽  
Elina Tereschenko
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Artificial Neural Networks ◽  
Energy Consumption ◽  
Short Term ◽  
Metallurgical Enterprise ◽  
Input Information ◽  
The Neural Network ◽  
Artificial Neural

The subject of the research is the methods of constructing and training neural networks as a nonlinear modeling apparatus for solving the problem of predicting the energy consumption of metallurgical enterprises. The purpose of this work is to develop a model for forecasting the consumption of the power system of a metallurgical enterprise and its experimental testing on the data available for research of PJSC "Dneprospetsstal". The following tasks have been solved: analysis of the time series of power consumption; building a model with the help of which data on electricity consumption for a historical period is processed; building the most accurate forecast of the actual amount of electricity for the day ahead; assessment of the forecast quality. Methods used: time series analysis, neural network modeling, short-term forecasting of energy consumption in the metallurgical industry. The results obtained: to develop a model for predicting the energy consumption of a metallurgical enterprise based on artificial neural networks, the MATLAB complex with the Neural Network Toolbox was chosen. When conducting experiments, based on the available statistical data of a metallurgical enterprise, a selection of architectures and algorithms for learning neural networks was carried out. The best results were shown by the feedforward and backpropagation network, architecture with nonlinear autoregressive and learning algorithms: Levenberg-Marquard nonlinear optimization, Bayesian Regularization method and conjugate gradient method. Another approach, deep learning, is also considered, namely the neural network with long short-term memory LSTM and the adam learning algorithm. Such a deep neural network allows you to process large amounts of input information in a short time and build dependencies with uninformative input information. The LSTM network turned out to be the most effective among the considered neural networks, for which the indicator of the maximum prediction error had the minimum value. Conclusions: analysis of forecasting results using the developed models showed that the chosen approach with experimentally selected architectures and learning algorithms meets the necessary requirements for forecast accuracy when developing a forecasting model based on artificial neural networks. The use of models will allow automating high-precision operational hourly forecasting of energy consumption in market conditions. Keywords: energy consumption; forecasting; artificial neural network; time series.

Neural Networks for Content-Based Image Retrieval

2011 ◽  
pp. 252-272 ◽  
Author(s):  
Brijesh Verma ◽  
Siddhivinayak Kulkarni
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Fuzzy Logic ◽  
Image Retrieval ◽  
Content Based Image Retrieval ◽  
The Neural Network ◽  
Benchmark Database ◽  
Overall Performance ◽  
Critical Literature

This chapter introduces neural networks for Content-Based Image Retrieval (CBIR) systems. It presents a critical literature review of both the traditional and neural network based techniques that are used in retrieving the images based on their content. It shows how neural networks and fuzzy logic can be used in interpretation of queries, feature extraction and classification of features by describing a detailed research methodology. It investigates a neural network based technique in conjunction with fuzzy logic to improve the overall performance of the CBIR systems. The results of the investigation on a benchmark database with a comparative analysis are presented in this chapter. The methodologies and results presented in this chapter will allow researchers to improve and compare their methods and it will also allow system developers to understand and implement the neural network and fuzzy logic based techniques for content based image retrieval.

Forecasting Emerging Market Indexes with Neural Networks

2011 ◽  
pp. 80-101 ◽  
Author(s):  
Steven Walczah
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Global Knowledge ◽  
Index Change ◽  
Market Index ◽  
The Neural Network ◽  
Neural Network System ◽  
Homogeneous Models ◽  
Using Data

Forecasting financial time series with neural networks is problematic. Multiple decisions, each of which affects the performance of the neural network forecasting model, must be made, including which data to use and the size and architecture of the neural network system. While most previous research with neural networks has focused on homogenous models, that is, only using data from the single time series to be forecast, the ever more global nature of the world’s financial markets necessitates the inclusion of more global knowledge into neural network design. This chapter demonstrates how specific markets are at least partially dependent on other global markets and that inclusion of heterogeneous market information will improve neural network forecasting performance over similar homogeneous models by as much as 12 percent (i.e., moving from a near 51% prediction accuracy for the direction of the market index change to a 63% accuracy of predicting the direction of the market index change).

XCSR Learning from Compressed Data Acquired by Deep Neural Network

2017 ◽  
Vol 21 (5) ◽  
pp. 856-867 ◽  
Author(s):  
Kazuma Matsumoto ◽  
Takato Tatsumi ◽  
Hiroyuki Sato ◽  
Tim Kovacs ◽  
Keiki Takadama ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Learning Classifier System ◽  
Rule Based ◽  
Classifier System ◽  
Learning Classifier ◽  
The Neural Network ◽  
Compressed Data

The correctness rate of classification of neural networks is improved by deep learning, which is machine learning of neural networks, and its accuracy is higher than the human brain in some fields. This paper proposes the hybrid system of the neural network and the Learning Classifier System (LCS). LCS is evolutionary rule-based machine learning using reinforcement learning. To increase the correctness rate of classification, we combine the neural network and the LCS. This paper conducted benchmark experiments to verify the proposed system. The experiment revealed that: 1) the correctness rate of classification of the proposed system is higher than the conventional LCS (XCSR) and normal neural network; and 2) the covering mechanism of XCSR raises the correctness rate of proposed system.

Bolt Tightening Using Impact Wrench Based on Neural Networks

2000 ◽  
Vol 12 (6) ◽  
pp. 706-711
Author(s):  
Toru Fujinaka ◽  
◽  
Hirofumi Nakano ◽  
Michifumi Yoshioka ◽  
Sigeru Omatu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Clamping Force ◽  
The Neural Network ◽  
The Impact

A method for controlling the tightening operation of bolts using an impact wrench is proposed, where the neural network is employed for achieving proper clamping force. The characteristics of the clamping force depend on the kind of work to which bolts are tightened, thus a neural network is used for classification of the work. The clamping force, which can only be measured during the test run, is estimated online, using another neural network. Then appropriate input to the actuator of the impact wrench is determined, based on the estimated value of the clamping force.

Sign in / Sign up

Export Citation Format

Share Document