Weights Direct Determination of Feedforward Neural Networks without Iterative BP-Training

2010 ◽  
pp. 197-225 ◽  
Author(s):  
Yunong Zhang ◽  
Ning Tan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Direct Determination ◽  
Bp Neural Networks ◽  
Learning Rates ◽  
The Neural Network ◽  
Gradient Based ◽  
Artificial Neural ◽  
Output Behavior

Artificial neural networks (ANN), especially with error back-propagation (BP) training algorithms, have been widely investigated and applied in various science and engineering fields. However, the BP algorithms are essentially gradient-based iterative methods, which adjust the neural-network weights to bring the network input/output behavior into a desired mapping by taking a gradient-based descent direction. This kind of iterative neural-network (NN) methods has shown some inherent weaknesses, such as, 1) the possibility of being trapped into local minima, 2) the difficulty in choosing appropriate learning rates, and 3) the inability to design the optimal or smallest NN-structure. To resolve such weaknesses of BP neural networks, we have asked ourselves a special question: Could neural-network weights be determined directly without iterative BP-training? The answer appears to be YES, which is demonstrated in this chapter with three positive but different examples. In other words, a new type of artificial neural networks with linearly-independent or orthogonal activation functions, is being presented, analyzed, simulated and verified by us, of which the neural-network weights and structure could be decided directly and more deterministically as well (in comparison with usual conventional BP neural networks).

scholarly journals Artificial neural networks applied for soil class prediction in mountainous landscape of the Serra do Mar¹

2014 ◽  
Vol 38 (6) ◽  
pp. 1681-1693 ◽  
Author(s):  
Braz Calderano Filho ◽  
Helena Polivanov ◽  
César da Silva Chagas ◽  
Waldir de Carvalho Júnior ◽  
Emílio Velloso Barroso ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Kappa Index ◽  
Class Prediction ◽  
Soil Class ◽  
Serra Do Mar ◽  
The Neural Network ◽  
Artificial Neural ◽  
Local Geology

Soil information is needed for managing the agricultural environment. The aim of this study was to apply artificial neural networks (ANNs) for the prediction of soil classes using orbital remote sensing products, terrain attributes derived from a digital elevation model and local geology information as data sources. This approach to digital soil mapping was evaluated in an area with a high degree of lithologic diversity in the Serra do Mar. The neural network simulator used in this study was JavaNNS and the backpropagation learning algorithm. For soil class prediction, different combinations of the selected discriminant variables were tested: elevation, declivity, aspect, curvature, curvature plan, curvature profile, topographic index, solar radiation, LS topographic factor, local geology information, and clay mineral indices, iron oxides and the normalized difference vegetation index (NDVI) derived from an image of a Landsat-7 Enhanced Thematic Mapper Plus (ETM+) sensor. With the tested sets, best results were obtained when all discriminant variables were associated with geological information (overall accuracy 93.2 - 95.6 %, Kappa index 0.924 - 0.951, for set 13). Excluding the variable profile curvature (set 12), overall accuracy ranged from 93.9 to 95.4 % and the Kappa index from 0.932 to 0.948. The maps based on the neural network classifier were consistent and similar to conventional soil maps drawn for the study area, although with more spatial details. The results show the potential of ANNs for soil class prediction in mountainous areas with lithological diversity.

Improving Pin-Fin Heat Transfer Predictions Using Artificial Neural Networks

2013 ◽  
Author(s):  
Jason K. Ostanek
Keyword(s):  
Neural Network ◽  
Heat Transfer ◽  
Neural Networks ◽  
Reynolds Number ◽  
Artificial Neural Networks ◽  
Power Law ◽  
Transfer Data ◽  
Pin Fin ◽  
The Neural Network ◽  
Artificial Neural

In much of the public literature on pin-fin heat transfer, Nusselt number is presented as a function of Reynolds number using a power-law correlation. Power-law correlations typically have an accuracy of 20% while the experimental uncertainty of such measurements is typically between 5% and 10%. Additionally, the use of power-law correlations may require many sets of empirical constants to fully characterize heat transfer for different geometrical arrangements. In the present work, artificial neural networks were used to predict heat transfer as a function of streamwise spacing, spanwise spacing, pin-fin height, Reynolds number, and row position. When predicting experimental heat transfer data, the neural network was able to predict 73% of array-averaged heat transfer data to within 10% accuracy while published power-law correlations predicted 48% of the data to within 10% accuracy. Similarly, the neural network predicted 81% of row-averaged data to within 10% accuracy while 52% of the data was predicted to within 10% accuracy using power-law correlations. The present work shows that first-order heat transfer predictions may be simplified by using a single neural network model rather than combining or interpolating between power-law correlations. Furthermore, the neural network may be expanded to include additional pin-fin features of interest such as fillets, duct rotation, pin shape, pin inclination angle, and more making neural networks expandable and adaptable models for predicting pin-fin heat transfer.

Artificial neural networks in the problem of determining the position and size of the solar disk in wide-angle photographs of the sky

2021 ◽  
Author(s):  
Mikhail Borisov ◽  
Mikhail Krinitskiy
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Solar Disk ◽  
Weather Conditions ◽  
Wide Angle ◽  
Know How ◽  
The Neural Network ◽  
Artificial Neural ◽  
The Moment

<p>Total cloud score is a characteristic of weather conditions. At the moment, there are algorithms that automatically calculate cloudiness based on a photograph of the sky These algorithms do not know how to find the solar disk, so their work is not absolutely accurate.</p><p>To create an algorithm that solves this data, the data used, obtained as a result of sea research voyages, is used, which is marked up for training the neural network.</p><p>As a result of the work, an algorithm was obtained based on neural networks, based on a photograph of the sky, in order to determine the size and position of the solar disk, other algorithms can be used to work with images of the visible hemisphere of the sky.</p>

Artificial Neural Networks

2011 ◽  
pp. 222-243
Author(s):  
Joarder Kamruzzaman ◽  
Ruhul Sarker
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Artificial Neural Networks ◽  
Network Models ◽  
Neural Network Models ◽  
Network Applications ◽  
The Neural Network ◽  
Artificial Neural ◽  
Neural Network Applications

The primary aim of this chapter is to present an overview of the artificial neural network basics and operation, architectures, and the major algorithms used for training the neural network models. As can be seen in subsequent chapters, neural networks have made many useful contributions to solve theoretical and practical problems in finance and manufacturing areas. The secondary aim here is therefore to provide a brief review of artificial neural network applications in finance and manufacturing areas.

Artificial Neural Networks and Learning Techniques

2016 ◽  
pp. 89-112
Author(s):  
Pushpendu Kar ◽  
Anusua Das
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Research Work ◽  
The Neural Network ◽  
Learning Techniques ◽  
Learning Procedure ◽  
Processing Component ◽  
Artificial Neural ◽  
Artificial Neural Network Ann

The recent craze for artificial neural networks has spread its roots towards the development of neuroscience, pattern recognition, machine learning and artificial intelligence. The theoretical neuroscience is basically converging towards the basic concept that the brain acts as a complex and decentralized computer which can perform rigorous calculations in a different approach compared to the conventional digital computers. The motivation behind the study of neural networks is due to their similarity in the structure of the human central nervous system. The elementary processing component of an Artificial Neural Network (ANN) is called as ‘Neuron'. A large number of neurons interconnected with each other mimic the biological neural network and form an ANN. Learning is an inevitable process that can be used to train an ANN. We can only transfer knowledge to the neural network by the learning procedure. This chapter presents the detailed concepts of artificial neural networks in addition to some significant aspects on the present research work.

Contributions to Predict the Malfunction Probability of the Human-Machine-Environment System, Using Artificial Neural Networks

2015 ◽  
Vol 760 ◽  
pp. 771-776
Author(s):  
Daniel Constantin Anghel ◽  
Nadia Belu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Design Experiment ◽  
Manufacturing Processes ◽  
Feed Forward Neural Network ◽  
Feed Forward ◽  
Linear Relationships ◽  
The Neural Network ◽  
Artificial Neural

This paper presents the application of Artificial Neural Networks to predict the malfunction probability of the human-machine-environment system, in order to provide some guidance to designers of manufacturing processes. Artificial Neural Networks excel in gathering difficult non-linear relationships between the inputs and outputs of a system. We used, in this work, a feed forward neural network in order to predict the malfunction probability. The neural network is simulated with Matlab. The design experiment presented in this paper was realized at University of Pitesti, at the Faculty of Mechanics and Technology, Technology and Management Department.

PRUNING ARTIFICIAL NEURAL NETWORKS USING NEURAL COMPLEXITY MEASURES

2008 ◽  
Vol 18 (05) ◽  
pp. 389-403 ◽  
Author(s):  
THOMAS D. JORGENSEN ◽  
BARRY P. HAYNES ◽  
CHARLOTTE C. F. NORLUND
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Robot Control ◽  
Complexity Measures ◽  
Information Theoretic ◽  
Pruning Method ◽  
The Neural Network ◽  
Artificial Neural ◽  
Pruning Technique

This paper describes a new method for pruning artificial neural networks, using a measure of the neural complexity of the neural network. This measure is used to determine the connections that should be pruned. The measure computes the information-theoretic complexity of a neural network, which is similar to, yet different from previous research on pruning. The method proposed here shows how overly large and complex networks can be reduced in size, whilst retaining learnt behaviour and fitness. The technique proposed here helps to discover a network topology that matches the complexity of the problem it is meant to solve. This novel pruning technique is tested in a robot control domain, simulating a racecar. It is shown, that the proposed pruning method is a significant improvement over the most commonly used pruning method Magnitude Based Pruning. Furthermore, some of the pruned networks prove to be faster learners than the benchmark network that they originate from. This means that this pruning method can also help to unleash hidden potential in a network, because the learning time decreases substantially for a pruned a network, due to the reduction of dimensionality of the network.

scholarly journals Investigation of a Multitasking System for Automatic Ship Berthing in Marine Practice Based on an Integrated Neural Controller

Mathematics ◽  
2020 ◽  
Vol 8 (7) ◽  
pp. 1167
Author(s):  
Van Suong Nguyen
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Coordinate System ◽  
Numerical Simulations ◽  
Neural Controller ◽  
The Neural Network ◽  
Artificial Neural ◽  
Ship Berthing

In this article, a multitasking system is investigated for automatic ship berthing in marine practices, based on artificial neural networks (ANNs). First, a neural network with separate structures in hidden layers is developed, based on a head-up coordinate system. This network is trained once with the berthing data of a ship in an original port to conduct berthing tasks in different ports. Then, on the basis of the developed network, an integrated mechanism including three negative signs is linked to achieve an integrated neural controller. This controller can bring the ship to a berth on each side of the ship in different ports. The whole system has the ability to berth for different tasks without retraining the neural network. Finally, to validate the effectiveness of the proposed system for automatic ship berthing, numerical simulations were performed for berthing tasks, such as different ports, and berthing each side of the ship. The results indicate that the proposed system shows a good performance in automatic ship berthing.

Prediction of Bending Beam Rheometer Test Outputs Using Artificial Neural Networks

2019 ◽  
Vol 821 ◽  
pp. 500-505
Author(s):  
Mohammad Fuad Aljarrah ◽  
Mohammad Ali Khasawneh ◽  
Aslam Ali Al-Omari ◽  
Mohammad Emad Alshorman
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Prediction Models ◽  
Time Interval ◽  
Testing Time ◽  
Bending Beam Rheometer ◽  
The Neural Network ◽  
Creep Stiffness ◽  
Artificial Neural

The major objective of this study is to investigate the possibility of using Artificial Neural Networks in creating prediction models capable of estimating Bending Beam Rheometer outputs; namely creep stiffness, and m-value based on test temperature, modifier content; in our case waste vegetable oil, and testing time interval. A feedforward backpropagation neural network with Bayesian Regulation training algorithm and an SSE performance function was implemented. It was found that the neural network model shows high predictive powers with training and testing performance of 99.8% and 99.2% respectively. Plots between laboratory obtained values and neural network predicted outputs were also considered, and a strong correlation between the two methods was concluded. Therefore, it was reasonable to state that using neural networks to build prediction models in order to find BBR test values is justified.

scholarly journals Use of neural networks for forecasting of the exposure of social network users to destructive impacts

2020 ◽  
pp. 24-33
Author(s):  
Elena Doynikova ◽  
Aleksandr Branitskiy ◽  
Igor Kotenko
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Social Networks ◽  
Artificial Neural Networks ◽  
Social Network ◽  
Negative Impact ◽  
Young Generation ◽  
The Neural Network ◽  
Internet Environment ◽  
Artificial Neural

Introduction: In social networks, the users can remotely communicate, express themselves, and search for people with similarinterests. At the same time, social networks as a source of information can have a negative impact on the behavior and thinking oftheir users. Purpose: Developing a technique of forecasting the exposure of social network users to destructive influences, based onthe use of artificial neural networks. Results: A technique has been developed and experimentally evaluated for forecasting Ammon’stest results by a social network user’s profile using artificial neural networks. The technique is based on the results of Ammon’s testfor medical students. For training the neural network, a set of features was generated based on the information provided by socialnetwork users. The results of the experiments have confirmed the dependence between the data provided by social network users andtheir psychological characteristics. A mechanism has been developed aimed at prompt detection of destructive impacts or social networkusers’ profiles indicating the susceptibility to such impacts, in order to facilitate the work of psychologists. The experiments haveshown that out of the four investigated types of neural networks, the highest accuracy is provided by a multilayer neural network. Inthe future, it is planned to expand the set of features in order to achieve a better accuracy. Practical relevance: The obtained results canbe used to develop systems for monitoring the Internet environment, detecting the impacts potentially dangerous for mental health ofthe young generation and the nation as a whole.

Sign in / Sign up

Export Citation Format

Share Document