scholarly journals A Practical Tutorial on Graph Neural Networks

2022 ◽  
Author(s):  
Isaac Ronald Ward ◽  
Jack Joyner ◽  
Casey Lickfold ◽  
Yulan Guo ◽  
Mohammed Bennamoun
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Deep Learning ◽  
Input Data ◽  
Unstructured Data ◽  
Data Types ◽  
Learning Techniques ◽  
Graph Neural Networks ◽  
Unique Ability

Graph neural networks (GNNs) have recently grown in popularity in the field of artificial intelligence (AI) due to their unique ability to ingest relatively unstructured data types as input data. Although some elements of the GNN architecture are conceptually similar in operation to traditional neural networks (and neural network variants), other elements represent a departure from traditional deep learning techniques. This tutorial exposes the power and novelty of GNNs to AI practitioners by collating and presenting details regarding the motivations, concepts, mathematics, and applications of the most common and performant variants of GNNs. Importantly, we present this tutorial concisely, alongside practical examples, thus providing a practical and accessible tutorial on the topic of GNNs.

Train Deep Learning Models using subsurface geological images datasets

2021 ◽  
Author(s):  
Ramy Abdallah ◽  
Clare E. Bond ◽  
Robert W.H. Butler
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Learning Models ◽  
Structural Interpretation ◽  
Performance Accuracy ◽  
Learning Techniques ◽  
Machine Learning Models

<p>Machine learning is being presented as a new solution for a wide range of geoscience problems. Primarily machine learning has been used for 3D seismic data processing, seismic facies analysis and well log data correlation. The rapid development in technology with open-source artificial intelligence libraries and the accessibility of affordable computer graphics processing units (GPU) makes the application of machine learning in geosciences increasingly tractable. However, the application of artificial intelligence in structural interpretation workflows of subsurface datasets is still ambiguous. This study aims to use machine learning techniques to classify images of folds and fold-thrust structures. Here we show that convolutional neural networks (CNNs) as supervised deep learning techniques provide excellent algorithms to discriminate between geological image datasets. Four different datasets of images have been used to train and test the machine learning models. These four datasets are a seismic character dataset with five classes (faults, folds, salt, flat layers and basement), folds types with three classes (buckle, chevron and conjugate), fault types with three classes (normal, reverse and thrust) and fold-thrust geometries with three classes (fault bend fold, fault propagation fold and detachment fold). These image datasets are used to investigate three machine learning models. One Feedforward linear neural network model and two convolutional neural networks models (Convolution 2d layer transforms sequential model and Residual block model (ResNet with 9, 34, and 50 layers)). Validation and testing datasets forms a critical part of testing the model’s performance accuracy. The ResNet model records the highest performance accuracy score, of the machine learning models tested. Our CNN image classification model analysis provides a framework for applying machine learning to increase structural interpretation efficiency, and shows that CNN classification models can be applied effectively to geoscience problems. The study provides a starting point to apply unsupervised machine learning approaches to sub-surface structural interpretation workflows.</p>

Comprehensive Overview of Neural Networks and Its Applications in Autonomous Vehicles

2019 ◽  
pp. 159-173
Author(s):  
Jay Rodge ◽  
Swati Jaiswal
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Deep Learning ◽  
Autonomous Vehicles ◽  
Autonomous Vehicle ◽  
Learning Algorithms ◽  
Activation Functions ◽  
Comprehensive Overview ◽  
Unit Component

Deep learning and Artificial intelligence (AI) have been trending these days due to the capability and state-of-the-art results that they provide. They have replaced some highly skilled professionals with neural network-powered AI, also known as deep learning algorithms. Deep learning majorly works on neural networks. This chapter discusses about the working of a neuron, which is a unit component of neural network. There are numerous techniques that can be incorporated while designing a neural network, such as activation functions, training, etc. to improve its features, which will be explained in detail. It has some challenges such as overfitting, which are difficult to neglect but can be overcome using proper techniques and steps that have been discussed. The chapter will help the academician, researchers, and practitioners to further investigate the associated area of deep learning and its applications in the autonomous vehicle industry.

scholarly journals Uncertainty-Based Human-in-the-Loop Deep Learning for Land Cover Segmentation

2020 ◽  
Vol 12 (22) ◽  
pp. 3836
Author(s):  
Carlos García Rodríguez ◽  
Jordi Vitrià ◽  
Oscar Mora
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Land Cover ◽  
Satellite Images ◽  
State Of The Art ◽  
Low Cost ◽  
Human Intervention ◽  
Human In The Loop ◽  
Learning Techniques

In recent years, different deep learning techniques were applied to segment aerial and satellite images. Nevertheless, state of the art techniques for land cover segmentation does not provide accurate results to be used in real applications. This is a problem faced by institutions and companies that want to replace time-consuming and exhausting human work with AI technology. In this work, we propose a method that combines deep learning with a human-in-the-loop strategy to achieve expert-level results at a low cost. We use a neural network to segment the images. In parallel, another network is used to measure uncertainty for predicted pixels. Finally, we combine these neural networks with a human-in-the-loop approach to produce correct predictions as if developed by human photointerpreters. Applying this methodology shows that we can increase the accuracy of land cover segmentation tasks while decreasing human intervention.

scholarly journals Weather Nowcasting Using Deep Learning Techniques

2021 ◽  
Author(s):  
Makhamisa Senekane ◽  
Mhlambululi Mafu ◽  
Molibeli Benedict Taele
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Recurrent Neural Networks ◽  
Weather Forecasting ◽  
Network Models ◽  
Short Term ◽  
Neural Network Models ◽  
Precipitation Forecasting ◽  
Learning Techniques

Weather variations play a significant role in peoples’ short-term, medium-term or long-term planning. Therefore, understanding of weather patterns has become very important in decision making. Short-term weather forecasting (nowcasting) involves the prediction of weather over a short period of time; typically few hours. Different techniques have been proposed for short-term weather forecasting. Traditional techniques used for nowcasting are highly parametric, and hence complex. Recently, there has been a shift towards the use of artificial intelligence techniques for weather nowcasting. These include the use of machine learning techniques such as artificial neural networks. In this chapter, we report the use of deep learning techniques for weather nowcasting. Deep learning techniques were tested on meteorological data. Three deep learning techniques, namely multilayer perceptron, Elman recurrent neural networks and Jordan recurrent neural networks, were used in this work. Multilayer perceptron models achieved 91 and 75% accuracies for sunshine forecasting and precipitation forecasting respectively, Elman recurrent neural network models achieved accuracies of 96 and 97% for sunshine and precipitation forecasting respectively, while Jordan recurrent neural network models achieved accuracies of 97 and 97% for sunshine and precipitation nowcasting respectively. The results obtained underline the utility of using deep learning for weather nowcasting.

Deep Learning in the Healthcare Industry

2020 ◽  
pp. 220-245 ◽  
Author(s):  
Zahra A. Shirazi ◽  
Camila P. E. de Souza ◽  
Rasha Kashef ◽  
Felipe F. Rodrigues
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Input Data ◽  
Time Series Data ◽  
Short Term Memory ◽  
Healthcare Industry ◽  
Neural Network Models ◽  
Input Layer ◽  
Hidden Layer

Artificial Neural networks (ANN) are composed of nodes that are joint to each other through weighted connections. Deep learning, as an extension of ANN, is a neural network model, but composed of different categories of layers: input layer, hidden layers, and output layers. Input data is fed into the first (input) layer. But the main process of the neural network models is done within the hidden layers, ranging from a single hidden layer to multiple ones. Depending on the type of model, the structure of the hidden layers is different. Depending on the type of input data, different models are applied. For example, for image data, convolutional neural networks are the most appropriate. On the other hand, for text or sequential and time series data, recurrent neural networks or long short-term memory models are the better choices. This chapter summarizes the state-of-the-art deep learning methods applied to the healthcare industry.

scholarly journals A systematic review of text classification research based on deep learning models in Arabic language

2020 ◽  
Vol 10 (6) ◽  
pp. 6629
Author(s):  
Ahlam Wahdan ◽  
Sendeyah AL Hantoobi ◽  
Said A. Salloum ◽  
Khaled Shaalan
Keyword(s):  
Neural Network ◽  
Systematic Review ◽  
Neural Networks ◽  
Deep Learning ◽  
Text Classification ◽  
Arabic Language ◽  
Machine Learning Techniques ◽  
Learning Models ◽  
Learning Techniques

Classifying or categorizing texts is the process by which documents are classified into groups by subject, title, author, etc. This paper undertakes a systematic review of the latest research in the field of the classification of Arabic texts. Several machine learning techniques can be used for text classification, but we have focused only on the recent trend of neural network algorithms. In this paper, the concept of classifying texts and classification processes are reviewed. Deep learning techniques in classification and its type are discussed in this paper as well. Neural networks of various types, namely, RNN, CNN, FFNN, and LSTM, are identified as the subject of study. Through systematic study, 12 research papers related to the field of the classification of Arabic texts using neural networks are obtained: for each paper the methodology for each type of neural network and the accuracy ration for each type is determined. The evaluation criteria used in the algorithms of different neural network types and how they play a large role in the highly accurate classification of Arabic texts are discussed. Our results provide some findings regarding how deep learning models can be used to improve text classification research in Arabic language.

scholarly journals Combining structured and unstructured data for predictive models: a deep learning approach

2020 ◽  
Author(s):  
Dongdong Zhang ◽  
Changchang Yin ◽  
Jucheng Zeng ◽  
Xiaohui Yuan ◽  
Ping Zhang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Medical Information ◽  
Prediction Models ◽  
Short Term Memory ◽  
Heterogeneous Data ◽  
Structured Data ◽  
Unstructured Data ◽  
Data Types ◽  
Clinical Notes

Background: The broad adoption of Electronic Health Records (EHRs) provides great opportunities to conduct health care research and solve various clinical problems in medicine. With recent advances and success, methods based on machine learning and deep learning have become increasingly popular in medical informatics. However, while many research studies utilize temporal structured data on predictive modeling, they typically neglect potentially valuable information in unstructured clinical notes. Integrating heterogeneous data types across EHRs through deep learning techniques may help improve the performance of prediction models. Methods: In this research, we proposed 2 general-purpose multi-modal neural network architectures to enhance patient representation learning by combining sequential unstructured notes with structured data. The proposed fusion models leverage document embeddings for the representation of long clinical note documents and either convolutional neural network or long short-term memory networks to model the sequential clinical notes and temporal signals, and one-hot encoding for static information representation. The concatenated representation is the final patient representation which is used to make predictions. Results: We evaluate the performance of proposed models on 3 risk prediction tasks (i.e., in-hospital mortality, 30-day hospital readmission, and long length of stay prediction) using derived data from the publicly available Medical Information Mart for Intensive Care III dataset. Our results show that by combining unstructured clinical notes with structured data, the proposed models outperform other models that utilize either unstructured notes or structured data only. Conclusions: The proposed fusion models learn better patient representation by combining structured and unstructured data. Integrating heterogeneous data types across EHRs helps improve the performance of prediction models and reduce errors.

RECOGNITION OF THE TEXT BY MEANS OF DEEP LEARNING

2020 ◽  
Vol 69 (1) ◽  
pp. 378-383
Author(s):  
T.A. Nurmukhanov ◽  
◽  
B.S. Daribayev ◽  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Neural Network Model ◽  
Input Data ◽  
Optimization Methods ◽  
Text Recognition ◽  
Activation Functions

Using neural networks, various variations of the classification of objects can be performed. Neural networks are used in many areas of recognition. A big area in this area is text recognition. The paper considers the optimal way to build a network for text recognition, the use of optimal methods for activation functions, and optimizers. Also, the article checked the correctness of text recognition with different optimization methods. This article is devoted to the analysis of convolutional neural networks. In the article, a convolutional neural network model will be trained with a teacher. Teaching with a teacher is a type of training for neural networks in which you provide the input data and the desired result, that is, the student looking at the input data will understand that you need to strive for the result that was provided to him.

scholarly journals To Identify and Recognize the Object for Traffic Analysis System using Deep Learning

2019 ◽  
Vol 8 (12) ◽  
pp. 1621-1624
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Deep Learning ◽  
Traffic Analysis ◽  
High Accuracy ◽  
Object Identification ◽  
Learning Systems ◽  
Learning Approaches ◽  
Learning Techniques ◽  
Analysis System

The object identification has been most essential field in development of machine vision which should be more efficient and accurate. Machine Learning & Artificial Intelligence, both are on their peak in today’s technology world. Playing with these can leads towards development. The field has actually replaced human efforts. With the approach of profound learning systems (i.e. deep learning techniques), the precision for object identification has expanded radically. This project aims to implement Object Identification for Traffic Analysis System in real time using Deep Learning Algorithms with high accuracy. The differentiation among objects such as humans, Traffic signs, etc. are identified. The dataset is so designed with specific objects which will be recognized by the camera and result will be shown within seconds. The project purely based on deep learning approaches which also includes YOLO object detection & Covolutionary Neural Network (CNN). The resulting system is fast and accurate, therefore can be implemented for smart automation across global stage

scholarly journals Generative Art: Between the Nodes of Neuron Networks

Artnodes ◽  
2020 ◽  
Author(s):  
Bruno Caldas Vianna
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Deep Learning ◽  
Generative Art ◽  
Creation Process ◽  
Neuron Networks ◽  
Starting Point ◽  
Deep Learning Neural Network ◽  
In The Beginning

This article uses the exhibition “Infinite Skulls”, which happened in Paris in the beginning of 2019, as a starting point to discuss art created by artificial intelligence and, by extension, unique pieces of art generated by algorithms. We detail the development of DCGAN, the deep learning neural network used in the show, from its cybernetics origin. The show and its creation process are described, identifying elements of creativity and technique, as well as question of the authorship of works. Then it frames these works in the context of generative art, pointing affinities and differences, and the issues of representing through procedures and abstractions. It describes the major breakthrough of neural network for technical images as the ability to represent categories through an abstraction, rather than images themselves. Finally, it tries to understand neural networks more as a tool for artists than an autonomous art creator.

Sign in / Sign up

Export Citation Format

Share Document