scholarly journals Convolutional neural network for image classification based on transfer learning technique

2021 ◽  
Author(s):  
Ghassan Mohammed Halawani
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Transfer Learning ◽  
Learning Networks ◽  
The Neural Network ◽  
Learning Technique ◽  
Common Architecture

The main purpose of this project is to modify a convolutional neural network for image classification, based on a deep-learning framework. A transfer learning technique is used by the MATLAB interface to Alex-Net to train and modify the parameters in the last two fully connected layers of Alex-Net with a new dataset to perform classifications of thousands of images. First, the general common architecture of most neural networks and their benefits are presented. The mathematical models and the role of each part in the neural network are explained in detail. Second, different neural networks are studied in terms of architecture, application, and the working method to highlight the strengths and weaknesses of each of neural network. The final part conducts a detailed study on one of the most powerful deep-learning networks in image classification – i.e. the convolutional neural network – and how it can be modified to suit different classification tasks by using transfer learning technique in MATLAB.

scholarly journals Convolutional neural network for image classification based on transfer learning technique

2021 ◽  
Author(s):  
Ghassan Mohammed Halawani
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Transfer Learning ◽  
Learning Networks ◽  
The Neural Network ◽  
Learning Technique ◽  
Common Architecture

The main purpose of this project is to modify a convolutional neural network for image classification, based on a deep-learning framework. A transfer learning technique is used by the MATLAB interface to Alex-Net to train and modify the parameters in the last two fully connected layers of Alex-Net with a new dataset to perform classifications of thousands of images. First, the general common architecture of most neural networks and their benefits are presented. The mathematical models and the role of each part in the neural network are explained in detail. Second, different neural networks are studied in terms of architecture, application, and the working method to highlight the strengths and weaknesses of each of neural network. The final part conducts a detailed study on one of the most powerful deep-learning networks in image classification – i.e. the convolutional neural network – and how it can be modified to suit different classification tasks by using transfer learning technique in MATLAB.

scholarly journals Hyperparameters optimization for ResNet and Xception in the purpose of diagnosing COVID-19

2021 ◽  
pp. 1-17
Author(s):  
Hania H. Farag ◽  
Lamiaa A. A. Said ◽  
Mohamed R. M. Rizk ◽  
Magdy Abd ElAzim Ahmed
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Random Search ◽  
Learning Networks ◽  
Residual Network ◽  
Global Pandemic ◽  
Search Optimization

COVID-19 has been considered as a global pandemic. Recently, researchers are using deep learning networks for medical diseases’ diagnosis. Some of these researches focuses on optimizing deep learning neural networks for enhancing the network accuracy. Optimizing the Convolutional Neural Network includes testing various networks which are obtained through manually configuring their hyperparameters, then the configuration with the highest accuracy is implemented. Each time a different database is used, a different combination of the hyperparameters is required. This paper introduces two COVID-19 diagnosing systems using both Residual Network and Xception Network optimized by random search in the purpose of finding optimal models that give better diagnosis rates for COVID-19. The proposed systems showed that hyperparameters tuning for the ResNet and the Xception Net using random search optimization give more accurate results than other techniques with accuracies 99.27536% and 100 % respectively. We can conclude that hyperparameters tuning using random search optimization for either the tuned Residual Network or the tuned Xception Network gives better accuracies than other techniques diagnosing COVID-19.

scholarly journals Image Classification in HTP Test Based on Convolutional Neural Network Model

2021 ◽  
Vol 2021 ◽  
pp. 1-8
Author(s):  
Lin Liu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Reliability And Validity ◽  
Feature Learning ◽  
Human Vision ◽  
Assessment Process ◽  
Learning Networks ◽  
Good Reliability

HTP test in psychometrics is a widely studied and applied psychological assessment technique. HTP test is a kind of projection test, which refers to the free expression of painting itself and its creativity. Therefore, the form of group psychological counselling is widely used in mental health education. Compared with traditional neural networks, deep learning networks have deeper and more network layers and can learn more complex processing functions. In this stage, image recognition technology can be used as an assistant of human vision. People can quickly get the information in the picture through retrieval. For example, you can take a picture of an object that is difficult to describe and quickly search the content related to it. Convolutional neural network, which is widely used in the image classification task of computer vision, can automatically complete feature learning on the data without manual feature extraction. Compared with the traditional test, the test can reflect the painting characteristics of different groups. After quantitative scoring, it has good reliability and validity. It has high application value in psychological evaluation, especially in the diagnosis of mental diseases. This paper focuses on the subjectivity of HTP evaluation. Convolutional neural network is a mature technology in deep learning. The traditional HTP assessment process relies on the experience of researchers to extract painting features and classification.

scholarly journals Dog Breed Prediction using Convolutional Neural Network

2020 ◽  
Vol 9 (5) ◽  
pp. 318-322
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Convolutional Neural Networks ◽  
Graphical Representation ◽  
Outcome Analysis ◽  
Dog Breed ◽  
The One

Deep learning gives the strength on the way to train algorithms model that can handle the difficulties of info classification also prediction grounded on totally on arising information as of raw information. Convolutional Neural Networks (CNNs) gives single often used method for image classification and detection. In this exertion, we define a CNNbased approach for spotting dogs in per chance complex images and due to this fact reflect inconsideration on the identification of the one of kinds of dog breed. The experimental outcome analysis supported the standard metrics and thus the graphical representation confirms that the algorithm (CNN) gives good analysis accuracy for all the tested datasets

scholarly journals Development and Validation of an Arterial Pressure-Based Cardiac Output Algorithm Using a Convolutional Neural Network: Retrospective Study Based on Prospective Registry Data

10.2196/24762 ◽  
2021 ◽  
Vol 9 (8) ◽  
pp. e24762
Author(s):  
Hyun-Lim Yang ◽  
Chul-Woo Jung ◽  
Seong Mi Yang ◽  
Min-Soo Kim ◽  
Sungho Shim ◽  
...  
Keyword(s):  
Neural Network ◽  
Cardiac Output ◽  
Deep Learning ◽  
Retrospective Study ◽  
Arterial Pressure ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Learning Model ◽  
Learning Technique ◽  
Deep Learning Model

Background Arterial pressure-based cardiac output (APCO) is a less invasive method for estimating cardiac output without concerns about complications from the pulmonary artery catheter (PAC). However, inaccuracies of currently available APCO devices have been reported. Improvements to the algorithm by researchers are impossible, as only a subset of the algorithm has been released. Objective In this study, an open-source algorithm was developed and validated using a convolutional neural network and a transfer learning technique. Methods A retrospective study was performed using data from a prospective cohort registry of intraoperative bio-signal data from a university hospital. The convolutional neural network model was trained using the arterial pressure waveform as input and the stroke volume (SV) value as the output. The model parameters were pretrained using the SV values from a commercial APCO device (Vigileo or EV1000 with the FloTrac algorithm) and adjusted with a transfer learning technique using SV values from the PAC. The performance of the model was evaluated using absolute error for the PAC on the testing dataset from separate periods. Finally, we compared the performance of the deep learning model and the FloTrac with the SV values from the PAC. Results A total of 2057 surgical cases (1958 training and 99 testing cases) were used in the registry. In the deep learning model, the absolute errors of SV were 14.5 (SD 13.4) mL (10.2 [SD 8.4] mL in cardiac surgery and 17.4 [SD 15.3] mL in liver transplantation). Compared with FloTrac, the absolute errors of the deep learning model were significantly smaller (16.5 [SD 15.4] and 18.3 [SD 15.1], P<.001). Conclusions The deep learning–based APCO algorithm showed better performance than the commercial APCO device. Further improvement of the algorithm developed in this study may be helpful for estimating cardiac output accurately in clinical practice and optimizing high-risk patient care.

scholarly journals Plastic Gasket Defect Detection Based on Transfer Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Xieyi Chen ◽  
Dongyun Wang ◽  
Jinjun Shao ◽  
Jun Fan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Defect Detection ◽  
Data Augmentation ◽  
Surface Defects ◽  
Visual Detection ◽  
Training Data

To automatically detect plastic gasket defects, a set of plastic gasket defect visual detection devices based on GoogLeNet Inception-V2 transfer learning was designed and established in this study. The GoogLeNet Inception-V2 deep convolutional neural network (DCNN) was adopted to extract and classify the defect features of plastic gaskets to solve the problem of their numerous surface defects and difficulty in extracting and classifying the features. Deep learning applications require a large amount of training data to avoid model overfitting, but there are few datasets of plastic gasket defects. To address this issue, data augmentation was applied to our dataset. Finally, the performance of the three convolutional neural networks was comprehensively compared. The results showed that the GoogLeNet Inception-V2 transfer learning model had a better performance in less time. It means it had higher accuracy, reliability, and efficiency on the dataset used in this paper.

Small aircraft detection using deep learning

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Emre Kiyak ◽  
Gulay Unal
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Convolutional Neural Networks ◽  
Fine Tuning ◽  
Deep Convolutional Neural Networks ◽  
Content Type ◽  
Training Time

Purpose The paper aims to address the tracking algorithm based on deep learning and four deep learning tracking models developed. They compared with each other to prevent collision and to obtain target tracking in autonomous aircraft. Design/methodology/approach First, to follow the visual target, the detection methods were used and then the tracking methods were examined. Here, four models (deep convolutional neural networks (DCNN), deep convolutional neural networks with fine-tuning (DCNNFN), transfer learning with deep convolutional neural network (TLDCNN) and fine-tuning deep convolutional neural network with transfer learning (FNDCNNTL)) were developed. Findings The training time of DCNN took 9 min 33 s, while the accuracy percentage was calculated as 84%. In DCNNFN, the training time of the network was calculated as 4 min 26 s and the accuracy percentage was 91%. The training of TLDCNN) took 34 min and 49 s and the accuracy percentage was calculated as 95%. With FNDCNNTL, the training time of the network was calculated as 34 min 33 s and the accuracy percentage was nearly 100%. Originality/value Compared to the results in the literature ranging from 89.4% to 95.6%, using FNDCNNTL, better results were found in the paper.

scholarly journals Pendeteksi Citra Masker Wajah Menggunakan CNN dan Transfer Learning

2021 ◽  
Vol 8 (6) ◽  
pp. 1293
Author(s):  
Mohammad Farid Naufal ◽  
Selvia Ferdiana Kusuma
Keyword(s):  
Neural Network ◽  
Computer Vision ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Transfer Learning ◽  
Cross Validation ◽  
Learning Algorithm ◽  
Computing Time ◽  
Computation Time

<p class="Abstrak">Pada tahun 2021 pandemi Covid-19 masih menjadi masalah di dunia. Protokol kesehatan diperlukan untuk mencegah penyebaran Covid-19. Penggunaan masker wajah adalah salah satu protokol kesehatan yang umum digunakan. Pengecekan secara manual untuk mendeteksi wajah yang tidak menggunakan masker adalah pekerjaan yang lama dan melelahkan. Computer vision merupakan salah satu cabang ilmu komputer yang dapat digunakan untuk klasifikasi citra. Convolutional Neural Network (CNN) merupakan algoritma deep learning yang memiliki performa bagus dalam klasifikasi citra. Transfer learning merupakan metode terkini untuk mempercepat waktu training pada CNN dan untuk mendapatkan performa klasifikasi yang lebih baik. Penelitian ini melakukan klasifikasi citra wajah untuk membedakan orang menggunakan masker atau tidak dengan menggunakan CNN dan Transfer Learning. Arsitektur CNN yang digunakan dalam penelitian ini adalah MobileNetV2, VGG16, DenseNet201, dan Xception. Berdasarkan hasil uji coba menggunakan 5-cross validation, Xception memiliki akurasi terbaik yaitu 0.988 dengan waktu total komputasi training dan testing sebesar 18274 detik. MobileNetV2 memiliki waktu total komputasi tercepat yaitu 4081 detik dengan akurasi sebesar 0.981.</p><p class="Abstrak"> </p><p class="Abstrak"><em><strong>Abstract</strong></em></p><p class="Judul2"><em>In 2021 the Covid-19 pandemic is still a problem in the world. Therefore, health protocols are needed to prevent the spread of Covid-19. The use of face masks is one of the commonly used health protocols. However, manually checking to detect faces that are not wearing masks is a long and tiring job. Computer vision is a branch of computer science that can be used for image classification. Convolutional Neural Network (CNN) is a deep learning algorithm that has good performance in image classification. Transfer learning is the latest method to speed up CNN training and get better classification performance. This study performs facial image classification to distinguish people using masks or not by using CNN and Transfer Learning. The CNN architecture used in this research is MobileNetV2, VGG16, DenseNet201, and Xception. Based on the results of trials using 5-cross validation, Xception has the best accuracy of 0.988 with a total computation time of training and testing of 18274 seconds. MobileNetV2 has the fastest total computing time of 4081 seconds with an accuracy of 0.981.</em></p><p class="Abstrak"><em><strong><br /></strong></em></p>

scholarly journals Predicting Retinal Diseases using Efficient Image Processing and Convolutional Neural Network (CNN)

2021 ◽  
pp. 221-227
Author(s):  
Asif Mohammad ◽  
Mahruf Zaman Utso ◽  
Shifat Bin Habib ◽  
Amit Kumar Das
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Image Processing ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Retinal Images ◽  
Retinal Diseases ◽  
Medical Sector ◽  
The Neural Network ◽  
Computational Technology

Neural networks in image processing are becoming a more crucial and integral part of machine learning as computational technology and hardware systems are advanced. Deep learning is also getting attention from the medical sector as it is a prominent process for classifying diseases.  There is a lot of research to predict retinal diseases using deep learning algorithms like Convolutional Neural Network (CNN). Still, there are not many researches for predicting diseases like CNV which stands for choroidal neovascularization, DME, which stands for Diabetic Macular Edema; and DRUSEN. In our research paper, the CNN (Convolutional Neural Networks) algorithm labeled the dataset of OCT retinal images into four types: CNV, DME, DRUSEN, and Natural Retina. We have also done several preprocessing on the images before passing these to the neural network. We have implemented different models for our algorithm where individual models have different hidden layers.  At the end of our following research, we have found that our algorithm CNN generates 93% accuracy.

scholarly journals Development and validation of an arterial pressure-based cardiac output algorithm using a convolutional neural network: Retrospective study based on prospective registry data (Preprint)

2020 ◽  
Author(s):  
Hyun-Lim Yang ◽  
Chul-Woo Jung ◽  
Seong Mi Yang ◽  
Min-Soo Kim ◽  
Sungho Shim ◽  
...  
Keyword(s):  
Neural Network ◽  
Cardiac Output ◽  
Deep Learning ◽  
Retrospective Study ◽  
Arterial Pressure ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Learning Model ◽  
Learning Technique ◽  
Deep Learning Model

BACKGROUND The arterial pressure-based cardiac output (APCO) is a less-invasive method for estimating the cardiac output without worries about complications from the pulmonary artery catheter (PAC). However, inaccuracies of the currently available APCO devices have been reported. Improvements of the algorithm by researchers are also impossible, since only a subset of the algorithm has been released. OBJECTIVE In this study, we developed and validated an open source APCO algorithm using convolutional neural network and the transfer learning technique. METHODS We did a retrospective study using data from a prospective cohort registry of intraoperative bio-signal data at a university hospital. The convolutional neural network model was trained using the arterial pressure waveform as input and the stroke volume (SV) value as output. The model parameters were pre-trained using the SV values from a commercial APCO device (Vigileo™ or EV1000™ with FloTrac™ algorithm) and adjusted by a transfer learning technique using SV values from the PAC. The performance of the model was evaluated by using absolute error for the PAC on the testing dataset from separate periods. Finally, we compared the performance of the deep learning model and the FloTrac with SV values from the PAC. RESULTS We used 2,057 surgical cases (1,958 training and 99 testing) in the registry for modelling. In the deep learning model, the absolute errors of SV were 14.5 ± 13.4 mL (10.2 ± 8.4 mL and 17.4 ± 15.3 in cardiac surgery and liver transplantation, respectively). In the comparison with FloTrac, the absolute errors of the deep learning model were significantly smaller than those of the FloTrac (16.5 ± 15.4 and 18.3 ± 15.1, respectively, P < .001). CONCLUSIONS The deep learning-based APCO algorithm showed better performance than the commercial APCO device. Further improvement of the algorithm developed in this study may be helpful for estimating cardiac output accurately in clinical practice and optimizing high-risk patient care. CLINICALTRIAL Not applicable.

Sign in / Sign up

Export Citation Format

Share Document