scholarly journals Generalization of Deep Neural Networks for Chest Pathology Classification in X-Rays Using Generative Adversarial Networks

2018 ◽  
Author(s):  
Hojjat Salehinejad ◽  
Shahrokh Valaee ◽  
Tim Dowdell ◽  
Errol Colak ◽  
Joseph Barfett
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Generative Adversarial Networks ◽  
X Rays ◽  
Adversarial Networks ◽  
Pathology Classification

scholarly journals Generalization of Deep Neural Networks for Imbalanced Fault Classification of Machinery Using Generative Adversarial Networks

IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 111168-111180 ◽  
Author(s):  
Jinrui Wang ◽  
Shunming Li ◽  
Baokun Han ◽  
Zenghui An ◽  
Huaiqian Bao ◽  
...  
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Fault Classification ◽  
Generative Adversarial Networks ◽  
Adversarial Networks

scholarly journals Generative Adversarial Positive-Unlabelled Learning

2018 ◽  
Author(s):  
Ming Hou ◽  
Brahim Chaib-draa ◽  
Chao Li ◽  
Qibin Zhao
Keyword(s):  
Neural Networks ◽  
Theoretical Analysis ◽  
Supervised Classification ◽  
Deep Neural Networks ◽  
Generative Adversarial Networks ◽  
Discriminative Learning ◽  
Decision Boundary ◽  
Negative Data ◽  
New Paradigm ◽  
Adversarial Networks

 In this work, we consider the task of classifying binary positive-unlabeled (PU) data. The existing discriminative learning based PU models attempt to seek an optimal reweighting strategy for U data, so that a decent decision boundary can be found. However, given limited P data, the conventional PU models tend to suffer from overfitting when adapted to very flexible deep neural networks. In contrast, we are the first to innovate a totally new paradigm to attack the binary PU task, from perspective of generative learning by leveraging the powerful generative adversarial networks (GAN). Our generative positive-unlabeled (GenPU) framework incorporates an array of discriminators and generators that are endowed with different roles in simultaneously producing positive and negative realistic samples. We provide theoretical analysis to justify that, at equilibrium, GenPU is capable of recovering both positive and negative data distributions. Moreover, we show GenPU is generalizable and closely related to the semi-supervised classification. Given rather limited P data, experiments on both synthetic and real-world dataset demonstrate the effectiveness of our proposed framework. With infinite realistic and diverse sample streams generated from GenPU, a very flexible classifier can then be trained using deep neural networks.

scholarly journals Generative Adversarial Networks for Pre-training of Medical Image Segmentation Networks

2020 ◽  
Author(s):  
Kun Chen ◽  
Manning Wang ◽  
Zhijian Song
Keyword(s):  
Neural Networks ◽  
Image Segmentation ◽  
Medical Image ◽  
Deep Neural Networks ◽  
Data Augmentation ◽  
Medical Image Segmentation ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Adversarial Networks ◽  
Synthetic Images

Abstract Background: Deep neural networks have been widely used in medical image segmentation and have achieved state-of-the-art performance in many tasks. However, different from the segmentation of natural images or video frames, the manual segmentation of anatomical structures in medical images needs high expertise so the scale of labeled training data is very small, which is a major obstacle for the improvement of deep neural networks performance in medical image segmentation. Methods: In this paper, we proposed a new end-to-end generation-segmentation framework by integrating Generative Adversarial Networks (GAN) and a segmentation network and train them simultaneously. The novelty is that during the training of the GAN, the intermediate synthetic images generated by the generator of the GAN are used to pre-train the segmentation network. As the advances of the training of the GAN, the synthetic images evolve gradually from being very coarse to containing more realistic textures, and these images help train the segmentation network gradually. After the training of GAN, the segmentation network is then fine-tuned by training with the real labeled images. Results: We evaluated the proposed framework on four different datasets, including 2D cardiac dataset and lung dataset, 3D prostate dataset and liver dataset. Compared with original U-net and CE-Net, our framework can achieve better segmentation performance. Our framework also can get better segmentation results than U-net on small datasets. In addition, our framework is more effective than the usual data augmentation methods. Conclusions: The proposed framework can be used as a pre-train method of segmentation network, which helps to get a better segmentation result. Our method can solve the shortcomings of current data augmentation methods to some extent.

scholarly journals Data Augmentation Using Generative Adversarial Networks (GANs) For GAN-Based Detection Of Pneumonia And COVID-19 In Chest X-Ray Images

2021 ◽  
Author(s):  
Saman Motamed ◽  
Patrik Rogalla ◽  
Farzad Khalvati
Keyword(s):  
Neural Networks ◽  
Data Augmentation ◽  
Generative Models ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
X Rays ◽  
X Ray ◽  
Standard Data ◽  
Adversarial Networks ◽  
Augmentation Techniques

Abstract Successful training of convolutional neural networks (CNNs) requires a substantial amount of data. With small datasets networks generalize poorly. Data Augmentation techniques improve the generalizability of neural networks by using existing training data more effectively. Standard data augmentation methods, however, produce limited plausible alternative data. Generative Adversarial Networks (GANs) have been utilized to generate new data and improve the performance of CNNs. Nevertheless, data augmentation techniques for training GANs are under-explored compared to CNNs. In this work, we propose a new GAN architecture for augmentation of chest X-rays for semi-supervised detection of pneumonia and COVID-19 using generative models. We show that the proposed GAN can be used to effectively augment data and improve classification accuracy of disease in chest X-rays for pneumonia and COVID-19. We compare our augmentation GAN model with Deep Convolutional GAN and traditional augmentation methods (rotate, zoom, etc) on two different X-ray datasets and show our GAN-based augmentation method surpasses other augmentation methods for training a GAN in detecting anomalies in X-ray images.

scholarly journals Detect and Remove Watermark in Deep Neural Networks via Generative Adversarial Networks

2021 ◽  
pp. 341-357
Author(s):  
Shichang Sun ◽  
Haoqi Wang ◽  
Mingfu Xue ◽  
Yushu Zhang ◽  
Jian Wang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Generative Adversarial Networks ◽  
Adversarial Networks

scholarly journals Analysis of Application Examples of Differential Privacy in Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Zhidong Shen ◽  
Ting Zhong
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
Differential Privacy ◽  
Generative Adversarial Networks ◽  
Learning Models ◽  
Privacy Leakage ◽  
Adversarial Networks ◽  
Inference Attacks

Artificial Intelligence has been widely applied today, and the subsequent privacy leakage problems have also been paid attention to. Attacks such as model inference attacks on deep neural networks can easily extract user information from neural networks. Therefore, it is necessary to protect privacy in deep learning. Differential privacy, as a popular topic in privacy-preserving in recent years, which provides rigorous privacy guarantee, can also be used to preserve privacy in deep learning. Although many articles have proposed different methods to combine differential privacy and deep learning, there are no comprehensive papers to analyze and compare the differences and connections between these technologies. For this purpose, this paper is proposed to compare different differential private methods in deep learning. We comparatively analyze and classify several deep learning models under differential privacy. Meanwhile, we also pay attention to the application of differential privacy in Generative Adversarial Networks (GANs), comparing and analyzing these models. Finally, we summarize the application of differential privacy in deep neural networks.

scholarly journals Towards computer-aided severity assessment via deep neural networks for geographic and opacity extent scoring of SARS-CoV-2 chest X-rays

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
A. Wong ◽  
Z. Q. Lin ◽  
L. Wang ◽  
A. G. Chung ◽  
B. Shen ◽  
...  
Keyword(s):  
Neural Networks ◽  
Monte Carlo ◽  
Lung Disease ◽  
Disease Severity ◽  
Deep Neural Networks ◽  
Cross Validation ◽  
X Rays ◽  
Computer Aided ◽  
Monte Carlo Cross Validation ◽  
Validation Experiments

AbstractA critical step in effective care and treatment planning for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), the cause for the coronavirus disease 2019 (COVID-19) pandemic, is the assessment of the severity of disease progression. Chest x-rays (CXRs) are often used to assess SARS-CoV-2 severity, with two important assessment metrics being extent of lung involvement and degree of opacity. In this proof-of-concept study, we assess the feasibility of computer-aided scoring of CXRs of SARS-CoV-2 lung disease severity using a deep learning system. Data consisted of 396 CXRs from SARS-CoV-2 positive patient cases. Geographic extent and opacity extent were scored by two board-certified expert chest radiologists (with 20+ years of experience) and a 2nd-year radiology resident. The deep neural networks used in this study, which we name COVID-Net S, are based on a COVID-Net network architecture. 100 versions of the network were independently learned (50 to perform geographic extent scoring and 50 to perform opacity extent scoring) using random subsets of CXRs from the study, and we evaluated the networks using stratified Monte Carlo cross-validation experiments. The COVID-Net S deep neural networks yielded R$$^2$$ 2 of $$0.664 \pm 0.032$$ 0.664 ± 0.032 and $$0.635 \pm 0.044$$ 0.635 ± 0.044 between predicted scores and radiologist scores for geographic extent and opacity extent, respectively, in stratified Monte Carlo cross-validation experiments. The best performing COVID-Net S networks achieved R$$^2$$ 2 of 0.739 and 0.741 between predicted scores and radiologist scores for geographic extent and opacity extent, respectively. The results are promising and suggest that the use of deep neural networks on CXRs could be an effective tool for computer-aided assessment of SARS-CoV-2 lung disease severity, although additional studies are needed before adoption for routine clinical use.

Sign in / Sign up

Export Citation Format

Share Document