scholarly journals Region-of-Interest-Based Cardiac Image Segmentation with Deep Learning

2021 ◽  
Vol 11 (4) ◽  
pp. 1965
Author(s):  
Raul-Ronald Galea ◽  
Laura Diosan ◽  
Anca Andreica ◽  
Loredana Popa ◽  
Simona Manole ◽  
...  
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Diagnostic System ◽  
Region Of Interest ◽  
General Purpose ◽  
Medical Image Segmentation ◽  
Dice Similarity Coefficient ◽  
Learning Methods ◽  
Study Results ◽  
Whole Heart

Despite the promising results obtained by deep learning methods in the field of medical image segmentation, lack of sufficient data always hinders performance to a certain degree. In this work, we explore the feasibility of applying deep learning methods on a pilot dataset. We present a simple and practical approach to perform segmentation in a 2D, slice-by-slice manner, based on region of interest (ROI) localization, applying an optimized training regime to improve segmentation performance from regions of interest. We start from two popular segmentation networks, the preferred model for medical segmentation, U-Net, and a general-purpose model, DeepLabV3+. Furthermore, we show that ensembling of these two fundamentally different architectures brings constant benefits by testing our approach on two different datasets, the publicly available ACDC challenge, and the imATFIB dataset from our in-house conducted clinical study. Results on the imATFIB dataset show that the proposed approach performs well with the provided training volumes, achieving an average Dice Similarity Coefficient of the whole heart of 89.89% on the validation set. Moreover, our algorithm achieved a mean Dice value of 91.87% on the ACDC validation, being comparable to the second best-performing approach on the challenge. Our approach provides an opportunity to serve as a building block of a computer-aided diagnostic system in a clinical setting.

scholarly journals Transductive Transfer Learning for Domain Adaptation in Brain Magnetic Resonance Image Segmentation

2021 ◽  
Vol 15 ◽  
Author(s):  
Kaisar Kushibar ◽  
Mostafa Salem ◽  
Sergi Valverde ◽  
Àlex Rovira ◽  
Joaquim Salvi ◽  
...  
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Magnetic Resonance ◽  
Transfer Learning ◽  
Domain Adaptation ◽  
Brain Mri ◽  
Magnetic Resonance Images ◽  
Medical Image Segmentation ◽  
Dice Similarity Coefficient ◽  
Shift Effect

Segmentation of brain images from Magnetic Resonance Images (MRI) is an indispensable step in clinical practice. Morphological changes of sub-cortical brain structures and quantification of brain lesions are considered biomarkers of neurological and neurodegenerative disorders and used for diagnosis, treatment planning, and monitoring disease progression. In recent years, deep learning methods showed an outstanding performance in medical image segmentation. However, these methods suffer from generalisability problem due to inter-centre and inter-scanner variabilities of the MRI images. The main objective of the study is to develop an automated deep learning segmentation approach that is accurate and robust to the variabilities in scanner and acquisition protocols. In this paper, we propose a transductive transfer learning approach for domain adaptation to reduce the domain-shift effect in brain MRI segmentation. The transductive scenario assumes that there are sets of images from two different domains: (1) source—images with manually annotated labels; and (2) target—images without expert annotations. Then, the network is jointly optimised integrating both source and target images into the transductive training process to segment the regions of interest and to minimise the domain-shift effect. We proposed to use a histogram loss in the feature level to carry out the latter optimisation problem. In order to demonstrate the benefit of the proposed approach, the method has been tested in two different brain MRI image segmentation problems using multi-centre and multi-scanner databases for: (1) sub-cortical brain structure segmentation; and (2) white matter hyperintensities segmentation. The experiments showed that the segmentation performance of a pre-trained model could be significantly improved by up to 10%. For the first segmentation problem it was possible to achieve a maximum improvement from 0.680 to 0.799 in average Dice Similarity Coefficient (DSC) metric and for the second problem the average DSC improved from 0.504 to 0.602. Moreover, the improvements after domain adaptation were on par or showed better performance compared to the commonly used traditional unsupervised segmentation methods (FIRST and LST), also achieving faster execution time. Taking this into account, this work presents one more step toward the practical implementation of deep learning algorithms into the clinical routine.

scholarly journals Deep learning-based segmentation of the lung in MR-images acquired by a stack-of-spirals trajectory at ultra-short echo-times

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Andreas M. Weng ◽  
Julius F. Heidenreich ◽  
Corona Metz ◽  
Simon Veldhoen ◽  
Thorsten A. Bley ◽  
...  
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Accurate Estimation ◽  
Dice Similarity Coefficient ◽  
Manual Segmentation ◽  
Pearson’S Correlation ◽  
Lung Volumes ◽  
Lung Segmentation ◽  
Pearson's Correlation ◽  
Lung Mri

Abstract Background Functional lung MRI techniques are usually associated with time-consuming post-processing, where manual lung segmentation represents the most cumbersome part. The aim of this study was to investigate whether deep learning-based segmentation of lung images which were scanned by a fast UTE sequence exploiting the stack-of-spirals trajectory can provide sufficiently good accuracy for the calculation of functional parameters. Methods In this study, lung images were acquired in 20 patients suffering from cystic fibrosis (CF) and 33 healthy volunteers, by a fast UTE sequence with a stack-of-spirals trajectory and a minimum echo-time of 0.05 ms. A convolutional neural network was then trained for semantic lung segmentation using 17,713 2D coronal slices, each paired with a label obtained from manual segmentation. Subsequently, the network was applied to 4920 independent 2D test images and results were compared to a manual segmentation using the Sørensen–Dice similarity coefficient (DSC) and the Hausdorff distance (HD). Obtained lung volumes and fractional ventilation values calculated from both segmentations were compared using Pearson’s correlation coefficient and Bland Altman analysis. To investigate generalizability to patients outside the CF collective, in particular to those exhibiting larger consolidations inside the lung, the network was additionally applied to UTE images from four patients with pneumonia and one with lung cancer. Results The overall DSC for lung tissue was 0.967 ± 0.076 (mean ± standard deviation) and HD was 4.1 ± 4.4 mm. Lung volumes derived from manual and deep learning based segmentations as well as values for fractional ventilation exhibited a high overall correlation (Pearson’s correlation coefficent = 0.99 and 1.00). For the additional cohort with unseen pathologies / consolidations, mean DSC was 0.930 ± 0.083, HD = 12.9 ± 16.2 mm and the mean difference in lung volume was 0.032 ± 0.048 L. Conclusions Deep learning-based image segmentation in stack-of-spirals based lung MRI allows for accurate estimation of lung volumes and fractional ventilation values and promises to replace the time-consuming step of manual image segmentation in the future.

scholarly journals ResBCDU-Net: A Deep Learning Framework for Lung CT Image Segmentation

Sensors ◽  
2021 ◽  
Vol 21 (1) ◽  
pp. 268
Author(s):  
Yeganeh Jalali ◽  
Mansoor Fateh ◽  
Mohsen Rezvani ◽  
Vahid Abolghasemi ◽  
Mohammad Hossein Anisi
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Ct Images ◽  
Medical Image Segmentation ◽  
Great Success ◽  
Morphological Operations ◽  
Ct Image ◽  
Feature Maps ◽  
Learning Framework ◽  
Lung Ct

Lung CT image segmentation is a key process in many applications such as lung cancer detection. It is considered a challenging problem due to existing similar image densities in the pulmonary structures, different types of scanners, and scanning protocols. Most of the current semi-automatic segmentation methods rely on human factors therefore it might suffer from lack of accuracy. Another shortcoming of these methods is their high false-positive rate. In recent years, several approaches, based on a deep learning framework, have been effectively applied in medical image segmentation. Among existing deep neural networks, the U-Net has provided great success in this field. In this paper, we propose a deep neural network architecture to perform an automatic lung CT image segmentation process. In the proposed method, several extensive preprocessing techniques are applied to raw CT images. Then, ground truths corresponding to these images are extracted via some morphological operations and manual reforms. Finally, all the prepared images with the corresponding ground truth are fed into a modified U-Net in which the encoder is replaced with a pre-trained ResNet-34 network (referred to as Res BCDU-Net). In the architecture, we employ BConvLSTM (Bidirectional Convolutional Long Short-term Memory)as an advanced integrator module instead of simple traditional concatenators. This is to merge the extracted feature maps of the corresponding contracting path into the previous expansion of the up-convolutional layer. Finally, a densely connected convolutional layer is utilized for the contracting path. The results of our extensive experiments on lung CT images (LIDC-IDRI database) confirm the effectiveness of the proposed method where a dice coefficient index of 97.31% is achieved.

scholarly journals HPS-Net: Multi-Task Network for Medical Image Segmentation with Predictable Performance

Symmetry ◽  
2021 ◽  
Vol 13 (11) ◽  
pp. 2107
Author(s):  
Xin Wei ◽  
Huan Wan ◽  
Fanghua Ye ◽  
Weidong Min
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Loss Function ◽  
Network Structure ◽  
Medical Diagnosis ◽  
Medical Image ◽  
Medical Image Segmentation ◽  
Training Mode ◽  
Cooperative Training

In recent years, medical image segmentation (MIS) has made a huge breakthrough due to the success of deep learning. However, the existing MIS algorithms still suffer from two types of uncertainties: (1) the uncertainty of the plausible segmentation hypotheses and (2) the uncertainty of segmentation performance. These two types of uncertainties affect the effectiveness of the MIS algorithm and then affect the reliability of medical diagnosis. Many studies have been done on the former but ignore the latter. Therefore, we proposed the hierarchical predictable segmentation network (HPS-Net), which consists of a new network structure, a new loss function, and a cooperative training mode. According to our knowledge, HPS-Net is the first network in the MIS area that can generate both the diverse segmentation hypotheses to avoid the uncertainty of the plausible segmentation hypotheses and the measure predictions about these hypotheses to avoid the uncertainty of segmentation performance. Extensive experiments were conducted on the LIDC-IDRI dataset and the ISIC2018 dataset. The results show that HPS-Net has the highest Dice score compared with the benchmark methods, which means it has the best segmentation performance. The results also confirmed that the proposed HPS-Net can effectively predict TNR and TPR.

scholarly journals Mixup (Sample Pairing) Can Improve the Performance of Deep Segmentation Networks

2021 ◽  
Vol 12 (1) ◽  
pp. 29-39
Author(s):  
Lars J. Isaksson ◽  
Paul Summers ◽  
Sara Raimondi ◽  
Sara Gandini ◽  
Abhir Bhalerao ◽  
...  
Keyword(s):  
Image Segmentation ◽  
Medical Image ◽  
Data Augmentation ◽  
Image Data ◽  
Magnetic Resonance Images ◽  
Medical Image Segmentation ◽  
Dice Similarity Coefficient ◽  
Surface Distance ◽  
Experienced Radiologist ◽  
Generalization Problem

Abstract Researchers address the generalization problem of deep image processing networks mainly through extensive use of data augmentation techniques such as random flips, rotations, and deformations. A data augmentation technique called mixup, which constructs virtual training samples from convex combinations of inputs, was recently proposed for deep classification networks. The algorithm contributed to increased performance on classification in a variety of datasets, but so far has not been evaluated for image segmentation tasks. In this paper, we tested whether the mixup algorithm can improve the generalization performance of deep segmentation networks for medical image data. We trained a standard U-net architecture to segment the prostate in 100 T2-weighted 3D magnetic resonance images from prostate cancer patients, and compared the results with and without mixup in terms of Dice similarity coefficient and mean surface distance from a reference segmentation made by an experienced radiologist. Our results suggest that mixup offers a statistically significant boost in performance compared to non-mixup training, leading to up to 1.9% increase in Dice and a 10.9% decrease in surface distance. The mixup algorithm may thus offer an important aid for medical image segmentation applications, which are typically limited by severe data scarcity.

scholarly journals Computed Tomography Angiography under Deep Learning in the Treatment of Atherosclerosis with Rapamycin

2021 ◽  
Vol 2021 ◽  
pp. 1-8
Author(s):  
Fuguang Ji ◽  
Shuai Zhou ◽  
Zhangshuan Bi
Keyword(s):  
Computed Tomography ◽  
Deep Learning ◽  
Computed Tomography Angiography ◽  
Atherosclerotic Lesion ◽  
Region Of Interest ◽  
Left Ventricular ◽  
Dice Similarity Coefficient ◽  
Imaging Features ◽  
Lesion Area ◽  
Imaging Characteristics

The clinical characteristics and vascular computed tomography (CT) imaging characteristics of patients were explored so as to assist clinicians in diagnosing patients with atherosclerosis. 316 patients with atherosclerosis who were hospitalized for emergency treatment were treated with rapamycin (RAPA) in the hospital. A group of manually delineated left ventricular myocardia (LVM) on the patient’s coronary computed tomography angiography (CCTA) were selected as the region of interest for imaging features extracted. The CCTA images of 80% of patients were randomly selected for training, and those of 20% of patients were used for verification. The correlation matrix method was used to remove redundant image omics features under different correlation thresholds. In the validation set, CCTA diagnostic parameters were about 40 times higher than the manually segmented data. The average dice similarity coefficient was 91.6%. The proposed method also produced a very small centroid distance (mean 1.058 mm, standard deviation 1.245 mm) and volume difference (mean 1.640), with a segmentation time of about 1.45 ± 0.51 s, compared to about 744.8 ± 117.49 s for physician manual segmentation. Therefore, the deep learning model effectively segmented the atherosclerotic lesion area, measured and assisted the diagnosis of future atherosclerosis clinical cases, improved medical efficiency, and accurately identified the patient’s lesion area. It had great application potential in helping diagnosis and curative effect analysis of atherosclerosis.

Ensemble-based deep meta learning for medical image segmentation

2021 ◽  
pp. 1-7
Author(s):  
Usman Ahmed ◽  
Jerry Chun-Wei Lin ◽  
Gautam Srivastava
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Learning Algorithm ◽  
State Of The Art ◽  
Medical Image Segmentation ◽  
The State ◽  
Data Set ◽  
Deep Learning Algorithm ◽  
Meta Learning ◽  
Small Set

Deep learning methods have led to a state of the art medical applications, such as image classification and segmentation. The data-driven deep learning application can help stakeholders to collaborate. However, limited labelled data set limits the deep learning algorithm to generalize for one domain into another. To handle the problem, meta-learning helps to learn from a small set of data. We proposed a meta learning-based image segmentation model that combines the learning of the state-of-the-art model and then used it to achieve domain adoption and high accuracy. Also, we proposed a prepossessing algorithm to increase the usability of the segments part and remove noise from the new test image. The proposed model can achieve 0.94 precision and 0.92 recall. The ability to increase 3.3% among the state-of-the-art algorithms.

A Study on Deep Learning Models for Medical Image Segmentation

2021 ◽  
pp. 161-174
Author(s):  
Pashupati Bhatt ◽  
Ashok Kumar Sahoo ◽  
Saumitra Chattopadhyay ◽  
Chandradeep Bhatt
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Medical Image ◽  
Medical Image Segmentation ◽  
Learning Models
Sign in / Sign up

Export Citation Format

Share Document