Automatic Handgun Detection with Deep Learning in Video Surveillance Images

There is a great need to implement preventive mechanisms against shootings and terrorist acts in public spaces with a large influx of people. While surveillance cameras have become common, the need for monitoring 24/7 and real-time response requires automatic detection methods. This paper presents a study based on three convolutional neural network (CNN) models applied to the automatic detection of handguns in video surveillance images. It aims to investigate the reduction of false positives by including pose information associated with the way the handguns are held in the images belonging to the training dataset. The results highlighted the best average precision (96.36%) and recall (97.23%) obtained by RetinaNet fine-tuned with the unfrozen ResNet-50 backbone and the best precision (96.23%) and F1 score values (93.36%) obtained by YOLOv3 when it was trained on the dataset including pose information. This last architecture was the only one that showed a consistent improvement—around 2%—when pose information was expressly considered during training.

Download Full-text

Effectiveness of transfer learning for enhancing tumor classification with a convolutional neural network on frozen sections

Scientific Reports ◽

10.1038/s41598-020-78129-0 ◽

2020 ◽

Vol 10 (1) ◽

Author(s):

Young-Gon Kim ◽

Sungchul Kim ◽

Cristina Eunbee Cho ◽

In Hye Song ◽

Hee Jin Lee ◽

...

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Transfer Learning ◽

Frozen Section ◽

Medical Center ◽

External Validation ◽

Model Performance ◽

Classification Model ◽

Training Dataset

AbstractFast and accurate confirmation of metastasis on the frozen tissue section of intraoperative sentinel lymph node biopsy is an essential tool for critical surgical decisions. However, accurate diagnosis by pathologists is difficult within the time limitations. Training a robust and accurate deep learning model is also difficult owing to the limited number of frozen datasets with high quality labels. To overcome these issues, we validated the effectiveness of transfer learning from CAMELYON16 to improve performance of the convolutional neural network (CNN)-based classification model on our frozen dataset (N = 297) from Asan Medical Center (AMC). Among the 297 whole slide images (WSIs), 157 and 40 WSIs were used to train deep learning models with different dataset ratios at 2, 4, 8, 20, 40, and 100%. The remaining, i.e., 100 WSIs, were used to validate model performance in terms of patch- and slide-level classification. An additional 228 WSIs from Seoul National University Bundang Hospital (SNUBH) were used as an external validation. Three initial weights, i.e., scratch-based (random initialization), ImageNet-based, and CAMELYON16-based models were used to validate their effectiveness in external validation. In the patch-level classification results on the AMC dataset, CAMELYON16-based models trained with a small dataset (up to 40%, i.e., 62 WSIs) showed a significantly higher area under the curve (AUC) of 0.929 than those of the scratch- and ImageNet-based models at 0.897 and 0.919, respectively, while CAMELYON16-based and ImageNet-based models trained with 100% of the training dataset showed comparable AUCs at 0.944 and 0.943, respectively. For the external validation, CAMELYON16-based models showed higher AUCs than those of the scratch- and ImageNet-based models. Model performance for slide feasibility of the transfer learning to enhance model performance was validated in the case of frozen section datasets with limited numbers.

Download Full-text

A Deep Learning-Based Approach for the Detection of Early Signs of Gingivitis in Orthodontic Patients Using Faster Region-Based Convolutional Neural Networks

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph17228447 ◽

2020 ◽

Vol 17 (22) ◽

pp. 8447

Author(s):

Dima M. Alalharith ◽

Hajar M. Alharthi ◽

Wejdan M. Alghamdi ◽

Yasmine M. Alsenbel ◽

Nida Aslam ◽

...

Keyword(s):

Neural Network ◽

Deep Learning ◽

Periodontal Disease ◽

Convolutional Neural Network ◽

Region Of Interest ◽

Training Dataset ◽

Detection Accuracy ◽

Detection Model ◽

Art Object ◽

Orthodontic Patients

Computer-based technologies play a central role in the dentistry field, as they present many methods for diagnosing and detecting various diseases, such as periodontitis. The current study aimed to develop and evaluate the state-of-the-art object detection and recognition techniques and deep learning algorithms for the automatic detection of periodontal disease in orthodontic patients using intraoral images. In this study, a total of 134 intraoral images were divided into a training dataset (n = 107 [80%]) and a test dataset (n = 27 [20%]). Two Faster Region-based Convolutional Neural Network (R-CNN) models using ResNet-50 Convolutional Neural Network (CNN) were developed. The first model detects the teeth to locate the region of interest (ROI), while the second model detects gingival inflammation. The detection accuracy, precision, recall, and mean average precision (mAP) were calculated to verify the significance of the proposed model. The teeth detection model achieved an accuracy, precision, recall, and mAP of 100 %, 100%, 51.85%, and 100%, respectively. The inflammation detection model achieved an accuracy, precision, recall, and mAP of 77.12%, 88.02%, 41.75%, and 68.19%, respectively. This study proved the viability of deep learning models for the detection and diagnosis of gingivitis in intraoral images. Hence, this highlights its potential usability in the field of dentistry and aiding in reducing the severity of periodontal disease globally through preemptive non-invasive diagnosis.

Download Full-text

Superresolution Reconstruction of Video Based on Efficient Subpixel Convolutional Neural Network for Urban Computing

Wireless Communications and Mobile Computing ◽

10.1155/2020/8865110 ◽

2020 ◽

Vol 2020 ◽

pp. 1-11

Author(s):

Jie Shen ◽

Mengxi Xu ◽

Xinyu Du ◽

Yunbo Xiong

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Optical Flow ◽

Video Surveillance ◽

Reconstruction Method ◽

Motion Information ◽

Learning Networks ◽

Urban Computing ◽

Deep Convolution Network

Video surveillance is an important data source of urban computing and intelligence. The low resolution of many existing video surveillance devices affects the efficiency of urban computing and intelligence. Therefore, improving the resolution of video surveillance is one of the important tasks of urban computing and intelligence. In this paper, the resolution of video is improved by superresolution reconstruction based on a learning method. Different from the superresolution reconstruction of static images, the superresolution reconstruction of video is characterized by the application of motion information. However, there are few studies in this area so far. Aimed at fully exploring motion information to improve the superresolution of video, this paper proposes a superresolution reconstruction method based on an efficient subpixel convolutional neural network, where the optical flow is introduced in the deep learning network. Fusing the optical flow features between successive frames can compensate for information in frames and generate high-quality superresolution results. In addition, in order to improve the superresolution, a superpixel convolution layer is added after the deep convolution network. Finally, experimental evaluations demonstrate the satisfying performance of our method compared with previous methods and other deep learning networks; our method is more efficient.

Download Full-text

Investigation of optimal configurations of a convolutional neural network for the identification of objects in real-time

Information Technology and Nanotechnology ◽

10.18287/1613-0073-2019-2416-417-423 ◽

2019 ◽

pp. 417-423

Author(s):

M A Isayev ◽

D A Savelyev

Keyword(s):

Neural Network ◽

Neural Networks ◽

Deep Learning ◽

Convolutional Neural Network ◽

Real Time ◽

State Of The Art ◽

Average Precision ◽

The Core ◽

Particular Solution ◽

Optimal Configurations

The comparison of different convolutional neural networks which are the core of the most actual solutions in the computer vision area is considers in hhe paper. The study includes benchmarks of this state-of-the-art solutions by some criteria, such as mAP (mean average precision), FPS (frames per seconds), for the possibility of real-time usability. It is concluded on the best convolutional neural network model and deep learning methods that were used at particular solution.

Download Full-text

Building an Otoscopic screening prototype tool using deep learning

Journal of Otolaryngology - Head and Neck Surgery ◽

10.1186/s40463-019-0389-9 ◽

2019 ◽

Vol 48 (1) ◽

Cited By ~ 5

Author(s):

Devon Livingstone ◽

Aron S. Talai ◽

Justin Chau ◽

Nils D. Forkert

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Primary Care Providers ◽

Deep Convolutional Neural Network ◽

Training Dataset ◽

Great Success ◽

Care Providers ◽

Tympanostomy Tubes ◽

Tympanic Membranes

Abstract Background Otologic diseases are often difficult to diagnose accurately for primary care providers. Deep learning methods have been applied with great success in many areas of medicine, often outperforming well trained human observers. The aim of this work was to develop and evaluate an automatic software prototype to identify otologic abnormalities using a deep convolutional neural network. Material and methods A database of 734 unique otoscopic images of various ear pathologies, including 63 cerumen impactions, 120 tympanostomy tubes, and 346 normal tympanic membranes were acquired. 80% of the images were used for the training of a convolutional neural network and the remaining 20% were used for algorithm validation. Image augmentation was employed on the training dataset to increase the number of training images. The general network architecture consisted of three convolutional layers plus batch normalization and dropout layers to avoid over fitting. Results The validation based on 45 datasets not used for model training revealed that the proposed deep convolutional neural network is capable of identifying and differentiating between normal tympanic membranes, tympanostomy tubes, and cerumen impactions with an overall accuracy of 84.4%. Conclusion Our study shows that deep convolutional neural networks hold immense potential as a diagnostic adjunct for otologic disease management.

Download Full-text

Deep Learning Approaches on Defect Detection in High Resolution Aerial Images of Insulators

Sensors ◽

10.3390/s21041033 ◽

2021 ◽

Vol 21 (4) ◽

pp. 1033

Author(s):

Qiaodi Wen ◽

Ziqi Luo ◽

Ruitao Chen ◽

Yifan Yang ◽

Guofa Li

Keyword(s):

Neural Network ◽

Deep Learning ◽

High Resolution ◽

Convolutional Neural Network ◽

Target Detection ◽

Defect Detection ◽

Region Of Interest ◽

Aerial Images ◽

Detection Methods ◽

Complex Background

By detecting the defect location in high-resolution insulator images collected by unmanned aerial vehicle (UAV) in various environments, the occurrence of power failure can be timely detected and the caused economic loss can be reduced. However, the accuracies of existing detection methods are greatly limited by the complex background interference and small target detection. To solve this problem, two deep learning methods based on Faster R-CNN (faster region-based convolutional neural network) are proposed in this paper, namely Exact R-CNN (exact region-based convolutional neural network) and CME-CNN (cascade the mask extraction and exact region-based convolutional neural network). Firstly, we proposed an Exact R-CNN based on a series of advanced techniques including FPN (feature pyramid network), cascade regression, and GIoU (generalized intersection over union). RoI Align (region of interest align) is introduced to replace RoI pooling (region of interest pooling) to address the misalignment problem, and the depthwise separable convolution and linear bottleneck are introduced to reduce the computational burden. Secondly, a new pipeline is innovatively proposed to improve the performance of insulator defect detection, namely CME-CNN. In our proposed CME-CNN, an insulator mask image is firstly generated to eliminate the complex background by using an encoder-decoder mask extraction network, and then the Exact R-CNN is used to detect the insulator defects. The experimental results show that our proposed method can effectively detect insulator defects, and its accuracy is better than the examined mainstream target detection algorithms.

Download Full-text

Automatic Detection of Modulation Scheme Using Convolutional Neural Networks

10.21203/rs.3.rs-495943/v1 ◽

2021 ◽

Author(s):

Blessy Babu ◽

Hari V Sreeniva

Keyword(s):

Neural Network ◽

Neural Networks ◽

Feature Extraction ◽

Convolutional Neural Network ◽

Convolutional Neural Networks ◽

System Performance ◽

Automatic Detection ◽

Training Dataset ◽

Modulation Scheme ◽

Intelligent Detection

Abstract This paper summarizes the intelligent detection of modulation scheme in an incoming signal, build on convolutional neural network (CNN). It describes the creation of training dataset, realization of CNN, testing and validation. The raw modulated signals are converted into 2D and put on to the network for training. The resulting prototype is adopted for detection. The results signify that the intended approach gives better prediction for the identification of modulated signal without need for any selective feature extraction. The system performance on noise is also evaluated and modelled.

Download Full-text

Mobile-Unet: An efficient convolutional neural network for fabric defect detection

Textile Research Journal ◽

10.1177/0040517520928604 ◽

2020 ◽

pp. 004051752092860 ◽

Cited By ~ 5

Author(s):

Junfeng Jing ◽

Zhen Wang ◽

Matthias Rätsch ◽

Huanhuan Zhang

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Defect Detection ◽

Production Efficiency ◽

Detection Methods ◽

Median Frequency ◽

Fabric Defect Detection ◽

Fabric Defect ◽

Model Training

Deep learning–based fabric defect detection methods have been widely investigated to improve production efficiency and product quality. Although deep learning–based methods have proved to be powerful tools for classification and segmentation, some key issues remain to be addressed when applied to real applications. Firstly, the actual fabric production conditions of factories necessitate higher real-time performance of methods. Moreover, fabric defects as abnormal samples are very rare compared with normal samples, which results in data imbalance. It makes model training based on deep learning challenging. To solve these problems, an extremely efficient convolutional neural network, Mobile-Unet, is proposed to achieve the end-to-end defect segmentation. The median frequency balancing loss function is used to overcome the challenge of sample imbalance. Additionally, Mobile-Unet introduces depth-wise separable convolution, which dramatically reduces the complexity cost and model size of the network. It comprises two parts: encoder and decoder. The MobileNetV2 feature extractor is used as the encoder, and then five deconvolution layers are added as the decoder. Finally, the softmax layer is used to generate the segmentation mask. The performance of the proposed model has been evaluated by public fabric datasets and self-built fabric datasets. In comparison with other methods, the experimental results demonstrate that segmentation accuracy and detection speed in the proposed method achieve state-of-the-art performance.

Download Full-text

ID: 3526753 DEEP LEARNING AND CAPSULE ENDOSCOPY: AUTOMATIC DETECTION OF ULCERS AND ENTERIC EROSIONS IN CAPSULE ENDOSCOPY USING A CONVOLUTIONAL NEURAL NETWORK

Gastrointestinal Endoscopy ◽

10.1016/j.gie.2021.03.895 ◽

2021 ◽

Vol 93 (6) ◽

pp. AB351-AB352

Author(s):

Miguel M. Saraiva ◽

Helder Cardoso ◽

João Afonso ◽

João Ferreira ◽

Patrícia Andrade ◽

...

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Capsule Endoscopy ◽

Automatic Detection

Download Full-text

Identification of Types of Wood using Convolutional Neural Network with Mobilenet Architecture

Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) ◽

10.29207/resti.v4i1.1445 ◽

2020 ◽

Vol 4 (1) ◽

pp. 70-76

Author(s):

Hendriyana Hendriyana ◽

Yazid Hilman Maulana

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

General Characteristic ◽

Training Dataset ◽

Learning Method ◽

Wood Identification ◽

The Senses ◽

The Right

Indonesia is a wood producing with large number of forest and various type of trees in less than 4000 species of trees in Indonesia’s forest. The activity of wood identification is effort to get information about kind of wood. The identification type of wood that have similar characteristics, it is difficult to identify the right type of wood. The characteristic can be allotted to two group, general characteristic and anatomy characteristic. General characteristics can be seen directly by the senses without tools, while anatomy characteristics can be seen with tools such as loupe or microscope. Convolutional Neural Network with mobilenet architecture is a Deep Learning method that can be use identify and classifying an object. In this study, using 1000 images for 10 types of wood in each type. The images split into 90 images training dataset dan 10 images for validation datasets captured by mobilephone. Based on the result of research, the obtained level of accuracy 98% training, 93,3% testing, 28% recall, and 93% for precission. That result can be concluded that performance from this model in this research is optimal to classification the kind of wood.

Download Full-text