scholarly journals Convolutional Neural Networks Ensembles Through Single-Iteration Optimization

2021 ◽  
Author(s):  
Luiz Carlos Felix Ribeiro ◽  
Gustavo Henrique de Rosa ◽  
Douglas Rodrigues ◽  
João Paulo Papa
Keyword(s):  
Neural Networks ◽  
Computer Vision ◽  
Object Recognition ◽  
Convolutional Neural Networks ◽  
Object Segmentation ◽  
Random Search ◽  
Heuristic Optimization ◽  
Diverse Range ◽  
Computational Burden

Abstract Convolutional Neural Networks have been widely employed in a diverse range of computer vision-based applications, including image classification, object recognition, and object segmentation. Nevertheless, one weakness of such models concerns their hyperparameters' setting, being highly specific for each particular problem. One common approach is to employ meta-heuristic optimization algorithms to find suitable sets of hyperparameters at the expense of increasing the computational burden, being unfeasible under real-time scenarios. In this paper, we address this problem by creating Convolutional Neural Networks ensembles through Single-Iteration Optimization, a fast optimization composed of only one iteration that is no more effective than a random search. Essentially, the idea is to provide the same capability offered by long-term optimizations, however, without their computational loads. The results among four well-known literature datasets revealed that creating one-iteration optimized ensembles provide promising results while diminishing the time to achieve them.

scholarly journals What You See Is What You Transform: Foveated Spatial Transformers as a bio-inspired attention mechanism

2021 ◽  
Author(s):  
Ghassan Dabane ◽  
Laurent Perrinet ◽  
Emmanuel Daucé
Keyword(s):  
Neural Networks ◽  
Computer Vision ◽  
Object Recognition ◽  
Convolutional Neural Networks ◽  
Visual Space ◽  
Attention Mechanism ◽  
Classical Approach ◽  
Weak Point ◽  
Spatial Transformations ◽  
Training Scheme

Convolutional Neural Networks have been considered the go-to option for object recognition in computer vision for the last couple of years. However, their invariance to object’s translations is still deemed as a weak point and remains limited to small translations only via their max-pooling layers. One bio-inspired approach considers the What/Where pathway separation in Mammals to overcome this limitation. This approach works as a nature-inspired attention mechanism, another classical approach of which is Spatial Transformers. These allow an adaptive endto-end learning of different classes of spatial transformations throughout training. In this work, we overview Spatial Transformers as an attention-only mechanism and compare them with the What/Where model. We show that the use of attention restricted or “Foveated” Spatial Transformer Networks, coupled alongside a curriculum learning training scheme and an efficient log-polar visual space entry, provides better performance when compared to the What/Where model, all this without the need for any extra supervision whatsoever.

scholarly journals What You See Is What You Transform: Foveated Spatial Transformers as a bio-inspired attention mechanism

2021 ◽  
Author(s):  
Ghassan Dabane ◽  
Laurent Perrinet ◽  
Emmanuel Daucé
Keyword(s):  
Neural Networks ◽  
Computer Vision ◽  
Object Recognition ◽  
Convolutional Neural Networks ◽  
Visual Space ◽  
Attention Mechanism ◽  
Classical Approach ◽  
Weak Point ◽  
Spatial Transformations ◽  
Training Scheme

Convolutional Neural Networks have been considered the go-to option for object recognition in computer vision for the last couple of years. However, their invariance to object’s translations is still deemed as a weak point and remains limited to small translations only via their max-pooling layers. One bio-inspired approach considers the What/Where pathway separation in Mammals to overcome this limitation. This approach works as a nature-inspired attention mechanism, another classical approach of which is Spatial Transformers. These allow an adaptive endto-end learning of different classes of spatial transformations throughout training. In this work, we overview Spatial Transformers as an attention-only mechanism and compare them with the What/Where model. We show that the use of attention restricted or “Foveated” Spatial Transformer Networks, coupled alongside a curriculum learning training scheme and an efficient log-polar visual space entry, provides better performance when compared to the What/Where model, all this without the need for any extra supervision whatsoever.

scholarly journals An Analysis on Object Recognition Using Convolutional Neural Networks

2021 ◽  
Vol 10 (3) ◽  
pp. 1928-1935
Keyword(s):  
Neural Networks ◽  
Image Processing ◽  
Computer Vision ◽  
Object Recognition ◽  
Object Detection ◽  
Transfer Learning ◽  
Convolutional Neural Networks ◽  
Critical Analysis ◽  
Data Volume ◽  
Fundamental Reason

The global development and progress in scientific paraphernalia and technology is the fundamental reason for the rapid increasein the data volume. Several significant techniques have been introducedfor image processing and object detection owing to this advancement. The promising features and transfer learning of ConvolutionalNeural Network (CNN) havegained much attention around the globe by researchers as well as computer vision society, as a result of which, several remarkable breakthroughs were achieved. This paper comprehensively reviews the data classification, history as well as architecture of CNN and well-known techniques bytheir boons and absurdities. Finally, a discussion for implementation of CNN over object detection for effectual results based on their critical analysis and performances is presented

scholarly journals CNN Architectures: Alex Net, Le Net, VGG, Google Net, Res Net

2020 ◽  
Vol 8 (6) ◽  
pp. 953-960 ◽  
Keyword(s):  
Neural Networks ◽  
Computer Vision ◽  
Deep Learning ◽  
Object Recognition ◽  
Speech Recognition ◽  
Object Detection ◽  
Convolutional Neural Networks ◽  
Recognition Pattern

Convolutional Neural Networks(CNNs) are a floating area in Deep Learning. Now a days CNNs are used inside the more note worthy some portion of the Object Recognition tasks. It is used in stand-out utility regions like Speech Recognition, Pattern Acknowledgment, Computer Vision, Object Detection and extraordinary photograph handling programs. CNN orders the realities in light of an opportunity regard. Right now, inside and out assessment of CNN shape and projects are built up. A relative examine of different assortments of CNN are too portrayed on this work.

scholarly journals One Dimensional Convolutional Neural Networks for Seizure Onset Detection Using Long-term Scalp and Intracranial EEG

2021 ◽  
Author(s):  
Xiaoshuang Wang ◽  
Xiulin Wang ◽  
Wenya Liu ◽  
Zheng Chang ◽  
Tommi Karkkainen ◽  
...  
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Onset Detection ◽  
Seizure Onset ◽  
Intracranial Eeg ◽  
One Dimensional

scholarly journals Human and bird detection and classification based on Doppler radar spectrograms and vision images using convolutional neural networks

2021 ◽  
Vol 18 (3) ◽  
pp. 172988142110105
Author(s):  
Jnana Sai Abhishek Varma Gokaraju ◽  
Weon Keun Song ◽  
Min-Ho Ka ◽  
Somyot Kaitwanidvilai
Keyword(s):  
Neural Networks ◽  
Object Recognition ◽  
Convolutional Neural Networks ◽  
Doppler Radar ◽  
Autonomous Vehicle ◽  
Sampling Point ◽  
Body Segment ◽  
Kinematic Modeling ◽  
Deep Convolutional Neural Networks ◽  
Kinematic Models

The study investigated object detection and classification based on both Doppler radar spectrograms and vision images using two deep convolutional neural networks. The kinematic models for a walking human and a bird flapping its wings were incorporated into MATLAB simulations to create data sets. The dynamic simulator identified the final position of each ellipsoidal body segment taking its rotational motion into consideration in addition to its bulk motion at each sampling point to describe its specific motion naturally. The total motion induced a micro-Doppler effect and created a micro-Doppler signature that varied in response to changes in the input parameters, such as varying body segment size, velocity, and radar location. Micro-Doppler signature identification of the radar signals returned from the target objects that were animated by the simulator required kinematic modeling based on a short-time Fourier transform analysis of the signals. Both You Only Look Once V3 and Inception V3 were used for the detection and classification of the objects with different red, green, blue colors on black or white backgrounds. The results suggested that clear micro-Doppler signature image-based object recognition could be achieved in low-visibility conditions. This feasibility study demonstrated the application possibility of Doppler radar to autonomous vehicle driving as a backup sensor for cameras in darkness. In this study, the first successful attempt of animated kinematic models and their synchronized radar spectrograms to object recognition was made.

scholarly journals RGB-D-Based Object Recognition Using Multimodal Convolutional Neural Networks: A Survey

IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 43110-43136 ◽  
Author(s):  
Mingliang Gao ◽  
Jun Jiang ◽  
Guofeng Zou ◽  
Vijay John ◽  
Zheng Liu
Keyword(s):  
Neural Networks ◽  
Object Recognition ◽  
Convolutional Neural Networks
Sign in / Sign up

Export Citation Format

Share Document