Medical Image Fusion Using Deep Learning Mechanism

Sparse representation(SR) model named convolutional sparsity based morphological component analysis is introduced for pixel-level medical image fusion. The CS-MCA model can achieve multicomponent and global SRs of source images, by integrating MCA and convolutional sparse representation(CSR) into a unified optimization framework. In the existing method, the CSRs of its gradient and texture components are obtained by the CSMCA model using pre-learned dictionaries. Then for each image component, sparse coefficients of all the source images are merged and then fused component is reconstructed using the corresponding dictionary. In the extension mechanism, we are using deep learning based pyramid decomposition. Now a days deep learning is a very demanding technology. Deep learning is used for image classification, object detection, image segmentation, image restoration. Keywords: CNN, CT, MRI, MCA, CS-MCA.

Remote Sensing Image Fusion Algorithm Based on Two-Stream Fusion Network and Residual Channel Attention Mechanism

A two-stream remote sensing image fusion network (RCAMTFNet) based on the residual channel attention mechanism is proposed by introducing the residual channel attention mechanism (RCAM) in this paper. In the RCAMTFNet, the spatial features of PAN and the spectral features of MS are extracted, respectively, by a two-channel feature extraction layer. Multiresidual connections allow the network to adapt to a deeper network structure without the degradation. The residual channel attention mechanism is introduced to learn the interdependence between channels, and then the correlation features among channels are adapted on the basis of the dependency. In this way, image spatial information and spectral information are extracted exclusively. What is more, pansharpening images are reconstructed across the board. Experiments are conducted on two satellite datasets, GaoFen-2 and WorldView-2. The experimental results show that the proposed algorithm is superior to the algorithms to some existing literature in the comparison of the values of reference evaluation indicators and nonreference evaluation indicators.

Detection Of Surface Defects And Subsurface Defects Of Polished Optics With Multisensor Image Fusion

Surface defects (SDs) and subsurface defects (SSDs) are the key factors decreasing the laser damage threshold of optics. Due to the spatially stacked structure, accurately detecting and distinguishing them has become a major challenge. Herein a detection method for SDs and SSDs with multisensor image fusion is proposed. The optics is illuminated by a laser under dark field condition, and the defects are excited to generate scattering and fluorescence lights, which are received by two image sensors in a wide-field microscope. With the modified algorithms of image registration and feature-level fusion, different types of defects are identified and extracted from the scattering and fluorescence images. Experiments show that two imaging modes can be realized simultaneously by multisensor image fusion, and HF etching verifies that SDs and SSDs of polished optics can be accurately distinguished. This method provides a more targeted reference for the evaluation and control of the defects of optics, and exhibits potential in the application of material surface research.