A novel remote sensing image retrieval method based on visual salient point features

Sensor Review ◽  
2014 ◽  
Vol 34 (4) ◽  
pp. 349-359 ◽  
Author(s):  
Xing Wang ◽  
Zhenfeng Shao ◽  
Xiran Zhou ◽  
Jun Liu
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Remote Sensing Image ◽  
Saliency Map ◽  
Visual Features ◽  
Salient Point ◽  
Remote Sensing Images ◽  
Retrieval Method ◽  
Content Type ◽  
Salient Regions

Purpose – This paper aims to present a novel feature design that is able to precisely describe salient objects in images. With the development of space survey, sensor and information acquisition technologies, more complex objects appear in high-resolution remote sensing images. Traditional visual features are no longer precise enough to describe the images. Design/methodology/approach – A novel remote sensing image retrieval method based on VSP (visual salient point) features is proposed in this paper. A key point detector and descriptor are used to extract the critical features and their descriptors in remote sensing images. A visual attention model is adopted to calculate the saliency map of the images, separating the salient regions from the background in the images. The key points in the salient regions are then extracted and defined as VSPs. The VSP features can then be constructed. The similarity between images is measured using the VSP features. Findings – According to the experiment results, compared with traditional visual features, VSP features are more precise and stable in representing diverse remote sensing images. The proposed method performs better than the traditional methods in image retrieval precision. Originality/value – This paper presents a novel remote sensing image retrieval method based on VSP features.

scholarly journals Remote Sensing Image Retrieval with Gabor-CA-ResNet and Split-Based Deep Feature Transform Network

2021 ◽  
Vol 13 (5) ◽  
pp. 869
Author(s):  
Zheng Zhuo ◽  
Zhong Zhou
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
State Of The Art ◽  
Remote Sensing Image ◽  
Storage Space ◽  
Remote Sensing Images ◽  
Retrieval Method ◽  
Organization Management ◽  
Deep Feature ◽  
Feature Transform

In recent years, the amount of remote sensing imagery data has increased exponentially. The ability to quickly and effectively find the required images from massive remote sensing archives is the key to the organization, management, and sharing of remote sensing image information. This paper proposes a high-resolution remote sensing image retrieval method with Gabor-CA-ResNet and a split-based deep feature transform network. The main contributions include two points. (1) For the complex texture, diverse scales, and special viewing angles of remote sensing images, A Gabor-CA-ResNet network taking ResNet as the backbone network is proposed by using Gabor to represent the spatial-frequency structure of images, channel attention (CA) mechanism to obtain stronger representative and discriminative deep features. (2) A split-based deep feature transform network is designed to divide the features extracted by the Gabor-CA-ResNet network into several segments and transform them separately for reducing the dimensionality and the storage space of deep features significantly. The experimental results on UCM, WHU-RS, RSSCN7, and AID datasets show that, compared with the state-of-the-art methods, our method can obtain competitive performance, especially for remote sensing images with rare targets and complex textures.

scholarly journals Deep Hash Remote Sensing Image Retrieval with Hard Probability Sampling

2020 ◽  
Vol 12 (17) ◽  
pp. 2789 ◽  
Author(s):  
Xue Shan ◽  
Pingping Liu ◽  
Guixia Gou ◽  
Qiuzhan Zhou ◽  
Zhen Wang
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Data Augmentation ◽  
Satellite Observation ◽  
Remote Sensing Image ◽  
Aerial Image ◽  
Remote Sensing Images ◽  
Retrieval Method ◽  
Probability Sampling ◽  
Memory Space

As satellite observation technology improves, the number of remote sensing images significantly and rapidly increases. Therefore, a growing number of studies are focusing on remote sensing image retrieval. However, having a large number of remote sensing images considerably slows the retrieval time and takes up a great deal of memory space. The hash method is being increasingly used for rapid image retrieval because of its remarkably fast performance. At the same time, selecting samples that contain more information and greater stability to train the network has gradually become the key to improving retrieval performance. Given the above considerations, we propose a deep hash remote sensing image retrieval method, called the hard probability sampling hash retrieval method (HPSH), which combines hash code learning with hard probability sampling in a deep network. Specifically, we used a probability sampling method to select training samples, and we designed one novel hash loss function to better train the network parameters and reduce the hashing accuracy loss due to quantization. Our experimental results demonstrate that HPSH could yield an excellent representation compared with other state-of-the-art hash approaches. For the university of California, merced (UCMD) dataset, HPSH+S resulted in a mean average precision (mAP) of up to 90.9% on 16 hash bits, 92.2% on 24 hash bits, and 92.8% on 32 hash bits. For the aerial image dataset (AID), HPSH+S achieved a mAP of up to 89.8% on 16 hash bits, 93.6% on 24 hash bits, and 95.5% on 32 hash bits. For the UCMD dataset, with the use of data augmentation, our proposed approach achieved a mAP of up to 99.6% on 32 hash bits and 99.7% on 64 hash bits.

scholarly journals Performance Evaluation of Single-Label and Multi-Label Remote Sensing Image Retrieval Using a Dense Labeling Dataset

2018 ◽  
Vol 10 (6) ◽  
pp. 964 ◽  
Author(s):  
Zhenfeng Shao ◽  
Ke Yang ◽  
Weixun Zhou
Keyword(s):  
Remote Sensing ◽  
Performance Evaluation ◽  
Deep Learning ◽  
Image Retrieval ◽  
Semantic Segmentation ◽  
Semantic Content ◽  
Remote Sensing Image ◽  
Remote Sensing Images ◽  
Benchmark Datasets ◽  
Feature Based

Benchmark datasets are essential for developing and evaluating remote sensing image retrieval (RSIR) approaches. However, most of the existing datasets are single-labeled, with each image in these datasets being annotated by a single label representing the most significant semantic content of the image. This is sufficient for simple problems, such as distinguishing between a building and a beach, but multiple labels and sometimes even dense (pixel) labels are required for more complex problems, such as RSIR and semantic segmentation.We therefore extended the existing multi-labeled dataset collected for multi-label RSIR and presented a dense labeling remote sensing dataset termed "DLRSD". DLRSD contained a total of 17 classes, and the pixels of each image were assigned with 17 pre-defined labels. We used DLRSD to evaluate the performance of RSIR methods ranging from traditional handcrafted feature-based methods to deep learning-based ones. More specifically, we evaluated the performances of RSIR methods from both single-label and multi-label perspectives. These results demonstrated the advantages of multiple labels over single labels for interpreting complex remote sensing images. DLRSD provided the literature a benchmark for RSIR and other pixel-based problems such as semantic segmentation.

scholarly journals A co-occurrence region based Bayesian network stepwise remote sensing image retrieval algorithm

2018 ◽  
Vol 22 (1) ◽  
pp. 29-35 ◽  
Author(s):  
Rui Zeng ◽  
Yingyan Wang ◽  
Wanliang Wang
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Bayesian Network ◽  
Remote Sensing Image ◽  
Structure Design ◽  
System Structure ◽  
Retrieval Algorithm ◽  
Remote Sensing Images ◽  
High Frequency Signal ◽  
Application Systems

Although scholars have conducted numerous researches on content-based image retrieval and obtained great achievements, they make little progress in studying remote sensing image retrieval. Both theoretical and application systems are immature. Since remote sensing images are characterized by large data volume, broad coverage, vague themes and rich semantics, the research results on natural images and medical images cannot be directly used in remote sensing image retrieval. Even perfect content-based remote sensing image retrieval systems have many difficulties with data organization, storage and management, feature description and extraction, similarity measurement, relevance feedback, network service mode, and system structure design and implementation. This paper proposes a remote sensing image retrieval algorithm that combines co-occurrence region based Bayesian network image retrieval with average high-frequency signal strength. By Bayesian networks, it establishes correspondence relationships between images and semantics, thereby realizing semantic-based retrieval of remote sensing images. In the meantime, integrated region matching is introduced for iterative retrieval, which effectively improves the precision of semantic retrieval.

scholarly journals Cohesion Intensive Deep Hashing for Remote Sensing Image Retrieval

2019 ◽  
Vol 12 (1) ◽  
pp. 101 ◽  
Author(s):  
Lirong Han ◽  
Peng Li ◽  
Xiao Bai ◽  
Christos Grecos ◽  
Xiaoyu Zhang ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Large Scale ◽  
Remote Sensing Data ◽  
Optimization Method ◽  
Remote Sensing Image ◽  
Model Parameters ◽  
Remote Sensing Images ◽  
Deep Hashing ◽  
Deep Model

Recently, the demand for remote sensing image retrieval is growing and attracting the interest of many researchers because of the increasing number of remote sensing images. Hashing, as a method of retrieving images, has been widely applied to remote sensing image retrieval. In order to improve hashing performance, we develop a cohesion intensive deep hashing model for remote sensing image retrieval. The underlying architecture of our deep model is motivated by the state-of-the-art residual net. Residual nets aim at avoiding gradient vanishing and gradient explosion when the net reaches a certain depth. However, different from the residual net which outputs multiple class-labels, we present a residual hash net that is terminated by a Heaviside-like function for binarizing remote sensing images. In this scenario, the representational power of the residual net architecture is exploited to establish an end-to-end deep hashing model. The residual hash net is trained subject to a weighted loss strategy that intensifies the cohesiveness of image hash codes within one class. This effectively addresses the data imbalance problem normally arising in remote sensing image retrieval tasks. Furthermore, we adopted a gradualness optimization method for obtaining optimal model parameters in order to favor accurate binary codes with little quantization error. We conduct comparative experiments on large-scale remote sensing data sets such as UCMerced and AID. The experimental results validate the hypothesis that our method improves the performance of current remote sensing image retrieval.

Multi-Visual Features Based Ship Detection in Remote Sensing Images

2014 ◽  
Vol 643 ◽  
pp. 228-232
Author(s):  
Xiao Guang Hu ◽  
Cheng Qi Cheng ◽  
De Ren Li
Keyword(s):  
Remote Sensing ◽  
Detection Method ◽  
Saliency Map ◽  
Visual Features ◽  
Remote Sensing Images ◽  
Complex Scene ◽  
Detection Experiment ◽  
Ship Detection ◽  
Visual Contrast ◽  
Design Idea

In this paper, we propose a novel ship detection method based on multi-visual features after analyzing the characteristics of ship in the sea. According to the principal of the visual contrast, brightness and orientation saliency map of ship object are respectively generated, and then they are integrated to obtain the total saliency map. In addition to the brightness and orientation of the ship objects, the method doesn’t use other prior knowledge of them. In ship detection experiment, the experimental results prove our method can effectively concentrate on the ship objects regardless of their size and brightness, and thereby improve the capacity of visual attention in complex scene. Thus, the design idea of our method is verified.

scholarly journals Deep Hashing Using Proxy Loss on Remote Sensing Image Retrieval

2021 ◽  
Vol 13 (15) ◽  
pp. 2924
Author(s):  
Xue Shan ◽  
Pingping Liu ◽  
Yifan Wang ◽  
Qiuzhan Zhou ◽  
Zhen Wang
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Metric Learning ◽  
Remote Sensing Image ◽  
Convergence Time ◽  
Aerial Image ◽  
Shooting Methods ◽  
Retrieval Method ◽  
Memory Space ◽  
Deep Hashing

With the improvement of various space-satellite shooting methods, the sources, scenes, and quantities of remote sensing data are also increasing. An effective and fast remote sensing image retrieval method is necessary, and many researchers have conducted a lot of work in this direction. Nevertheless, a fast retrieval method called hashing retrieval is proposed to improve retrieval speed, while maintaining retrieval accuracy and greatly reducing memory space consumption. At the same time, proxy-based metric learning losses can reduce convergence time. Naturally, we present a proxy-based hash retrieval method, called DHPL (Deep Hashing using Proxy Loss), which combines hash code learning with proxy-based metric learning in a convolutional neural network. Specifically, we designed a novel proxy metric learning network, and we used one hash loss function to reduce the quantified losses. For the University of California Merced (UCMD) dataset, DHPL resulted in a mean average precision (mAP) of up to 98.53% on 16 hash bits, 98.83% on 32 hash bits, 99.01% on 48 hash bits, and 99.21% on 64 hash bits. For the aerial image dataset (AID), DHPL achieved an mAP of up to 93.53% on 16 hash bits, 97.36% on 32 hash bits, 98.28% on 48 hash bits, and 98.54% on 64 bits. Our experimental results on UCMD and AID datasets illustrate that DHPL could generate great results compared with other state-of-the-art hash approaches.

scholarly journals Distribution Consistency Loss for Large-Scale Remote Sensing Image Retrieval

2020 ◽  
Vol 12 (1) ◽  
pp. 175 ◽  
Author(s):  
Lili Fan ◽  
Hongwei Zhao ◽  
Haoyu Zhao
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Large Scale ◽  
Metric Learning ◽  
Remote Sensing Image ◽  
Positive Sample ◽  
Fine Tuning ◽  
Remote Sensing Images ◽  
Hard Samples ◽  
Image Datasets

Remote sensing images are featured by massiveness, diversity and complexity. These features put forward higher requirements for the speed and accuracy of remote sensing image retrieval. The extraction method plays a key role in retrieving remote sensing images. Deep metric learning (DML) captures the semantic similarity information between data points by learning embedding in vector space. However, due to the uneven distribution of sample data in remote sensing image datasets, the pair-based loss currently used in DML is not suitable. To improve this, we propose a novel distribution consistency loss to solve this problem. First, we define a new way to mine samples by selecting five in-class hard samples and five inter-class hard samples to form an informative set. This method can make the network extract more useful information in a short time. Secondly, in order to avoid inaccurate feature extraction due to sample imbalance, we assign dynamic weight to the positive samples according to the ratio of the number of hard samples and easy samples in the class, and name the loss caused by the positive sample as the sample balance loss. We combine the sample balance of the positive samples with the ranking consistency of the negative samples to form our distribution consistency loss. Finally, we built an end-to-end fine-tuning network suitable for remote sensing image retrieval. We display comprehensive experimental results drawing on three remote sensing image datasets that are publicly available and show that our method achieves the state-of-the-art performance.

scholarly journals Coarse-to-Fine Deep Metric Learning for Remote Sensing Image Retrieval

2020 ◽  
Vol 12 (2) ◽  
pp. 219 ◽  
Author(s):  
Min-Sub Yun ◽  
Woo-Jeoung Nam ◽  
Seong-Whan Lee
Keyword(s):  
Remote Sensing ◽  
South Korea ◽  
Image Retrieval ◽  
Loss Function ◽  
Remote Sensing Image ◽  
Google Earth ◽  
Remote Sensing Images ◽  
Query Image ◽  
Coverage Area ◽  
Coarse To Fine

Remote sensing image retrieval (RSIR) is the process of searching for identical areas by investigating the similarities between a query image and the database images. RSIR is a challenging task owing to the time difference, viewpoint, and coverage area depending on the shooting circumstance, resulting in variations in the image contents. In this paper, we propose a novel method based on a coarse-to-fine strategy, which makes a deep network more robust to the variations in remote sensing images. Moreover, we propose a new triangular loss function to consider the whole relation within the tuple. This loss function improves the retrieval performance and demonstrates better performance in terms of learning the detailed information in complex remote sensing images. To verify our methods, we experimented with the Google Earth South Korea dataset, which contains 40,000 images, using the evaluation metric Recall@n. In all experiments, we obtained better performance results than those of the existing retrieval training methods. Our source code and Google Earth South Korea dataset are available online.

Sign in / Sign up

Export Citation Format

Share Document