You can’t “count” how many items people remember in working memory: The importance of signal detection-based measures for understanding change detection performance

Change detection tasks are commonly used to measure and understand the nature of visual working memory capacity. Across two experiments, we examine whether the nature of the latent memory signals used to perform change detection are continuous or all-or-none, and consider the implications for proper measurement of performance. In Experiment 1, we find evidence from confidence reports that visual working memory is continuous in strength, with strong support for equal variance signal detection models. We then tested a critical implication of this result without relying on model comparison or confidence reports in Experiment 2 by asking whether a simple instruction change would improve performance when measured with K, an all-or-none-measure, compared to d’, a measure based on continuous strength signals. We found strong evidence that K values increased by roughly 30% despite no change in the underlying memory signals. By contrast, we found that d’ is fixed across these same instructions, demonstrating that it correctly separates response criterion from memory performance. Overall, our data call into question a large body of work using threshold measures, like K, to analyze change detection data since this metric confounds response bias with memory performance in standard change detection tasks.

Change Target Extraction Based on Scale-Adaptive Difference Image and Morphology Filter for KOMPSAT-5

Multitemporal synthetic aperture radar (SAR) images have been widely used for change detection and monitoring of the environment owing to their competency under all weather conditions. However, owing to speckle backgrounds and strong reflections, change detection in urban areas is challenging. In this study, to automatically extract changed objects, we developed a model that integrated change detection and object extraction in multiple Korean Multi-Purpose Satellite-5 (KOMPSAT-5) images. Initially, two arbitrary L1A-level SAR images were input into the proposed model, and after pre-processing, such as radio calibration and coordinate system processing, change detection was performed. Subsequently, the desired targets were automatically extracted from the change detection results. Finally, the model obtained images of the extraction targets and metadata, such as date and location. Noise was removed by applying scale-adaptive modification to the generated difference image during the change detection process, and the detection accuracy was improved by emphasizing the occurrence of the change. After polygonizing the pixel groups of the change detection map in the target extraction process, the morphology-based object filtering technique was applied to minimize the false detection rate. As a result of the proposed approach, the changed objects in the KOMPSAT-5 images were automatically extracted with 90% accuracy.

Sentinel-1 Spatiotemporal Simulation Using Convolutional LSTM for Flood Mapping

The synthetic aperture radar (SAR) imagery has been widely applied for flooding mapping based on change detection approaches. However, errors in the mapping result are expected since not all land-cover changes are flood-induced, and those changes are sensitive to SAR data, such as crop growth or harvest over agricultural lands, clearance of forested areas, and/or modifications on the urban landscape. This study, therefore, incorporated historical SAR images to boost the detection of flood-induced changes during extreme weather events, using the Long Short-Term Memory (LSTM) method. Additionally, to incorporate the spatial signatures for the change detection, we applied a deep learning-based spatiotemporal simulation framework, Convolutional Long Short-Term Memory (ConvLSTM), for simulating a synthetic image using Sentinel One intensity time series. This synthetic image will be prepared in advance of flood events, and then it can be used to detect flood areas using change detection when the post-image is available. Practically, significant divergence between the synthetic image and post-image is expected over inundated zones, which can be mapped by applying thresholds to the Delta image (synthetic image minus post-image). We trained and tested our model on three events from Australia, Brazil, and Mozambique. The generated Flood Proxy Maps were compared against reference data derived from Sentinel Two and Planet Labs optical data. To corroborate the effectiveness of the proposed methods, we also generated Delta products for two baseline models (closest post-image minus pre-image and historical mean minus post-image) and two LSTM architectures: normal LSTM and ConvLSTM. Results show that thresholding of ConvLSTM Delta yielded the highest Cohen’s Kappa coefficients in all study cases: 0.92 for Australia, 0.78 for Mozambique, and 0.68 for Brazil. Lower Kappa values obtained in the Mozambique case can be subject to the topographic effect on SAR imagery. These results still confirm the benefits in terms of classification accuracy that convolutional operations provide in time series analysis of satellite data employing spatially correlated information in a deep learning framework.