scholarly journals Cortical Sensitivity to Natural Scene Structure

2019 ◽  
Author(s):  
Daniel Kaiser ◽  
Greta Häberle ◽  
Radoslaw M. Cichy
Keyword(s):  
Spatial Structure ◽  
Human Vision ◽  
Scene Analysis ◽  
Natural Scenes ◽  
Natural Environments ◽  
Cortical Processing ◽  
Natural Scene ◽  
Visual Inputs ◽  
Scene Structure ◽  
Categorical Structure

AbstractNatural scenes are inherently structured, with meaningful objects appearing in predictable locations. Human vision is tuned to this structure: When scene structure is purposefully jumbled, perception is strongly impaired. Here, we tested how such perceptual effects are reflected in neural sensitivity to scene structure. During separate fMRI and EEG experiments, participants passively viewed scenes whose spatial structure (i.e., the position of scene parts) and categorical structure (i.e., the content of scene parts) could be intact or jumbled. Using multivariate decoding, we show that spatial (but not categorical) scene structure profoundly impacts on cortical processing: Scene-selective responses in occipital and parahippocampal cortices (fMRI) and after 255ms (EEG) accurately differentiated between spatially intact and jumbled scenes. Importantly, this differentiation was more pronounced for upright than for inverted scenes, indicating genuine sensitivity to spatial structure rather than sensitivity to low-level attributes. Our findings suggest that visual scene analysis is tightly linked to the spatial structure of our natural environments. This link between cortical processing and scene structure may be crucial for rapidly parsing naturalistic visual inputs.

scholarly journals Mice use robust and common strategies to discriminate natural scenes

2017 ◽  
Author(s):  
Yiyi Yu ◽  
Riichiro Hira ◽  
Jeffrey N. Stirman ◽  
Waylin Yu ◽  
Ikuko T. Smith ◽  
...  
Keyword(s):  
Gabor Filter ◽  
Discrimination Performance ◽  
Structural Similarity ◽  
Orientation Dependence ◽  
Natural Scenes ◽  
Natural Environments ◽  
Natural Scene ◽  
Image Metrics ◽  
Screen System ◽  
Mouse Vision

AbstractMice use vision to navigate and avoid predators in natural environments. However, the spatial resolution of mouse vision is poor compared to primates, and mice lack a fovea. Thus, it is unclear how well mice can discriminate ethologically relevant scenes. Here, we examined natural scene discrimination in mice using an automated touch-screen system. We estimated the discrimination difficulty using the computational metric structural similarity (SSIM), and constructed psychometric curves. However, the performance of each mouse was better predicted by the population mean than SSIM. This high inter-mouse agreement indicates that mice use common and robust strategies to discriminate natural scenes. We tested several other image metrics to find an alternative to SSIM for predicting discrimination performance. We found that a simple, primary visual cortex (V1)-inspired model predicted mouse performance with fidelity approaching the inter-mouse agreement. The model involved convolving the images with Gabor filters, and its performance varied with the orientation of the Gabor filter. This orientation dependence was driven by the stimuli, rather than an innate biological feature. Together, these results indicate that mice are adept at discriminating natural scenes, and their performance is well predicted by simple models of V1 processing.

scholarly journals Coherent natural scene structure facilitates the extraction of task-relevant object information in visual cortex

2020 ◽  
Author(s):  
Daniel Kaiser ◽  
Greta Häberle ◽  
Radoslaw M. Cichy
Keyword(s):  
Visual Cortex ◽  
Rural Environment ◽  
Natural Scenes ◽  
Natural Environments ◽  
Response Patterns ◽  
Scene Structure ◽  
Processing Pathways ◽  
Typical Composition ◽  
High Level ◽  
The Brain

AbstractLooking for objects within complex natural environments is a task everybody performs multiple times each day. In this study, we explore how the brain uses the typical composition of real-world environments to efficiently solve this task. We recorded fMRI activity while participants performed two different categorization tasks on natural scenes. In the object task, they indicated whether the scene contained a person or a car, while in the scene task, they indicated whether the scene depicted an urban or a rural environment. Critically, each scene was presented in an “intact” way, preserving its coherent structure, or in a “jumbled” way, with information swapped across quadrants. In both tasks, participants’ categorization was more accurate and faster for intact scenes. These behavioral benefits were accompanied by stronger responses to intact than to jumbled scenes across high-level visual cortex. To track the amount of object information in visual cortex, we correlated multivoxel response patterns during the two categorization tasks with response patterns evoked by people and cars in isolation. We found that object information in object- and body-selective cortex was enhanced when the object was embedded in an intact, rather than a jumbled scene. However, this enhancement was only found in the object task: When participants instead categorized the scenes, object information did not differ between intact and jumbled scenes. Together, these results indicate that coherent scene structure facilitates the extraction of object information in a task-dependent way, suggesting that interactions between the object and scene processing pathways adaptively support behavioral goals.

scholarly journals Spatial vision by macaque midbrain

2017 ◽  
Author(s):  
Chih-Yang Chen ◽  
Lukas Sonnenberg ◽  
Simone Weller ◽  
Thede Witschel ◽  
Ziad M. Hafed
Keyword(s):  
Superior Colliculus ◽  
Spatial Vision ◽  
Population Level ◽  
Visual Exploration ◽  
Natural Scenes ◽  
Natural Environments ◽  
Natural Scene ◽  
Natural Scene Statistics ◽  
Brain Areas ◽  
Spatial Frequencies

Visual brain areas exhibit tuning characteristics that are well suited for image statistics present in our natural environment. However, visual sensation is an active process, and if there are any brain areas that ought to be particularly 'in tune' with natural scene statistics, it would be sensory-motor areas critical for guiding behavior. Here we found that the primate superior colliculus, a structure instrumental for rapid visual exploration with saccades, detects low spatial frequencies, which are the most prevalent in natural scenes, much more rapidly than high spatial frequencies. Importantly, this accelerated detection happens independently of whether a neuron is more or less sensitive to low spatial frequencies to begin with. At the population level, the superior colliculus additionally over-represents low spatial frequencies in neural response sensitivity, even at near-foveal eccentricities. Thus, the superior colliculus possesses both temporal and response gain mechanisms for efficient gaze realignment in low-spatial-frequency dominated natural environments.

scholarly journals Generalist camouflage can be more successful than microhabitat specialisation in natural environments

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Emmanuelle Sophie Briolat ◽  
Lina María Arenas ◽  
Anna E. Hughes ◽  
Eric Liggins ◽  
Martin Stevens
Keyword(s):  
Survival Benefit ◽  
Search Task ◽  
Natural Scenes ◽  
Science Methods ◽  
Natural Environments ◽  
Background Matching ◽  
Computer Based ◽  
Visual Scenes ◽  
Small Targets ◽  
Predator Defence

Abstract Background Crypsis by background-matching is a critical form of anti-predator defence for animals exposed to visual predators, but achieving effective camouflage in patchy and variable natural environments is not straightforward. To cope with heterogeneous backgrounds, animals could either specialise on particular microhabitat patches, appearing cryptic in some areas but mismatching others, or adopt a compromise strategy, providing partial matching across different patch types. Existing studies have tested the effectiveness of compromise strategies in only a limited set of circumstances, primarily with small targets varying in pattern, and usually in screen-based tasks. Here, we measured the detection risk associated with different background-matching strategies for relatively large targets, with human observers searching for them in natural scenes, and focusing on colour. Model prey were designed to either ‘specialise’ on the colour of common microhabitat patches, or ‘generalise’ by matching the average colour of the whole visual scenes. Results In both the field and an equivalent online computer-based search task, targets adopting the generalist strategy were more successful in evading detection than those matching microhabitat patches. This advantage occurred because, across all possible locations in these experiments, targets were typically viewed against a patchwork of different microhabitat areas; the putatively generalist targets were thus more similar on average to their various immediate surroundings than were the specialists. Conclusions Demonstrating close agreement between the results of field and online search experiments provides useful validation of online citizen science methods commonly used to test principles of camouflage, at least for human observers. In finding a survival benefit to matching the average colour of the visual scenes in our chosen environment, our results highlight the importance of relative scales in determining optimal camouflage strategies, and suggest how compromise coloration can succeed in nature.

scholarly journals Analysis and Evaluation of the Spatial Structure of Cittaslow Towns on the Example of Selected Regions in Central Italy and North-Eastern Poland

Land ◽  
2021 ◽  
Vol 10 (8) ◽  
pp. 780
Author(s):  
Marek Zagroba ◽  
Katarzyna Pawlewicz ◽  
Adam Senetra
Keyword(s):  
Sustainable Development ◽  
Spatial Structure ◽  
Dimensional Space ◽  
Subjective Evaluation ◽  
Central Italy ◽  
Small Towns ◽  
Natural Environments ◽  
Architectural Features ◽  
Italian Regions ◽  
Local Traditions

Cittaslow International promotes harmonious development of small towns based on sustainable relationships between economic growth, protection of local traditions, cultural heritage and the environment, and an improvement in the quality of local life. The aim of this study was to analyze and evaluate the differences and similarities in the spatial structure of Cittaslow towns in the Italian regions of Tuscany and Umbria and the Polish region of Warmia and Mazury. The study examined historical towns which are situated in different parts of Europe and have evolved in different cultural and natural environments. The presented research attempts to determine whether the spatial structure of historical towns established in different European regions promotes the dissemination of the Cittaslow philosophy and the adoption of sustainable development principles. The urban design, architectural features and the composition of urban and architectural factors which are largely responsible for perceptions of multi-dimensional space were evaluated. These goals were achieved with the use of a self-designed research method which supported a subjective evaluation of spatial structure defined by historical urban planning and architectural solutions. The study demonstrated that Medieval urban layouts can be successfully incorporated into the modern urban fabric to promote sustainable development and slow living.

Independence of color and luminance edges in natural scenes

2009 ◽  
Vol 26 (1) ◽  
pp. 35-49 ◽  
Author(s):  
THORSTEN HANSEN ◽  
KARL R. GEGENFURTNER
Keyword(s):  
Visual Processing ◽  
Artificial Vision ◽  
Natural Scenes ◽  
Natural Scene ◽  
Natural Scene Statistics ◽  
Form Vision ◽  
Independent Information ◽  
Edge Contrast ◽  
Source Of Information ◽  
Gain Access

AbstractForm vision is traditionally regarded as processing primarily achromatic information. Previous investigations into the statistics of color and luminance in natural scenes have claimed that luminance and chromatic edges are not independent of each other and that any chromatic edge most likely occurs together with a luminance edge of similar strength. Here we computed the joint statistics of luminance and chromatic edges in over 700 calibrated color images from natural scenes. We found that isoluminant edges exist in natural scenes and were not rarer than pure luminance edges. Most edges combined luminance and chromatic information but to varying degrees such that luminance and chromatic edges were statistically independent of each other. Independence increased along successive stages of visual processing from cones via postreceptoral color-opponent channels to edges. The results show that chromatic edge contrast is an independent source of information that can be linearly combined with other cues for the proper segmentation of objects in natural and artificial vision systems. Color vision may have evolved in response to the natural scene statistics to gain access to this independent information.

Spatio-Chromatic Information Content of Natural Scenes

Perception ◽  
1996 ◽  
Vol 25 (1_suppl) ◽  
pp. 162-162 ◽  
Author(s):  
T Troscianko ◽  
C A Parraga ◽  
G Brelstaff ◽  
D Carr ◽  
K Nelson
Keyword(s):  
Spatial Frequency ◽  
Human Vision ◽  
Natural Scenes ◽  
Data Set ◽  
Frequency Space ◽  
Sensitivity Functions ◽  
Visual Encoding ◽  
Spatial Frequencies ◽  
Hyper Spectral ◽  
Fourier Spectra

A common assumption in the study of the relationship between human vision and the visual environment is that human vision has developed in order to encode the incident information in an optimal manner. Such arguments have been used to support the 1/f dependence of scene content as a function of spatial frequency. In keeping with this assumption, we ask whether there are any important differences between the luminance and (r/g) chrominance Fourier spectra of natural scenes, the simple expectation being that the chrominance spectrum should be relatively richer in low spatial frequencies than the luminance spectrum, to correspond with the different shape of luminance and chrominance contrast sensitivity functions. We analysed a data set of 29 images of natural scenes (predominantly of vegetation at different distances) which were obtained with a hyper-spectral camera (measuring the scene through a set of 31 wavelength bands in the range 400 – 700 nm). The images were transformed to the three Smith — Pokorny cone fundamentals, and further transformed into ‘luminance’ (r+g) and ‘chrominance’ (r-g) images, with various assumptions being made about the relative weighting of the r and g components, and the form of the chrominance response. We then analysed the Fourier spectra of these images using logarithmic intervals in spatial frequency space. This allowed a determination of the total energy within each Fourier band for each of the luminance and chrominance representations. The results strongly indicate that, for the set of scenes studied here, there was no evidence of a predominance of low-spatial-frequency chrominance information. Two classes of explanation are possible: (a) that raw Fourier content may not be the main organising principle determining visual encoding of colour, and/or (b) that our scenes were atypical of what may have driven visual evolution. We present arguments in favour of both of these propositions.

Face Detection in Natural Scenes

Perception ◽  
1996 ◽  
Vol 25 (1_suppl) ◽  
pp. 67-67 ◽  
Author(s):  
H Hill ◽  
R Watt
Keyword(s):  
Face Detection ◽  
Face Processing ◽  
Feature Detection ◽  
Processing System ◽  
Decision Task ◽  
Natural Scenes ◽  
Natural Scene ◽  
Energy Models ◽  
The Face ◽  
And Performance

The first task of any face processing system is detection of the face. We studied how the human visual system achieves face detection using a 2AFC task in which subjects were required to detect a face in the image of a natural scene. Luminance noise was added to the stimuli and performance was measured as a function of orientation and orientation bandwidth of the noise. Sensitivity levels and the effects of orientation bandwidth were similar for horizontally and vertically oriented noise. Performance was reduced for the smallest orientation bandwidth (5.6°) noise but sensitivity did not decrease further with increasing bandwidth until a point between 45° and 90°. The results suggest that important information may be oriented close to the vertical and horizontal. To test whether the results were specific to the task of face detection the same noise was added to the images in a man-made natural decision task. Equivalent levels of noise were found to be more disruptive and the effect of orientation bandwidth was different. The results are discussed in terms of models of face processing making use of oriented filters (eg Watt and Dakin, 1993 Perception22 Supplement, 12) and local energy models of feature detection (Morrone and Burr, 1988 Proceedings of the Royal Society of London B235 221 – 245).

Sign in / Sign up

Export Citation Format

Share Document