Shape from specularities: computation and psychophysics

1991 ◽  
Vol 331 (1260) ◽  
pp. 237-252 ◽  
Keyword(s):  
Mathematical Modelling ◽  
Computational Models ◽  
3D Structure ◽  
Natural Scenes ◽  
Local Surface ◽  
Surface Geometry ◽  
Geometric Information ◽  
Visual Processes ◽  
Scene Structure ◽  
The Brain

Images of artificial and natural scenes typically contain many ‘specularities’ generated by mirror-like reflection from glossy surfaces. Until fairly recently computational models of visual processes have tended to regard specularities as obscuring underlying scene structure. Mathematical modelling shows that, on the contrary, they are rich in local geometric information. Recent psychophysical findings support the notion that the brain can apply that information. Our results concern the inference of 3D structure from 2D shaded images of glossy surfaces. Stereoscopically viewed highlights or ‘specularities’ are found to serve as cues for 3D local surface-geometry.

scholarly journals Coherent natural scene structure facilitates the extraction of task-relevant object information in visual cortex

2020 ◽  
Author(s):  
Daniel Kaiser ◽  
Greta Häberle ◽  
Radoslaw M. Cichy
Keyword(s):  
Visual Cortex ◽  
Rural Environment ◽  
Natural Scenes ◽  
Natural Environments ◽  
Response Patterns ◽  
Scene Structure ◽  
Processing Pathways ◽  
Typical Composition ◽  
High Level ◽  
The Brain

AbstractLooking for objects within complex natural environments is a task everybody performs multiple times each day. In this study, we explore how the brain uses the typical composition of real-world environments to efficiently solve this task. We recorded fMRI activity while participants performed two different categorization tasks on natural scenes. In the object task, they indicated whether the scene contained a person or a car, while in the scene task, they indicated whether the scene depicted an urban or a rural environment. Critically, each scene was presented in an “intact” way, preserving its coherent structure, or in a “jumbled” way, with information swapped across quadrants. In both tasks, participants’ categorization was more accurate and faster for intact scenes. These behavioral benefits were accompanied by stronger responses to intact than to jumbled scenes across high-level visual cortex. To track the amount of object information in visual cortex, we correlated multivoxel response patterns during the two categorization tasks with response patterns evoked by people and cars in isolation. We found that object information in object- and body-selective cortex was enhanced when the object was embedded in an intact, rather than a jumbled scene. However, this enhancement was only found in the object task: When participants instead categorized the scenes, object information did not differ between intact and jumbled scenes. Together, these results indicate that coherent scene structure facilitates the extraction of object information in a task-dependent way, suggesting that interactions between the object and scene processing pathways adaptively support behavioral goals.

scholarly journals Power Failure of Mitochondria and Oxidative Stress in Neurodegeneration and Its Computational Models

Antioxidants ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 229
Author(s):  
JunHyuk Woo ◽  
Hyesun Cho ◽  
YunHee Seol ◽  
Soon Ho Kim ◽  
Chanhyeok Park ◽  
...  
Keyword(s):  
Oxidative Stress ◽  
Mitochondrial Dysfunction ◽  
Computational Models ◽  
Neuronal Damage ◽  
Living Organism ◽  
The Body ◽  
Mitochondrial Functions ◽  
A Cell ◽  
The Brain ◽  
And Oxidative Stress

The brain needs more energy than other organs in the body. Mitochondria are the generator of vital power in the living organism. Not only do mitochondria sense signals from the outside of a cell, but they also orchestrate the cascade of subcellular events by supplying adenosine-5′-triphosphate (ATP), the biochemical energy. It is known that impaired mitochondrial function and oxidative stress contribute or lead to neuronal damage and degeneration of the brain. This mini-review focuses on addressing how mitochondrial dysfunction and oxidative stress are associated with the pathogenesis of neurodegenerative disorders including Alzheimer’s disease, amyotrophic lateral sclerosis, Huntington’s disease, and Parkinson’s disease. In addition, we discuss state-of-the-art computational models of mitochondrial functions in relation to oxidative stress and neurodegeneration. Together, a better understanding of brain disease-specific mitochondrial dysfunction and oxidative stress can pave the way to developing antioxidant therapeutic strategies to ameliorate neuronal activity and prevent neurodegeneration.

scholarly journals Inferring brain-computational mechanisms with models of activity measurements

2016 ◽  
Vol 371 (1705) ◽  
pp. 20160278 ◽  
Author(s):  
Nikolaus Kriegeskorte ◽  
Jörn Diedrichsen
Keyword(s):  
Computational Models ◽  
Brain Activity ◽  
Visual Object ◽  
Visual Object Recognition ◽  
Summary Statistics ◽  
Activity Data ◽  
Individual Measurement ◽  
Activity Measurements ◽  
The Brain ◽  
The Way

High-resolution functional imaging is providing increasingly rich measurements of brain activity in animals and humans. A major challenge is to leverage such data to gain insight into the brain's computational mechanisms. The first step is to define candidate brain-computational models (BCMs) that can perform the behavioural task in question. We would then like to infer which of the candidate BCMs best accounts for measured brain-activity data. Here we describe a method that complements each BCM by a measurement model (MM), which simulates the way the brain-activity measurements reflect neuronal activity (e.g. local averaging in functional magnetic resonance imaging (fMRI) voxels or sparse sampling in array recordings). The resulting generative model (BCM-MM) produces simulated measurements. To avoid having to fit the MM to predict each individual measurement channel of the brain-activity data, we compare the measured and predicted data at the level of summary statistics. We describe a novel particular implementation of this approach, called probabilistic representational similarity analysis (pRSA) with MMs, which uses representational dissimilarity matrices (RDMs) as the summary statistics. We validate this method by simulations of fMRI measurements (locally averaging voxels) based on a deep convolutional neural network for visual object recognition. Results indicate that the way the measurements sample the activity patterns strongly affects the apparent representational dissimilarities. However, modelling of the measurement process can account for these effects, and different BCMs remain distinguishable even under substantial noise. The pRSA method enables us to perform Bayesian inference on the set of BCMs and to recognize the data-generating model in each case. This article is part of the themed issue ‘Interpreting BOLD: a dialogue between cognitive and cellular neuroscience’.

Bistability of somatic pattern memories: stochastic outcomes in bioelectric circuits underlying regeneration

2021 ◽  
Vol 376 (1821) ◽  
pp. 20190765 ◽  
Author(s):  
Giovanni Pezzulo ◽  
Joshua LaPalme ◽  
Fallon Durant ◽  
Michael Levin
Keyword(s):  
Large Scale ◽  
Computational Models ◽  
State Of The Art ◽  
Memory Representation ◽  
Theme Issue ◽  
Evolutionary Innovation ◽  
New Interpretation ◽  
The Brain

Nervous systems’ computational abilities are an evolutionary innovation, specializing and speed-optimizing ancient biophysical dynamics. Bioelectric signalling originated in cells' communication with the outside world and with each other, enabling cooperation towards adaptive construction and repair of multicellular bodies. Here, we review the emerging field of developmental bioelectricity, which links the field of basal cognition to state-of-the-art questions in regenerative medicine, synthetic bioengineering and even artificial intelligence. One of the predictions of this view is that regeneration and regulative development can restore correct large-scale anatomies from diverse starting states because, like the brain, they exploit bioelectric encoding of distributed goal states—in this case, pattern memories. We propose a new interpretation of recent stochastic regenerative phenotypes in planaria, by appealing to computational models of memory representation and processing in the brain. Moreover, we discuss novel findings showing that bioelectric changes induced in planaria can be stored in tissue for over a week, thus revealing that somatic bioelectric circuits in vivo can implement a long-term, re-writable memory medium. A consideration of the mechanisms, evolution and functionality of basal cognition makes novel predictions and provides an integrative perspective on the evolution, physiology and biomedicine of information processing in vivo . This article is part of the theme issue ‘Basal cognition: multicellularity, neurons and the cognitive lens’.

scholarly journals Intrinsic spatial knowledge about terrestrial ecology favors the tall for judging distance

2016 ◽  
Vol 2 (8) ◽  
pp. e1501070 ◽  
Author(s):  
Liu Zhou ◽  
Teng Leng Ooi ◽  
Zijiang J. He
Keyword(s):  
Target Location ◽  
Spatial Relationship ◽  
Ground Surface ◽  
Spatial Knowledge ◽  
Superior Performance ◽  
Natural Scenes ◽  
Terrestrial Environment ◽  
Optical Images ◽  
Intermediate Distance ◽  
The Brain

Our sense of vision reliably directs and guides our everyday actions, such as reaching and walking. This ability is especially fascinating because the optical images of natural scenes that project into our eyes are insufficient to adequately form a perceptual space. It has been proposed that the brain makes up for this inadequacy by using its intrinsic spatial knowledge. However, it is unclear what constitutes intrinsic spatial knowledge and how it is acquired. We investigated this question and showed evidence of an ecological basis, which uses the statistical spatial relationship between the observer and the terrestrial environment, namely, the ground surface. We found that in dark and reduced-cue environments where intrinsic knowledge has a greater contribution, perceived target location is more accurate when referenced to the ground than to the ceiling. Furthermore, taller observers more accurately localized the target. Superior performance was also observed in the full-cue environment, even when we compensated for the observers’ heights by having the taller observer sit on a chair and the shorter observers stand on a box. Although fascinating, this finding dovetails with the prediction of the ecological hypothesis for intrinsic spatial knowledge. It suggests that an individual’s accumulated lifetime experiences of being tall and his or her constant interactions with ground-based objects not only determine intrinsic spatial knowledge but also endow him or her with an advantage in spatial ability in the intermediate distance range.

scholarly journals Task-Dependent Warping of Semantic Representations During Search for Visual Action Categories

2021 ◽  
Author(s):  
Mo Shahdloo ◽  
Emin Çelik ◽  
Burcu A Urgen ◽  
Jack L. Gallant ◽  
Tolga Çukur
Keyword(s):  
Visual Search ◽  
Social Interactions ◽  
Brain Activity ◽  
Semantic Representation ◽  
Natural Scenes ◽  
Action Perception ◽  
Semantic Representations ◽  
Object Categories ◽  
Search For Objects ◽  
The Brain

Object and action perception in cluttered dynamic natural scenes relies on efficient allocation of limited brain resources to prioritize the attended targets over distractors. It has been suggested that during visual search for objects, distributed semantic representation of hundreds of object categories is warped to expand the representation of targets. Yet, little is known about whether and where in the brain visual search for action categories modulates semantic representations. To address this fundamental question, we studied human brain activity recorded via functional magnetic resonance imaging while subjects viewed natural movies and searched for either communication or locomotion actions. We find that attention directed to action categories elicits tuning shifts that warp semantic representations broadly across neocortex, and that these shifts interact with intrinsic selectivity of cortical voxels for target actions. These results suggest that attention serves to facilitate task performance during social interactions by dynamically shifting semantic selectivity towards target actions, and that tuning shifts are a general feature of conceptual representations in the brain.

scholarly journals Distributed Code for Semantic Relations Predicts Neural Similarity

2019 ◽  
Author(s):  
Jeffrey N. Chiang ◽  
Yujia Peng ◽  
Hongjing Lu ◽  
Keith J. Holyoak ◽  
Martin M. Monti
Keyword(s):  
Computational Models ◽  
Semantic Network ◽  
Building Blocks ◽  
Semantic Relations ◽  
Human Cognition ◽  
Sequential Presentation ◽  
Specific Content ◽  
Distributed Representations ◽  
Relational Similarity ◽  
The Brain

AbstractThe ability to generate and process semantic relations is central to many aspects of human cognition. Theorists have long debated whether such relations are coded as atomistic links in a semantic network, or as distributed patterns over some core set of abstract relations. The form and content of the conceptual and neural representations of semantic relations remains to be empirically established. The present study combined computational modeling and neuroimaging to investigate the representation and comparison of abstract semantic relations in the brain. By using sequential presentation of verbal analogies, we decoupled the neural activity associated with encoding the representation of the first-order semantic relation between words in a pair from that associated with the second-order comparison of two relations. We tested alternative computational models of relational similarity in order to distinguish between rival accounts of how semantic relations are coded and compared in the brain. Analyses of neural similarity patterns supported the hypothesis that semantic relations are coded, in the parietal cortex, as distributed representations over a pool of abstract relations specified in a theory-based taxonomy. These representations, in turn, provide the immediate inputs to the process of analogical comparison, which draws on a broad frontoparietal network. This study sheds light not only on the form of relation representations but also on their specific content.SignificanceRelations provide basic building blocks for language and thought. For the past half century, cognitive scientists exploring human semantic memory have sought to identify the code for relations. In a neuroimaging paradigm, we tested alternative computational models of relation processing that predict patterns of neural similarity during distinct phases of analogical reasoning. The findings allowed us to draw inferences not only about the form of relation representations, but also about their specific content. The core of these distributed representations is based on a relatively small number of abstract relation types specified in a theory-based taxonomy. This study helps to resolve a longstanding debate concerning the nature of the conceptual and neural code for semantic relations in the mind and brain.

scholarly journals Mathematical Modelling of Nitric Oxide Release Caused by Exocytosis and Determination of a Stellate Neuron Activity Function in Rat Brain

2007 ◽  
Vol 12 (3) ◽  
pp. 399-408 ◽  
Author(s):  
A. Oleinick ◽  
C. Amatore ◽  
O. Klymenko ◽  
I. Svir
Keyword(s):  
Mathematical Modelling ◽  
Neuron Activity ◽  
Nitric Oxide Release ◽  
Numerical Fitting ◽  
No Release ◽  
Initial Hypothesis ◽  
Gaussian Decomposition ◽  
The Brain ◽  
Theoretical Results

In this work we report the results of the mathematical modelling of NO◦ -release by neurons considering a series of Gaussian bursts, together with its transport in the brain by diffusion. Our analysis relies on the NO◦ -release from a neuron monitored before, during and after its patch-clamp stimulation as detected by an ultramicroelectrode introduced into a slice of living rat’s brain. The parameters of the neuron activity function have been obtained by numerical fitting of experimental data with simulated theoretical results. Within our initial hypothesis about the Gaussian decomposition of NO◦ -release that allowed drawing qualitative and quantitative conclusions about the considered neuron activity function. It is noted that since the activity function can be readily modified this signal processing may be adapted to the treatment of other and maybe more physiologically relevant hypotheses.

Peri-personal space as an interface for self-environment interaction

2021 ◽  
pp. 17-46
Author(s):  
Jean-Paul Noel ◽  
Tommaso Bertoni ◽  
Andrea Serino
Keyword(s):  
Motor System ◽  
Computational Models ◽  
Multisensory Processing ◽  
Critical Role ◽  
Personal Space ◽  
Environment Interaction ◽  
Specific System ◽  
Physical Interactions ◽  
Psychophysical Studies ◽  
The Brain

The brain has developed a specific system to encode the space closely surrounding our body, our peri-personal space (PPS). This space is the theatre where all physical interactions with objects in the environment occur, and thus is postulated to play a critical role in both approaching and defensive behaviour. Here, we first describe the classic neurophysiological findings that have led researchers to conceive of PPS as a multisensory-motor interface. This historical perspective is given to clarify what properties are strictly related to PPS encoding, and what characteristics bear out or are related to PPS. Then, in an effort to uncover gaps in knowledge that often go unnoticed, we critically examine the association between PPS and i) multisensory processing, and ii) the motor system—its strongest allies. We do not mean to say that PPS isn’t multisensory-motor, simply to pinpoint current research shortcomings. Subsequently, we detail more recent psychophysical studies, highlighting the extreme plasticity of PPS, and its putative role in bodily self-consciousness and social cognition. Lastly, we briefly discuss computational models of PPS. Throughout the chapter, we particularly attempt to emphasize open areas of investigation. By critically evaluating past findings, many of them our own, we hope to provide a forward-looking perspective on the study of PPS.

scholarly journals Manipulating the structure of natural scenes using wavelets to study the functional architecture of perceptual hierarchies in the brain

NeuroImage ◽  
2020 ◽  
Vol 221 ◽  
pp. 117173
Author(s):  
Alexander M. Puckett ◽  
Mark M. Schira ◽  
Zoey J. Isherwood ◽  
Jonathan D. Victor ◽  
James A. Roberts ◽  
...  
Keyword(s):  
Natural Scenes ◽  
Functional Architecture ◽  
The Brain
Sign in / Sign up

Export Citation Format

Share Document