Unsupervised Character Recognition with Graphene Memristive Synapses

Memristive devices being applied in neuromorphic computing are envisioned to significantly improve the power consumption and speed of future computing platforms. The materials used to fabricate such devices will play a significant role in their viability. Graphene is a promising material, with superb electrical properties and the ability to be produced sustainably. In this paper, we demonstrate that a fabricated graphene-pentacene memristive device can be used as synapses within Spiking Neural Networks (SNNs) to realise Spike Timing Dependent Plasticity (STDP) for unsupervised learning in an efficient manner. Specifically, we verify operation of two SNN architectures tasked for single digit (0-9) classification: (i) a simple single-layer network, where inputs are presented in 5x5 pixel resolution, and (ii) a larger network capable of classifying the Modified National Institute of Standards and Technology (MNIST) dataset, where inputs are presented in 28x28 pixel resolution. Final results demonstrate that for 100 output neurons, after one training epoch, a test set accuracy of up to 86% can be achieved, which is higher than prior art using the same number of output neurons. We attribute this performance improvement to homeostatic plasticity dynamics that we used to alter the threshold of neurons during training. Our work presents the first investigation of the use of green-fabricated graphene memristive devices to perform a complex pattern classification task. This can pave the way for future research in using graphene devices with memristive capabilities in neuromorphic computing architectures. In favour of reproducible research, we make our code and data publicly available https://anonymous.4open.science/r/c69ab2e2-b672-4ebd-b266-987ee1fd65e7.

Nicotine Exposure during Adolescence Leads to Changes of Synaptic Plasticity and Intrinsic Excitability of Mice Insular Pyramidal Cells at Later Life

To find satisfactory treatment for nicotine addiction, synaptic and cellular mechanisms should be investigated comprehensively. Synaptic transmission, plasticity and intrinsic excitability in various brain regions are known to be altered by acute nicotine exposure. However, it has not been addressed whether and how nicotine exposure during adolescence alters these synaptic events and intrinsic excitability in the insular cortex in adulthood. To address this question, we performed whole-cell patch-clamp recordings to examine the effects of adolescent nicotine exposure on synaptic transmission, plasticity and intrinsic excitability in layer V pyramidal neurons (PNs) of the mice insular cortex five weeks after the treatment. We found that excitatory synaptic transmission and potentiation were enhanced in these neurons. Following adolescent nicotine exposure, insular layer V PNs displayed enhanced intrinsic excitability, which was reflected in changes in relationship between current strength and spike number, inter-spike interval, spike current threshold and refractory period. In addition, spike-timing precision evaluated by standard deviation of spike timing was decreased following nicotine exposure. Our data indicate that adolescent nicotine exposure enhances synaptic transmission, plasticity and intrinsic excitability in layer V PNs of the mice insular cortex at later life, which might contribute to severe nicotine dependence in adulthood.

A heuristic approach to the hyperparameters in training spiking neural networks using spike-timing-dependent plasticity

The third type of neural network called spiking is developed due to a more accurate representation of neuronal activity in living organisms. Spiking neural networks have many different parameters that can be difficult to adjust manually to the current classification problem. The analysis and selection of coefficients’ values in the network can be analyzed as an optimization problem. A practical method for automatic selection of them can decrease the time needed to develop such a model. In this paper, we propose the use of a heuristic approach to analyze and select coefficients with the idea of collaborative working. The proposed idea is based on parallel analyzing of different coefficients and choosing the best of them or average ones. This type of optimization problem allows the selection of all variables, which can significantly affect the convergence of the accuracy. Our proposal was tested using network simulators and popular databases to indicate the possibilities of the described approach. Five different heuristic algorithms were tested and the best results were reached by Cuckoo Search Algorithm, Grasshopper Optimization Algorithm, and Polar Bears Algorithm.

The Spatial Reach of Neuronal Coherence and Spike-field Coupling across the Human Neocortex

Neuronal coherence is thought to be a fundamental mechanism of communication in the brain, where synchronized field potentials coordinate synaptic and spiking events to support plasticity and learning. Although the spread of field potentials has garnered great interest, little is known about the spatial reach of phase synchronization, or neuronal coherence. Functional connectivity between different brain regions is known to occur across long distances, but the locality of coherence within a brain region is understudied. Here we used simultaneous recordings from electrocorticography (ECoG) grids and high-density microelectrode arrays to estimate the spatial reach of neuronal coherence and spike-field coherence (SFC) across frontal, temporal, and occipital cortices during cognitive tasks in humans. We observed the strongest coherence within a 2-3 cm distance from the microelectrode arrays, potentially defining an effective range for local communication. This range was relatively consistent across brain regions, spectral frequencies, and cognitive tasks. The magnitude of coherence showed power law decay with increasing distance from the microelectrode arrays, where the highest coherence occurred between ECoG contacts, followed by coherence between ECoG and deep cortical LFP, and then SFC (i.e., ECoG > LFP > SFC). The spectral frequency of coherence also affected its magnitude. Alpha coherence (8-14 Hz) was generally higher than other frequencies for signals nearest the microelectrode arrays, whereas delta coherence (1-3 Hz) was higher for signals that were farther away. Action potentials in all brain regions were most coherent with the phase of alpha oscillations, which suggests that alpha waves could play a larger, more spatially local role in spike timing than other frequencies. These findings provide a deeper understanding of the spatial and spectral dynamics of neuronal coherence, further advancing knowledge about how activity propagates across the human brain.

STDP implementation using multi-state spin-orbit torque synapse

The abundance of data to be processed calls for new computing paradigms, which could accommodate, and directly map artificial neural network (ANN) architectures at the hardware level. Neuromorphic computing has emerged as a potential solution, proposing the implementation of artificial neurons and synapses on physical substrates. Conventionally, neuromorphic platforms are deployed in complementary metal-oxide–semiconductor (CMOS) technology. However, such implementations still cannot compete with the highly energy-efficient performance of the brain. This calls for novel ultra-low-power nano-scale devices with the possibility of upscaling for the implementation of complex networks. In this paper, a multi-state spin-orbit torque (SOT) synapse based on the three-terminal perpendicular-anisotropy magnetic tunnel junction (P-MTJ) is proposed. In this implementation, P-MTJs use common heavy metals (HMs) but with different cross-section areas, thereby creating multiple states that can be harnessed to implement synapses. The proposed multi-state SOT synapse can solve the state-limited issue of spin-based synapses. Moreover, it is shown that the proposed multi-state SOT synapse can be programmed to reproduce the spike-timing-dependent plasticity (STDP) learning algorithm.

Directional Tuning of Phase Precession Properties in the Hippocampus

Running direction in the hippocampus is encoded by rate modulations of place field activity but also by spike timing correlations known as theta sequences. Whether directional rate codes and the directionality of place field correlations are related, however, has so far not been explored and therefore the nature of how directional information is encoded in the cornu ammonis remains unresolved. Here, using a previously published dataset that contains the spike activity of rat hippocampal place cells in the CA1, CA2 and CA3 subregions during free foraging of male Long-Evans rats in a 2D environment, we found that rate and spike timing codes are related. Opposite to a place field's preferred firing rate direction spikes are more likely to undergo theta phase precession and, hence, more strongly impact paired correlations. Furthermore, we identified a subset of field pairs whose theta correlations are intrinsic in that they maintain the same firing order when the running direction is reversed. Both effects are associated with differences in theta phase distributions, and are more prominent in CA3 than CA1. We thus hypothesize that intrinsic spiking is most prominent when the directionally modulated sensory-motor drive of hippocampal firing rates is minimal, suggesting that extrinsic and intrinsic sequences contribute to phase precession as two distinct mechanisms.

Temporally Targeted Interactions With Pathologic Oscillations as Therapeutical Targets in Epilepsy and Beyond

Self-organized neuronal oscillations rely on precisely orchestrated ensemble activity in reverberating neuronal networks. Chronic, non-malignant disorders of the brain are often coupled to pathological neuronal activity patterns. In addition to the characteristic behavioral symptoms, these disturbances are giving rise to both transient and persistent changes of various brain rhythms. Increasing evidence support the causal role of these “oscillopathies” in the phenotypic emergence of the disease symptoms, identifying neuronal network oscillations as potential therapeutic targets. While the kinetics of pharmacological therapy is not suitable to compensate the disease related fine-scale disturbances of network oscillations, external biophysical modalities (e.g., electrical stimulation) can alter spike timing in a temporally precise manner. These perturbations can warp rhythmic oscillatory patterns via resonance or entrainment. Properly timed phasic stimuli can even switch between the stable states of networks acting as multistable oscillators, substantially changing the emergent oscillatory patterns. Novel transcranial electric stimulation (TES) approaches offer more reliable neuronal control by allowing higher intensities with tolerable side-effect profiles. This precise temporal steerability combined with the non- or minimally invasive nature of these novel TES interventions make them promising therapeutic candidates for functional disorders of the brain. Here we review the key experimental findings and theoretical background concerning various pathological aspects of neuronal network activity leading to the generation of epileptic seizures. The conceptual and practical state of the art of temporally targeted brain stimulation is discussed focusing on the prevention and early termination of epileptic seizures.

Distributed Phase Oscillatory Excitation Efficiently Produces Attractors Using Spike-Timing-Dependent Plasticity

The brain is thought to represent information in the form of activity in distributed groups of neurons known as attractors. We show here that in a randomly connected network of simulated spiking neurons, periodic stimulation of neurons with distributed phase offsets, along with standard spike-timing-dependent plasticity (STDP), efficiently creates distributed attractors. These attractors may have a consistent ordered firing pattern or become irregular, depending on the conditions. We also show that when two such attractors are stimulated in sequence, the same STDP mechanism can create a directed association between them, forming the basis of an associative network. We find that for an STDP time constant of 20 ms, the dependence of the efficiency of attractor creation on the driving frequency has a broad peak centered around 8 Hz. Upon restimulation, the attractors self-oscillate, but with an oscillation frequency that is higher than the driving frequency, ranging from 10 to 100 Hz.