Discovering the Neuroanatomical Correlates of Music with Machine Learning In Eduardo Reck Miranda (Eds.). Handbook of Artificial Intelligence for Music. Part 1. Springer

Music is ubiquitous in our lives yet unique to humans. The interaction between music and the brain is complex, engaging a variety of neural circuits underlying sensory perception, learning and memory, action, social communication, and creative activities. Over the past decades, a growing body of literature has revealed the neural and computational underpinnings of music processing including not only sensory perception (e.g., pitch, rhythm, and timbre), but also1local/non-local structural processing (e.g., melody and harmony). These findings have also influenced Artificial Intelligence and Machine Learning systems, enabling computers to possess human-like learning and composing abilities. Despite the plenty of evidence, more study is required for complete account of music knowledge and creative mechanisms in human brain. This chapter reviews the neural correlates of unsupervised learning with regard to the computational and neuroanatomical architectures of music processing. Further, we offer a novel theoretical perspective on the brain’s unsupervised learning machinery that considers computational and neurobiological constraints, highlighting the connections between neuroscience and machine learning.

Secondary task type, exposure frequency, and their combined effects on second language vocabulary learning through reading

The type of processing-resource allocation (TOPRA) model predicts that the semantic processing of new second language (L2) words can impede the learning of their forms while structural processing can promote it. Using this framework, the present study examined the effects of processing type (semantic, structural, control), exposure frequency (one exposure, three exposures), and their combination on the learning of new L2 words through reading. Adult Japanese learners of English read a reading text that contained 10 target words, five of them were repeated only one time whereas the other five were repeated three times. They were asked to answer some comprehension questions as their primary task, and the participants in the semantic and structural processing groups were asked to perform the secondary vocabulary processing tasks (pleasantness rating and phonological recording, respectively) to further process target word meanings or forms. The unexpected first language (L1)-to-L2 and L2-to-L1 cued recall were administered. The positive effects of structural processing and exposure frequency were demonstrated in L1-to-L2 cued recall. The results further suggested that effects of vocabulary processing type and exposure frequency vary depending on how vocabulary gain is measured.

Lexically-mediated syntactic priming effects in comprehension: Sources of facilitation

The nature of the facilitation occurring when sentences share a verb and syntactic structure (i.e., lexically-mediated syntactic priming) has not been adequately addressed in comprehension. In four eye-tracking experiments, we investigated the degree to which lexical, syntactic, thematic, and verb form repetition contribute to facilitated target sentence processing. Lexically-mediated syntactic priming was observed when primes and targets shared a verb and abstract syntactic structure, regardless of the ambiguity of the prime. In addition, repeated thematic role assignment resulted in syntactic priming (to a lesser degree), and verb form repetition facilitated lexical rather than structural processing. We conclude that priming in comprehension involves lexically associated abstract syntactic representations, and facilitation of verb and thematic role processes. The results also indicate that syntactic computation errors during prime processing are not necessary for lexically-mediated priming to occur during target processing. This result is inconsistent with an error-driven learning account of lexically-mediated syntactic priming effects.

Learning speech-internal cues to pronoun interpretation from co-speech gesture: a training study

This study explores whether children can learn a structural processing bias relevant to pronoun interpretation from brief training. Over three days, 42 five-year-olds were exposed to narratives exhibiting a first-mentioned tendency. Two characters were introduced, and the first-mentioned was later described engaging in a solo activity. In our primary condition of interest, the Gesture Training condition, the solo-activity sentence contained an ambiguous pronoun, but co-speech gesture clarified the referent. There were two comparison conditions. In the Gender Training condition the characters were different genders, thereby avoiding ambiguity. In the Name Training condition, the first-mentioned name was simply repeated. Ambiguous pronoun interpretation was tested pre- and post-training. Children in the Gesture condition were significantly more likely to interpret ambiguous pronouns as the first-mentioned character after training. Results from the comparison conditions were ambiguous: there was a small but non-significant effect of training, but also no significant differences between conditions.

Incremental comprehension of pitch relationships in written music: Evidence from eye movements

To investigate how proficient pianists comprehend pitch relationships in written music when they first encounter it, we conducted two experiments in which proficient pianists’ eyes were tracked while they read and played single-line melodies. In Experiment 1, participants played at their own speed; in Experiment 2, they played with an external metronome. The melodies were either congruent or anomalous, with the anomaly involving one bar being shifted in pitch to alter the implied harmonic structure (e.g. non-resolution of a dominant). In both experiments, anomaly led to rapid disruption in participants’ eye movements in terms of regressions from the target bar, indicating that pianists process written pitch relationships online. This is particularly striking because in musical sight-reading, eye movement behaviour is constrained by the concurrent performance. Both experiments also showed that anomaly induced pupil dilation. Together, these results indicate that proficient pianists rapidly integrate the music that they read into the prior context and that anomalies in terms of pitch relationships lead to processing difficulty. These findings parallel those of text reading, suggesting that structural processing involves similar constraints across domains.