Effects of First Language Background and Learning Experience in Perceiving Mandarin Lexical Tones: Learners and Nonlearners From English- and Japanese-Speaking Backgrounds

Purpose: This research compared individuals from two first language (L1) backgrounds (English and Japanese) to determine how they may differ in their perception of Mandarin tones (Tones 1 vs. 2 [T1–T2], Tones 1 vs. 3 [T1–T3], Tones 1 vs. 4 [T1–T4], Tones 2 vs. 3 [T2–T3], Tones 2 vs. 4 [T2–T4], Tones 3 vs. 4 [T3–T4]) on account of their L1. Method: The participants included two groups of learners of Mandarin (23 English speakers, 18 Japanese speakers), two groups of nonlearners of Mandarin (24 English speakers, 21 Japanese speakers), and a control group of 10 Mandarin speakers. A four-alternative forced-choice discrimination task that included 360 trials was presented in three blocks of 120 trials. Results: The native Mandarin group was more accurate in their tonal discrimination of all six tone pairs than all the nonnative groups. While Japanese nonlearners generally outperformed English nonlearners in their overall perception of Mandarin lexical tones, L1-based differences were less extensive for the two groups of learners. Both learner groups were least accurate on T2–T3 and most accurate on T3–T4. Conclusion: The results suggest that with classroom experience, English speakers can overcome their initial disadvantage and learn lexical tones in a new language as successfully as speakers of Japanese with classroom experience.

Categorical Perception of Mandarin Pitch Directions by Cantonese-Speaking Musicians and Non-musicians

Purpose: This study is to investigate whether Cantonese-speaking musicians may show stronger CP than Cantonese-speaking non-musicians in perceiving pitch directions generated based on Mandarin tones. It also aims to examine whether musicians may be more effective in processing stimuli and more sensitive to subtle differences caused by vowel quality.Methods: Cantonese-speaking musicians and non-musicians performed a categorical identification and a discrimination task on rising and falling continua of fundamental frequency generated based on Mandarin level, rising and falling tones on two vowels with nine duration values.Results: Cantonese-speaking musicians exhibited a stronger categorical perception (CP) of pitch contours than non-musicians based on the identification and discrimination tasks. Compared to non-musicians, musicians were also more sensitive to the change of stimulus duration and to the intrinsic F0 in pitch perception in pitch processing.Conclusion: The CP was strengthened due to musical experience and musicians benefited more from increased stimulus duration and were more efficient in pitch processing. Musicians might be able to better use the extra time to form an auditory representation with more acoustic details. Even with more efficiency in pitch processing, musicians' ability to detect subtle pitch changes caused by intrinsic F0 was not undermined, which is likely due to their superior ability to process temporal information. These results thus suggest musicians may have a great advantage in learning tones of a second language.

Learning nonnative speech sounds changes local encoding in the adult human cortex

Adults can learn to identify nonnative speech sounds with training, albeit with substantial variability in learning behavior. Increases in behavioral accuracy are associated with increased separability for sound representations in cortical speech areas. However, it remains unclear whether individual auditory neural populations all show the same types of changes with learning, or whether there are heterogeneous encoding patterns. Here, we used high-resolution direct neural recordings to examine local population response patterns, while native English listeners learned to recognize unfamiliar vocal pitch patterns in Mandarin Chinese tones. We found a distributed set of neural populations in bilateral superior temporal gyrus and ventrolateral frontal cortex, where the encoding of Mandarin tones changed throughout training as a function of trial-by-trial accuracy (“learning effect”), including both increases and decreases in the separability of tones. These populations were distinct from populations that showed changes as a function of exposure to the stimuli regardless of trial-by-trial accuracy. These learning effects were driven in part by more variable neural responses to repeated presentations of acoustically identical stimuli. Finally, learning effects could be predicted from speech-evoked activity even before training, suggesting that intrinsic properties of these populations make them amenable to behavior-related changes. Together, these results demonstrate that nonnative speech sound learning involves a wide array of changes in neural representations across a distributed set of brain regions.

The Effects of a Digital Articulatory Game on the Ability to Perceive Speech-Sound Contrasts in Another Language

Digital and mobile devices enable easy access to applications for the learning of foreign languages. However, experimental studies on the effectiveness of these applications are scarce. Moreover, it is not understood whether the effects of speech and language training generalize to features that are not trained. To this end, we conducted a four-week intervention that focused on articulatory training and learning of English words in 6–7-year-old Finnish-speaking children who used a digital language-learning game app Pop2talk. An essential part of the app is automatic speech recognition that enables assessing children’s utterances and giving instant feedback to the players. The generalization of the effects of such training in English were explored by using discrimination tasks before and after training (or the same period of time in a control group). The stimuli of the discrimination tasks represented phonetic contrasts from two non-trained languages, including Russian sibilant consonants and Mandarin tones. We found some improvement with the Russian sibilant contrast in the gamers but it was not statistically significant. No improvement was observed for the tone contrast for the gaming group. A control group with no training showed no improvement in either contrast. The pattern of results suggests that the game may have improved the perception of non-trained speech sounds in some but not all individuals, yet the effects of motivation and attention span on their performance could not be excluded with the current methods. Children’s perceptual skills were linked to their word learning in the control group but not in the gaming group where recurrent exposure enabled learning also for children with poorer perceptual skills. Together, the results demonstrate beneficial effects of learning via a digital application, yet raise a need for further research of individual differences in learning.

Aging Effects on Categorical Perception of Mandarin Lexical Tones in Noise

Purpose The purpose of this study was to examine the aging effects on the categorical perception (CP) of Mandarin lexical Tones 1–4 and Tones 1–2 in noise. It also investigated whether listeners' categorical tone perception in noise correlated with their general tone identification of 20 natural vowel-plus-tone signals in noise. Method Twelve younger and 12 older listeners with normal hearing were recruited in both tone identification and discrimination tasks in a CP paradigm where fundamental frequency contours of target stimuli varied systematically from the flat tone (Tone 1) to the rising/falling tones (Tones 2/4). Both tasks were conducted in quiet and noise with signal-to-noise ratios set at −5 and −10 dB, respectively, and general tone identification of natural speech signals was also tested in noise conditions. Results Compared with younger listeners, older listeners had shallower identification slopes and smaller discrimination peakedness in Tones 1–2/4 perception in all listening conditions, except for Tones 1–4 perception in quiet where no group differences were found. Meanwhile, noise affected Tones 1–2/4 perception: The signal-to-noise ratio condition at −10 dB brought shallower slope in Tones 1–2/4 identification and less peakedness in Tones 1–4 discrimination for both listener groups. Older listeners' CP in noise, the identification slopes in particular, positively correlated with their general tone identification in noise, but such correlations were partially missing for younger listeners. Conclusions Both aging and the presence of speech-shaped noise significantly reduced the CP of Mandarin Tones 1–2/4. Listeners' Mandarin tone recognition may be related to their CP of Mandarin tones.