Abstract

Relationship between auditory acuity and the use of motor equivalence in production of the sibilant “sh”.
J. Brunner, S. Ghosh, P. Hoole, M. Matthies, M. Tiede & J. Perkell

Motor-equivalent trading relations (i.e. different articulations with essentially the same acoustic output) reflect strategies for compensating for perturbations. Previous studies have shown that some speakers use motor equivalence but others do not. In the present study we test the hypothesis that the use of these strategies is linked to the speakers' auditory acuity: Speakers with high auditory acuity will use motor equivalence to a greater extent and concomitantly produce clearer phoneme contrasts than low acuity speakers.

In a first experiment, seven speakers were recorded via electromagnetic articulography while adapting over the course of two weeks to an articulatory perturbation consisting of an artificial palate. Motor equivalence in production of the sibilant “sh”, i.e., more lip protrusion when the tongue tip is fronted and less if it is retracted, was found for five of the seven speakers but not for the remaining two.

In a second experiment, the speakers' auditory acuity was assessed by testing their ability to hear small differences along a synthetic s-sh continuum. The results indicate that higher-acuity speakers used motor equivalence to a greater extent when adapting to a perturbation than lower-acuity speakers. Additionally, higher-acuity speakers produced greater acoustic contrasts than lower-acuity speakers.

Speech rate had an influence on the use of motor equivalence: slow speakers used motor equivalence to a lesser degree than fast speakers.

Abstract:

Coreferential processing is thought to be modulated by an antecedent’s accessibility in a comprehender’s discourse model. Many theories of coreferential processing suggest that an antecedent’s availability as a referent is the result of being in linguistic focus, as when an entity is mentioned first or most frequently in a discourse, or when an entity occupies a prominent position in a sentence’s syntactic structure. However, it may also be possible to enhance an entity’s referential accessibility by virtue of domain-general principles of memory (such as primacy, frequency, or levels-of-processing effects) without appealing to higher-level linguistic operations such as syntactic processing. Because these memory and language effects are typically confounded, the question of whether referential accessibility may be attributed to non-linguistic rather than linguistic processes has never been directly tested. The current study used both event-related potentials (ERPs) and behavioral measures in a series of experiments in order to investigate the effects of linguistic and non-linguistic focus on coreference. We examined this question against the backdrop of a well-known finding in the coreferential processing literature, the repeated name penalty (Gordon, Grosz, & Gilliom, 1993); this penalty results when an entity that is prominent in a sentence’s syntactic structure is referred to by a repeated name anaphor. By using a generation task (analogous to a levels-of-processing manipulation) we modulated antecedent accessibility without altering the entity’s status in sentence/discourse structure. Experiment 1 showed that, while both generation and syntactic focus improved recognition memory performance, only the syntactic manipulation elicited online discourse processing effects – an N400 effect, the electrophysiological correlate of the repeated name penalty (Swaab, Camblin & Gordon, 2004). When syntactically-enhanced access was removed as a factor in Experiment 2, generation interacted with repetition in the offline recognition memory for antecedent names, while no discourse processing consequences in the ERP waveforms were evident. In Experiment 3, memory enhancement by means of generation and repetition was examined for proper names in word lists. Lexical repetition effects (reduced N400 and increased LPC amplitudes) were found regardless of generation condition; however, repetition and generation elicited different patterns of recognition memory performance. These results suggest that general memory enhancement alone is insufficient to produce discourse processing effects, and that sentence comprehension engages recognition memory processes that can be distinguished from those elicited by word lists.

Abstract:
Developmental dyslexia (DD) is one of the most prominent specific learning disabilities, affecting 5-17% of children. Heritability of DD has been supported by strong evidence from molecular-genetic studies and from studies of twins and families with DD. Substantial evidence suggests that neurological abnormalities underlie DD in children and adults. Multiple functional neuroimaging studies comparing adults and children with DD to typical controls have observed dysfunctions within various brain regions. Differences in the neural correlates of language and auditory processing have also been observed in infants with a family history of reading or language impairments compared to those without. Additionally, it has been suggested that the functional differences observed in children with DD may be related to morphological brain differences. Measures of brain volume have revealed structural abnormalities in children and adults with a diagnosis of DD in regions that broadly overlap with observed functional differences.
A number of key questions remain unanswered. We do not know whether observed functional and structural brain differences associated with DD are present /prior /to reading onset in those who will later receive a diagnosis. We do not know whether these functional and structural differences could be exploited to predict later reading outcome (DD in particular). It also remains unclear how key skills that are impaired in those with DD (e.g., phonological processing and rapid auditory processing) develop in children as they move from the pre-reading to the skilled reading stage. In this talk, I will present preliminary results from our ongoing longitudinal study which investigates possible neural and behavioral pre-markers of DD in pre-reading children (age 4-5) with and without a family history of DD. All children have been examined with standardized tests sampling language and cognitive functions, psychophysical measures, functional magnetic resonance imaging (using a phonological processing task, a rapid auditory processing task and a executive functioning task) and whole brain structural imaging prior to reading onset and after one year of reading instruction. I will further present some recent data looking at the neural correlates of reading fluency in an adult population.
**

Talk title TBA

Susie Levi, New York University
"Talker perception by children with SLI: A possible window into the disorder?"

Christina Reuterskiöld, New York University
"tba"

Abstract: Precise vocal pitch regulation is crucial for prosody in speech and accurate production of notes and melodies in singing. The integration of auditory feedback with the vocal motor system, known as audio-vocal
integration, is essential for vocal pitch regulation; however, its neural substrate is not well understood. We used singing tasks in three functional magnetic resonance imaging (fMRI) experiments designed to: 1) investigate the neural mechanisms underlying vocal pitch regulation, and 2) evaluate the effects of training on vocal performance and neural activity involved in vocal pitch regulation. In Experiment 1, we tested non-musicians and experienced singers with particular singing tasks to
find experience-dependent neural substrates of audio-vocal integration. To target brain activity relevant for audio-vocal integration, we used pitch-shifted auditory feedback and instructed subjects either to adjust
or ignore the shifted feedback. Experiment 2 used a similar fMRI paradigm with large and small pitch shifts to distinguish between voluntary and involuntary vocal pitch regulation and to elucidate the neural mechanisms governing each type of vocal pitch regulation. In
Experiment 3, we trained non-musicians in an auditory discrimination task and administered perceptual discrimination and singing tasks to determine whether training-enhanced auditory discrimination would result
in improved vocal accuracy. We also used fMRI to evaluate any training-induced modulations within brain regions involved in singing and audio-vocal integration. Collectively, the behavioral data showed that correcting for pitch-shifted feedback is an automatic process,
whereas ignoring shifted feedback requires training. The imaging data confirmed the existence of a singing network, comprised of auditory cortex, anterior cingulate cortex, insula, motor and premotor areas, thalamus, and cerebellum; within this network, experienced singers
recruit additional activity in the superior temporal sulcus, rostral cingulate zone, and anterior insula as a network for audio-vocal integration that specifically underlies voluntary vocal pitch regulation. However, auditory training alone is not sufficient to improve vocal accuracy or engage this audio-vocal integration network in
non-musicians.

Abstract:
It is generally assumed that the early stages of speech perception involve the extraction of some kind of generalized auditory patterns or properties from the peripheral input. The auditory representation that results is of considerable interest, since it serves as the input
to higher-level, speech specific processes of phonetic perception. The current research examines this auditory representation using a priming paradigm, in which perception of vowel targets is facilitated when the targets are preceded by acoustically-matched nonspeech stimuli. By manipulating the acoustic parameters of these nonspeech "prime" tones, it is possible to determine the role of these parameters in the auditory stages of vowel processing. Previous results [Wallace and Blumstein, J. Acoust. Soc. Am. 119, 3245 (2006)] suggest a short
window of analysis of no more than 25 ms. In Experiment 1, frequency of nonspeech primes was varied, with results suggesting broad frequency tuning. In Experiment 2, primes matched to both F1 and F2 of the target vowels were found to elicit a greater priming effect than would be predicted by summing the response to separately-presented F1 and F2 primes, suggesting that the auditory representation of vowels encodes combinations of formant frequencies.

Abstract
How do we understand the actions of others as they are described to us through language? Embodied theories of conceptual knowledge suggest that sensory-motor representations of actions similar to those involved in the performance of the action described are recruited during language comprehension. The extent of this recruitment, however, and the brain mechanisms supporting how word meanings are combined remain unknown. In this talk, I will discuss three neuroimaging studies investigating these issues. One study compared the activity elicited by sentences that conveyed different degrees of physical effort (push the piano vs. push the chair vs. see the piano). A graded BOLD response to these sentences, reflecting the graded effort required to perform these actions, was found in the same motoric areas that were activated by physically stressing a ball. A similar response was also found in a part of Broca’s area that was not active in action performance. A subsequent study suggests that the motoric component of such findings is likely confined to brain areas implicated in planning actions, rather than executing them. The fact that Broca’s area is sensitive to the real-world effort entailed by executing the described actions suggests that language comprehension involves a complex interplay between abstract representations of action and linguistically based representations.

Abstract
The world about us changes at an extraordinary pace. If language is to have any influence on what we attend to, that influence has to be exerted at a pace that can keep up. In this talk I shall focus on two aspects of this requirement: The speed with which language can mediate visual attention, and the fact that the cognitive system can very efficiently make up for the fact that, to be expedient (i.e. to keep up with the changing world) we do not in fact refer to all the changes that are associated with, or entailed, by an event. Rather, we infer aspects of those changes. One example of this is through elaborative inference, and another is through the manner in which we track (often unstated) changes in the states of objects as those objects undergo change. The talk will conclude with data suggesting that multiple representations of the same object in different event-dependent states may in fact compete with one another, and that this competitive process may bring both costs and benefits.

Abstract:

This work focuses on speech development in children with genetic duplication at 7q11.23 ("DUP7"), the same region where deletion results in Williams syndrome ("WS"). Findings include: (1) phonological and apraxia-like motor speech deficits are present in the majority of preschool/school-aged children with DUP7; (2) a comparison of matched pairs of 21- and 24-month-old children with DUP7 versus WS demonstrates reduced volubility and consonant inventories in toddlers with DUP7.

Abstract:
Researchers have long noted that children's early word productions are variable in form, yet the nature and extent of this variability has not been systematically examined. Furthermore, much of our understanding of these issues comes from orthographic and/or IPA transcriptions that may be unable to capture systematic covert contrasts being made. As a result, we still know little about children's early phonological and morphological representations, and how these develop over time. However, our research has begun to show that some of children's early variability in morpheme production is due to contextual effects. Other work finds that children provide acoustic cues to "missing" segments. These results suggest that early phonological and morphological representations may be more robust than often assumed. The theoretical and applied implications are discussed.

Abstract:
MIMICRI is a signal processing algorithm that has been shown to blindly infer and invert memoryless nonlinear functions of unobservable bandlimited signals, such as the mapping from the unobservable positions of the speech articulators to observable speech sounds. This blind
inversion can be accomplished because the bandwidth of signals almost always increases when transformed by a nonlinear function. Thus, if we transform the observable signals to have the same pass-band as the unobservable signals, then we are within an affine transform of the
unobservable signals. We review results of using MIMICRI on toy problems and on human speech data. We note that MIMICRI requires that the user specifies two parameters, the dimensionality and pass-band of the unobservable signals, but the user may not know the best values to
use. We show how to use cross-validation techniques with MIMICRI to help estimate parameters that previously needed to be specified. An unexpected consequence of this work is that it helps separate signals that have different frequency characteristics. For example, since lip motions tend to be slower than tongue motions, we may be able to
separate the acoustic effects of lips from the acoustic effects of the tongue, or possibly add noise robustness to speech recognition.

Abstract

The property of duality of patterning Ð the existence of two levels of structure, a meaningful level of words and sentences alongside a meaningless level of sounds Ð has been characterized as a basic design feature of human language (Hockett 1960). Some have also argued that a meaningless level, i.e., phonology, must have existed prior to hierarchical syntactic structure in the evolution of language (Pinker & Jackendoff 2005). Sign languages were admitted to the 'bona fide language club' only after Stokoe (1960) demonstrated that they do exhibit duality. But is it possible for a conventionalized language to exist without a fully developed phonological system—without duality? Using evidence from a sign language that has emerged over the past 75 years in a small, insular community, I will show that phonology cannot be taken for granted. The Al-Sayyid Bedouins have a conventionalized language with certain syntactic and morphological regularities (Sandler et al 2005, Aronoff et al 2008), but the language is apparently still in the process of developing a level of structure with discrete meaningless units that behave systematically. In other words, we don't find evidence for a full-blown phonological system in this language. Can a language go on like this? Data from children and from families with several deaf people help to pinpoint emerging regularities and complexity at the level of meaningless formational elements in ABSL. While phonology in language cannot be taken for granted, then, its existence in all older languages, spoken and signed, suggests that it is inevitable. Rather than assume that phonology is somehow 'given' or hard-wired, this work leads us to ask, Why and how does it arise?

Abstract:

Studying the complex and rapid processing of spoken language in typical and impaired populations requires a sophisticated set of scientific tools. I will describe a combination of experimental, statistical, and computational modeling tools developed for the study of typical spoken language processing and how these tools can be used to study the nature of spoken language impairments in aphasia. The visual world eye-tracking paradigm provides an experimental tool that reveals the precise time course of spoken language processing in a naturalistic and (relatively) simple task. Growth curve analysis provides powerful quantification of fixation time course, including quantification of individual differences. Simulation studies of computational models provide a concrete method for testing theoretical interpretations of the experimental results. When applied to the study of spoken word recognition in aphasia, these techniques suggest an integrated "dynamic balance" theory of Broca's and Wernicke's aphasia.

Abstract:
Language production is sometimes described as a process in which conceptual semantic messages drive the selection of linguistic information. Such a description is probably appropriate for some aspects of the process (e.g. noun selection), yet it is clearly incomplete.

Consider for instance the fact that in numerous languages determiner forms depend not only on semantics, but also on several other kinds of information. In Germanic, Slavic, and Romance languages, the retrieval of the determiners (and other closed- class words, such as pronouns) also depends on a property of the nouns called "grammatical gender." For instance, in Dutch, nouns belong to the so-called "neuter" gender or to the "common" gender. The definite determiners accompanying the nouns belonging to the two sets are respectively het (e.g. het huis, 'the house') and de (e.g. de appel, the apple). In English, consonant-initial nouns and vowel-initial noun can require different indefinite article forms (e.g. a pear vs. an apple).

Such properties of determiners surely impose constraints on how these lexical items can be retrieved. For this very reason, determiners provide a broad testing ground for contrasting psycholinguistic hypothesis of lexical processing and grammatical encoding. In my talk, I will review the cross-linguistic research I have been conducting on determiner retrieval. One important question that will be asked, and only tentatively answered, concerns the extent to which open-class words such as nouns and closed-class words such as determiners are processed and selected by similar mechanisms.

*Early literacy development: Tracking the influences of genes, homes, teachers, schools and countries *

Brian is a long-time Haskins collaborator who has been a leader in
behavior genetic studies of reading and learning.

Abstract:
Comprehension and production deficits associated with
Broca's agrammatism have traditionally received non-converging
generalizations despite having in common the idea that the deficit has a syntactic source. Such a situation seems to suggest that the locus of the problem may not be in the linguistic representation itself but in its dynamic instantiation. Capitalizing on this insight, I present an alternative view whereby the production and comprehension patterns of impairment manifested in the syndrome stem from a unified processing-based source. Crucially, this view is built upon a linguistically-based processing model that takes syntactic representation to be a dynamic manifestation of sentence formation. This analysis and its implications will be discussed in the context not only of theories of cortical distribution of language, given the localizing value of Broca's aphasia agrammatism, but also of theories of language processing and representation.

MEIJIN BRUTTOMESSO:
Effects of Metrical Subdivision on the Continuation, Reproduction, and Perception of Beat Tempo"

JACKIE THOMPSON:
Context Effects in the Tritone Paradox

HAITHAM JENDOUBI:
Effects of Phase-Shifted Subdivisions on Synchronization with a Beat

Animal models of early cortical disruption: possible relevance tso higher-order functional disruptions in humans

March 27, 12:30 PM
Haskins

March 28, 4:00PM
UConn
Bousfield 160, STORRS

Ken McRae, University of Western Ontario

How Knowledge of Real-world Events Influences Language Comprehension

Abstract
A significant proportion of everyday utterances concern real-word events. Thus, people's knowledge of everyday events, including their common participants, is an important component of language comprehension. In many theories of language comprehension, event knowledge is outside of "the lexicon", is accessed slowly, and influences comprehension only after an architecturally-determined time delay. In contrast, I present results from semantic priming and sentence comprehension studies that strongly support a view in which event knowledge is organized efficiently so that it is computed immediately from words (and combinations of words). In addition, our studies show that event knowledge is an important source of information that is used to generate expectancies about upcoming concepts and syntactic structure during on-line sentence comprehension.

Abstract:
Variation set structure --- partial alignment of successive utterances in child-directed speech --- has been shown to correlate with progress in the acquisition of syntax by children. The present study demonstrates that arranging a certain proportion of utterances in a training corpus in variation sets facilitates word segmentation and phrase structure learning in the acquisition of miniature artificial languages by adult subjects.

The positive effects of variation sets in the reported experiments suggest that learners can reuse the same learning procedures --- alignment, and comparison --- at different levels of linguistic structure (here, lexical and phrasal units). We are presently extending
our approach to investigate whether variation sets also facilitate the learning of other core features of language, such as lexical categorization, long-distance dependencies, and recursion.

Beyond having implications for understanding the course of L1 acquisition by children, this work contributes to the development of more efficient algorithms for automatic language acquisition, as well as better methods for L2 instruction.

Also visiting will be Albert Zhang and Dan Hudock from East Carolina University. (PowerPoint presentation)

"Hearing lips and seeing voices: How cortical areas supporting speech production mediate audiovisual speech perception."

Len Katz. Two statistical issues journal editors are concerned about:
(1) the appropriate analysis when your experiment includes items or tokens, and
(2) the death of null hypothesis testing.

Fermin Moscoso Del Prado Martin. MRC Cognition and Brain Sciences Unit, Cambridge, UK. A sketch of an information-theoretical approach to lexical processing.