Adam Buchwald, New York University
"Distinguishing phonetic processing and motor processing: Evidence from instrumental analysis of acquired speech impairment"

(presentation in PowerPoint format)

Maria Grigos, New York University
"Developmental changes in articulatory kinematics in childhood apraxia of speech"

(presentation in PDF format)

Susannah V. Levi, New York University
"Talker perception by children with SLI: A possible window into the disorder?"

(presentation in PDF format)

Christina Reuterskiöld, New York University
"Context, relevance, and the future"

(presentation in PDF format)

Abstract: Precise vocal pitch regulation is crucial for prosody in speech and accurate production of notes and melodies in singing. The integration of auditory feedback with the vocal motor system, known as audio-vocal
integration, is essential for vocal pitch regulation; however, its neural substrate is not well understood. We used singing tasks in three functional magnetic resonance imaging (fMRI) experiments designed to: 1) investigate the neural mechanisms underlying vocal pitch regulation, and 2) evaluate the effects of training on vocal performance and neural activity involved in vocal pitch regulation. In Experiment 1, we tested non-musicians and experienced singers with particular singing tasks to
find experience-dependent neural substrates of audio-vocal integration. To target brain activity relevant for audio-vocal integration, we used pitch-shifted auditory feedback and instructed subjects either to adjust
or ignore the shifted feedback. Experiment 2 used a similar fMRI paradigm with large and small pitch shifts to distinguish between voluntary and involuntary vocal pitch regulation and to elucidate the neural mechanisms governing each type of vocal pitch regulation. In
Experiment 3, we trained non-musicians in an auditory discrimination task and administered perceptual discrimination and singing tasks to determine whether training-enhanced auditory discrimination would result
in improved vocal accuracy. We also used fMRI to evaluate any training-induced modulations within brain regions involved in singing and audio-vocal integration. Collectively, the behavioral data showed that correcting for pitch-shifted feedback is an automatic process,
whereas ignoring shifted feedback requires training. The imaging data confirmed the existence of a singing network, comprised of auditory cortex, anterior cingulate cortex, insula, motor and premotor areas, thalamus, and cerebellum; within this network, experienced singers
recruit additional activity in the superior temporal sulcus, rostral cingulate zone, and anterior insula as a network for audio-vocal integration that specifically underlies voluntary vocal pitch regulation. However, auditory training alone is not sufficient to improve vocal accuracy or engage this audio-vocal integration network in
non-musicians.

Abstract:
It is generally assumed that the early stages of speech perception involve the extraction of some kind of generalized auditory patterns or properties from the peripheral input. The auditory representation that results is of considerable interest, since it serves as the input
to higher-level, speech specific processes of phonetic perception. The current research examines this auditory representation using a priming paradigm, in which perception of vowel targets is facilitated when the targets are preceded by acoustically-matched nonspeech stimuli. By manipulating the acoustic parameters of these nonspeech "prime" tones, it is possible to determine the role of these parameters in the auditory stages of vowel processing. Previous results [Wallace and Blumstein, J. Acoust. Soc. Am. 119, 3245 (2006)] suggest a short
window of analysis of no more than 25 ms. In Experiment 1, frequency of nonspeech primes was varied, with results suggesting broad frequency tuning. In Experiment 2, primes matched to both F1 and F2 of the target vowels were found to elicit a greater priming effect than would be predicted by summing the response to separately-presented F1 and F2 primes, suggesting that the auditory representation of vowels encodes combinations of formant frequencies.

Abstract
How do we understand the actions of others as they are described to us through language? Embodied theories of conceptual knowledge suggest that sensory-motor representations of actions similar to those involved in the performance of the action described are recruited during language comprehension. The extent of this recruitment, however, and the brain mechanisms supporting how word meanings are combined remain unknown. In this talk, I will discuss three neuroimaging studies investigating these issues. One study compared the activity elicited by sentences that conveyed different degrees of physical effort (push the piano vs. push the chair vs. see the piano). A graded BOLD response to these sentences, reflecting the graded effort required to perform these actions, was found in the same motoric areas that were activated by physically stressing a ball. A similar response was also found in a part of Broca’s area that was not active in action performance. A subsequent study suggests that the motoric component of such findings is likely confined to brain areas implicated in planning actions, rather than executing them. The fact that Broca’s area is sensitive to the real-world effort entailed by executing the described actions suggests that language comprehension involves a complex interplay between abstract representations of action and linguistically based representations.

Abstract
The world about us changes at an extraordinary pace. If language is to have any influence on what we attend to, that influence has to be exerted at a pace that can keep up. In this talk I shall focus on two aspects of this requirement: The speed with which language can mediate visual attention, and the fact that the cognitive system can very efficiently make up for the fact that, to be expedient (i.e. to keep up with the changing world) we do not in fact refer to all the changes that are associated with, or entailed, by an event. Rather, we infer aspects of those changes. One example of this is through elaborative inference, and another is through the manner in which we track (often unstated) changes in the states of objects as those objects undergo change. The talk will conclude with data suggesting that multiple representations of the same object in different event-dependent states may in fact compete with one another, and that this competitive process may bring both costs and benefits.

Abstract:

This work focuses on speech development in children with genetic duplication at 7q11.23 ("DUP7"), the same region where deletion results in Williams syndrome ("WS"). Findings include: (1) phonological and apraxia-like motor speech deficits are present in the majority of preschool/school-aged children with DUP7; (2) a comparison of matched pairs of 21- and 24-month-old children with DUP7 versus WS demonstrates reduced volubility and consonant inventories in toddlers with DUP7.

Abstract:
Researchers have long noted that children's early word productions are variable in form, yet the nature and extent of this variability has not been systematically examined. Furthermore, much of our understanding of these issues comes from orthographic and/or IPA transcriptions that may be unable to capture systematic covert contrasts being made. As a result, we still know little about children's early phonological and morphological representations, and how these develop over time. However, our research has begun to show that some of children's early variability in morpheme production is due to contextual effects. Other work finds that children provide acoustic cues to "missing" segments. These results suggest that early phonological and morphological representations may be more robust than often assumed. The theoretical and applied implications are discussed.

Abstract:
MIMICRI is a signal processing algorithm that has been shown to blindly infer and invert memoryless nonlinear functions of unobservable bandlimited signals, such as the mapping from the unobservable positions of the speech articulators to observable speech sounds. This blind
inversion can be accomplished because the bandwidth of signals almost always increases when transformed by a nonlinear function. Thus, if we transform the observable signals to have the same pass-band as the unobservable signals, then we are within an affine transform of the
unobservable signals. We review results of using MIMICRI on toy problems and on human speech data. We note that MIMICRI requires that the user specifies two parameters, the dimensionality and pass-band of the unobservable signals, but the user may not know the best values to
use. We show how to use cross-validation techniques with MIMICRI to help estimate parameters that previously needed to be specified. An unexpected consequence of this work is that it helps separate signals that have different frequency characteristics. For example, since lip motions tend to be slower than tongue motions, we may be able to
separate the acoustic effects of lips from the acoustic effects of the tongue, or possibly add noise robustness to speech recognition.

Abstract

The property of duality of patterning Ð the existence of two levels of structure, a meaningful level of words and sentences alongside a meaningless level of sounds Ð has been characterized as a basic design feature of human language (Hockett 1960). Some have also argued that a meaningless level, i.e., phonology, must have existed prior to hierarchical syntactic structure in the evolution of language (Pinker & Jackendoff 2005). Sign languages were admitted to the 'bona fide language club' only after Stokoe (1960) demonstrated that they do exhibit duality. But is it possible for a conventionalized language to exist without a fully developed phonological system—without duality? Using evidence from a sign language that has emerged over the past 75 years in a small, insular community, I will show that phonology cannot be taken for granted. The Al-Sayyid Bedouins have a conventionalized language with certain syntactic and morphological regularities (Sandler et al 2005, Aronoff et al 2008), but the language is apparently still in the process of developing a level of structure with discrete meaningless units that behave systematically. In other words, we don't find evidence for a full-blown phonological system in this language. Can a language go on like this? Data from children and from families with several deaf people help to pinpoint emerging regularities and complexity at the level of meaningless formational elements in ABSL. While phonology in language cannot be taken for granted, then, its existence in all older languages, spoken and signed, suggests that it is inevitable. Rather than assume that phonology is somehow 'given' or hard-wired, this work leads us to ask, Why and how does it arise?

Abstract:

Studying the complex and rapid processing of spoken language in typical and impaired populations requires a sophisticated set of scientific tools. I will describe a combination of experimental, statistical, and computational modeling tools developed for the study of typical spoken language processing and how these tools can be used to study the nature of spoken language impairments in aphasia. The visual world eye-tracking paradigm provides an experimental tool that reveals the precise time course of spoken language processing in a naturalistic and (relatively) simple task. Growth curve analysis provides powerful quantification of fixation time course, including quantification of individual differences. Simulation studies of computational models provide a concrete method for testing theoretical interpretations of the experimental results. When applied to the study of spoken word recognition in aphasia, these techniques suggest an integrated "dynamic balance" theory of Broca's and Wernicke's aphasia.

Abstract:
Language production is sometimes described as a process in which conceptual semantic messages drive the selection of linguistic information. Such a description is probably appropriate for some aspects of the process (e.g. noun selection), yet it is clearly incomplete.

Consider for instance the fact that in numerous languages determiner forms depend not only on semantics, but also on several other kinds of information. In Germanic, Slavic, and Romance languages, the retrieval of the determiners (and other closed- class words, such as pronouns) also depends on a property of the nouns called "grammatical gender." For instance, in Dutch, nouns belong to the so-called "neuter" gender or to the "common" gender. The definite determiners accompanying the nouns belonging to the two sets are respectively het (e.g. het huis, 'the house') and de (e.g. de appel, the apple). In English, consonant-initial nouns and vowel-initial noun can require different indefinite article forms (e.g. a pear vs. an apple).

Such properties of determiners surely impose constraints on how these lexical items can be retrieved. For this very reason, determiners provide a broad testing ground for contrasting psycholinguistic hypothesis of lexical processing and grammatical encoding. In my talk, I will review the cross-linguistic research I have been conducting on determiner retrieval. One important question that will be asked, and only tentatively answered, concerns the extent to which open-class words such as nouns and closed-class words such as determiners are processed and selected by similar mechanisms.

*Early literacy development: Tracking the influences of genes, homes, teachers, schools and countries *

Brian is a long-time Haskins collaborator who has been a leader in
behavior genetic studies of reading and learning.

Abstract:
Comprehension and production deficits associated with
Broca's agrammatism have traditionally received non-converging
generalizations despite having in common the idea that the deficit has a syntactic source. Such a situation seems to suggest that the locus of the problem may not be in the linguistic representation itself but in its dynamic instantiation. Capitalizing on this insight, I present an alternative view whereby the production and comprehension patterns of impairment manifested in the syndrome stem from a unified processing-based source. Crucially, this view is built upon a linguistically-based processing model that takes syntactic representation to be a dynamic manifestation of sentence formation. This analysis and its implications will be discussed in the context not only of theories of cortical distribution of language, given the localizing value of Broca's aphasia agrammatism, but also of theories of language processing and representation.

MEIJIN BRUTTOMESSO:
Effects of Metrical Subdivision on the Continuation, Reproduction, and Perception of Beat Tempo"

JACKIE THOMPSON:
Context Effects in the Tritone Paradox

HAITHAM JENDOUBI:
Effects of Phase-Shifted Subdivisions on Synchronization with a Beat

Animal models of early cortical disruption: possible relevance tso higher-order functional disruptions in humans

March 27, 12:30 PM
Haskins

March 28, 4:00PM
UConn
Bousfield 160, STORRS

Ken McRae, University of Western Ontario

How Knowledge of Real-world Events Influences Language Comprehension

Abstract
A significant proportion of everyday utterances concern real-word events. Thus, people's knowledge of everyday events, including their common participants, is an important component of language comprehension. In many theories of language comprehension, event knowledge is outside of "the lexicon", is accessed slowly, and influences comprehension only after an architecturally-determined time delay. In contrast, I present results from semantic priming and sentence comprehension studies that strongly support a view in which event knowledge is organized efficiently so that it is computed immediately from words (and combinations of words). In addition, our studies show that event knowledge is an important source of information that is used to generate expectancies about upcoming concepts and syntactic structure during on-line sentence comprehension.

Abstract:
Variation set structure --- partial alignment of successive utterances in child-directed speech --- has been shown to correlate with progress in the acquisition of syntax by children. The present study demonstrates that arranging a certain proportion of utterances in a training corpus in variation sets facilitates word segmentation and phrase structure learning in the acquisition of miniature artificial languages by adult subjects.

The positive effects of variation sets in the reported experiments suggest that learners can reuse the same learning procedures --- alignment, and comparison --- at different levels of linguistic structure (here, lexical and phrasal units). We are presently extending
our approach to investigate whether variation sets also facilitate the learning of other core features of language, such as lexical categorization, long-distance dependencies, and recursion.

Beyond having implications for understanding the course of L1 acquisition by children, this work contributes to the development of more efficient algorithms for automatic language acquisition, as well as better methods for L2 instruction.

Also visiting will be Albert Zhang and Dan Hudock from East Carolina University. (PowerPoint presentation)

"Hearing lips and seeing voices: How cortical areas supporting speech production mediate audiovisual speech perception."

Len Katz. Two statistical issues journal editors are concerned about:
(1) the appropriate analysis when your experiment includes items or tokens, and
(2) the death of null hypothesis testing.

Fermin Moscoso Del Prado Martin. MRC Cognition and Brain Sciences Unit, Cambridge, UK. A sketch of an information-theoretical approach to lexical processing.