Seeing speech: visual information from lip movements modifies activity in the human auditory cortex
Neuroscience LettersPublished 1 June 1991
Mikko Sams, Reijo Aulanko, Matti Hämäläinen, Riitta Hari, O. V. Lounasmaa, Sing-Teh Lu
Citations368
SJR quartileQ2
SJR score0.77
SNIP0.67
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The results show that visual information from articulatory movements has an entry into the auditory cortex, which could be explained by activity in the supratemporal auditory cortex.
Abstract
Neuromagnetic responses were recorded over the left hemisphere to find out in which cortical area the heard and seen speech are integrated. Auditory stimuli were Finnish/pa/syllables presented together with a videotaped face articulating either the concordant syllable/pa/(84% of stimuli, V = A) or the discordant syllable/ka/(16%, V not equal to A). In some subjects the probabilities were reversed. The subjects heard V not equal to A stimuli as/ta/ or ka. The magnetic responses to infrequent perceptions elicited a specific waveform which could be explained by activity in the supratemporal auditory cortex. The results show that visual information from articulatory movements has an entry into the auditory cortex.
Keywords
PsychologyNeuroscience
NatureHearing lips and seeing voices
6,130 Citations1976Harry McGurk, John MacDonald
The study reported here demonstrates a previously unrecognised influence of vision upon speech perception, on being shown a film of a young woman's talking head in which repeated utterances of the syllable [ba] had been dubbed on to lip movements for [ga].
BrainDISCONNEXION SYNDROMES IN ANIMALS AND MAN
3,402 Citations1965Norman Geschwind
This paper would never have been written without Professor Zangwill’s urging, and I am grateful to him for having brought me to a more careful review of the older literature and a more precise statement of my own ideas.
Journal of NeurophysiologyVisual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration
1,193 Citations1986M. Alex Meredith, Barry E. Stein
Data show that multisensory convergence provides the descending efferent cells of the SC with a dynamic response character, which can vary in response to the particular complex of stimuli present in the environment at any given moment.
Cerebral cortexArchitecture and Connections of Cortical Association Areas
589 Citations1985Deepak Ν. Pandya, Edward H. Yeterian
The execution of behavior depends on the integration of activity at various levels of the central nervous system, and different regions of the nervous system have been shown to participate in specific functions.
Perception & PsychophysicsVisual influences on speech perception processes
455 Citations1978John MacDonald, Harry McGurk
It is confirmed and extended an earlier observation that visual information for the speaker’s lip movements profoundly modifies the auditorv perception of natural speech by normally hearing subjects.
Experimental Brain ResearchAuditory evoked transient and sustained magnetic fields of the human brain localization of neural generators
426 Citations1980Riitta Hari, K. Aittoniemi +3 more
The distributions of the magnetic fields indicate that the auditory evoked transient response at a latency of 100 ms as well as the auditory sustained response are generated at and around the primary auditory cortex.
Journal of NeurophysiologyPolysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey
300 Citations1988Kazuo Hikosaka, Eiichi Iwai +2 more
The sensory properties of cells in the anterior bank of the caudal part of the superior temporal sulcus (caudal STS) in anesthetized, paralyzed monkeys to visual, auditory, and somesthetic stimuli agreed with previous studies.
Experimental NeurologyAuditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey
293 Citations1977L.A. Benevento, James Fallon +2 more
The results indicate that neurons in both regions show auditory-visual interactions and that at least some of these interactions are due to convergence at the cortical cell.
Journal of Speech and Hearing ResearchAuditory and Visual Contributions to the Perception of Consonants
189 Citations1974Carl A. Binnie, Allen A. Montgomery +1 more
Perceptual confusions of 16 consonant-vowel syllables were studied with normal-hearing adults under conditions of auditory-visual presentation at various signal-to-noise (S/N) ratios.
ScienceRecording and Interpretation of Cerebral Magnetic Fields
184 Citations1989Riitta Hari, O. V. Lounasmaa
This review presents results obtained mainly in the laboratory by means of an intermediate method, MEG, which reflects cortical activity of neuronal populations at the level of cytoarchitectonic areas, which can be used to study brain functions that are characteristically human.
PerceptionThe Role of Vision in the Perception of Speech
152 Citations1977Barbara Dodd
The ability of hearing adolescents to use speech-read information in order to report lists of CVC words presented in white noise was investigated and it was indicated that vision provided a complementary source of information for the perception of speech.
PsychophysiologyCortical Activity Elicited by Changes in Auditory Stimuli: Different Sources for the Magnetic N1OOm and Mismatch Responses
138 Citations1991Mikko Sams, E. Kaukoranta +2 more
All mismatch fields, i.e., responses elicited by different deviant tones, as well as N100m to the standards and deviants, could be explained by neural activity in the supratemporal auditory cortex.
Scandinavian AudiologyMagnetic Auditory Responses from the Human Brain<i>A Preliminary Report</i>
93 Citations1980C. Elberling, C. Bak +3 more
The evoked magnetic field is widely distributed across the scalp and seems to be produced by an equivalent magnetic dipole located in or near the primary auditory cortex, although in the present experiment neither right--left hemisphere nor ipsi--contralateral differences could be demonstrated.
A 24-Channel Magnetometer for Brain Research
56 Citations1989M. Kajola, Seppo P. Ahlfors +9 more
Experimental NeurologyConvergence of auditory and visual stimuli on single cells in the primary visual cortex of unanesthetized unrestrained cats
34 Citations1968Ephraim Bental, Nachum Dafny +1 more
There exists a high degree of interaction between the auditory and visual pathways resulting in convergence at the single-cell level, in the primary visual cortex of unanesthetized unrestrained cats, according to a statistically significant convergence of photic and acoustic responses.
Journal of Speech and Hearing ResearchNeural and Mechanical Response Time for Speech Production
25 Citations1974Ronald Netsell, Billie Daniel
The reaction time of 10 neurologically normal young adults was determined for a speech production task and the response was production of a CVC word following the offset of an auditory stimulus tone.