Hearing by eye: how much spatial degradation can be tolerated?

Citation
J. Macdonald et al., Hearing by eye: how much spatial degradation can be tolerated?, PERCEPTION, 29(10), 2000, pp. 1155-1168
Citations number
50
Categorie Soggetti
Psycology
Journal title
PERCEPTION
ISSN journal
03010066 → ACNP
Volume
29
Issue
10
Year of publication
2000
Pages
1155 - 1168
Database
ISI
SICI code
0301-0066(2000)29:10<1155:HBEHMS>2.0.ZU;2-N
Abstract
In the McGurk effect (McGurk and MacDonald, 1976 Nature 264 746-748), illus ory auditory perception is produced if the visual information from lip move ments is discrepant from the auditory information from the voice. A study i s reported of the tolerance of the effect to varying levels of spatial degr adation (videotaped images of a speaker's face were quantised by a mosaic t ransform). The illusory effect systematically decreased with an increase in the coarseness of the spatial quantisation. However, even with the coarses t level (11.2 pixels/face) the illusion did not completely disappear. In ad dition, those participants who did not experience the illusion nevertheless showed the effects of auditory-visual interaction in their clarity ratings of the auditory stimulus. It is concluded that auditory-visual interaction in visible speech perception is based on relatively coarse-spatial-scale i nformation.