Hearing mouth shapes: Sound symbolism and the reverse McGurk effect
Journal Title: i-Perception - Year , Vol 3, Issue 8
Abstract
In their recent article, Sweeny, Guzman-Martinez, Ortega, Grabowecky, and Suzuki (2012) demonstrate that heard speech sounds modulate the perceived shape of briefly presented visual stimuli. Ovals, whose aspect ratio (relating width to height) varied on a trial-by-trial basis, were rated as looking wider when a /woo/ sound was presented, and as taller when a /wee/ sound was presented instead. On the one hand, these findings add to a growing body of evidence demonstrating that audiovisual correspondences can have perceptual (as well as decisional) effects. On the other hand, they prompt a question concerning their origin. Although the currently popular view is that crossmodal correspondences are based on the internalization of the natural multisensory statistics of the environment (see Spence, 2011), these new results suggest instead that certain correspondences may actually be based on the sensorimotor responses associated with human vocalizations. As such, the findings of Sweeny et al. help to breathe new life into Sapir's (1929) once-popular “embodied” explanation of sound symbolism. Furthermore, they pose a challenge for those psychologists wanting to determine which among a number of plausible accounts best explains the available data on crossmodal correspondences.
Authors and Affiliations
Charles Spence, Ophelia Deroy
Keywords
Related Articles
- EP ID EP682510
- DOI 10.1068/i0558ic
- Views 88
- Downloads 0
Grouping by closure influences subjective regularity and implicit preference
A reflection between a pair of contours is more rapidly detected than a translation, but this effect is stronger when the contours are closed to form a single object compared to when they are closed to form 2 objects wit...
The utility of defocus blur in binocular depth perception
The question of whether defocus blur is a quantitative cue for depth perception is a topic of renewed interest. A recent study suggests that relative defocus blur can be used in computing depth throughout the visual fiel...
Afterimages from unseen stimuli
Observers adapted to a field of randomly coloured twinkling tiles, in which was embedded a faint, subthreshold green letter. Observers failed to discern this letter, but they readily reported its pink afterimage afterwar...
Looking at two paintings at once: Luminance edges can gate colors
Two paintings, O1 and O2, were split into their luminance (grayscale) components L1, L2 and their color components C1, C2. The two color components, C1, C2, were transparently superimposed. Adding the grayscale of the fi...
View-based matching can be more than image matching: The importance of considering an animal's perspective
Using vision for navigation is important for many animals and a common debate is the extent to which spatial performance can be explained by “simple” view-based matching strategies. We discuss, in the con...