45
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Cross-modal associations in synaesthesia: Vowel colours in the ear of the beholder

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Human speech conveys many forms of information, but for some exceptional individuals (synaesthetes), listening to speech sounds can automatically induce visual percepts such as colours. In this experiment, grapheme–colour synaesthetes and controls were asked to assign colours, or shades of grey, to different vowel sounds. We then investigated whether the acoustic content of these vowel sounds influenced participants' colour and grey-shade choices. We found that both colour and grey-shade associations varied systematically with vowel changes. The colour effect was significant for both participant groups, but significantly stronger and more consistent for synaesthetes. Because not all vowel sounds that we used are “translatable” into graphemes, we conclude that acoustic–phonetic influences co-exist with established graphemic influences in the cross-modal correspondences of both synaesthetes and non-synaesthetes.

          Related collections

          Most cited references30

          • Record: found
          • Abstract: found
          • Article: not found

          Crossmodal correspondences: a tutorial review.

          In many everyday situations, our senses are bombarded by many different unisensory signals at any given time. To gain the most veridical, and least variable, estimate of environmental stimuli/properties, we need to combine the individual noisy unisensory perceptual estimates that refer to the same object, while keeping those estimates belonging to different objects or events separate. How, though, does the brain "know" which stimuli to combine? Traditionally, researchers interested in the crossmodal binding problem have focused on the roles that spatial and temporal factors play in modulating multisensory integration. However, crossmodal correspondences between various unisensory features (such as between auditory pitch and visual size) may provide yet another important means of constraining the crossmodal binding problem. A large body of research now shows that people exhibit consistent crossmodal correspondences between many stimulus features in different sensory modalities. For example, people consistently match high-pitched sounds with small, bright objects that are located high up in space. The literature reviewed here supports the view that crossmodal correspondences need to be considered alongside semantic and spatiotemporal congruency, among the key constraints that help our brains solve the crossmodal binding problem.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Mechanisms of synesthesia: cognitive and physiological constraints.

            Synesthesia is a conscious experience of systematically induced sensory attributes that are not experienced by most people under comparable conditions. Recent findings from cognitive psychology, functional brain imaging and electrophysiology have shed considerable light on the nature of synesthesia and its neurocognitive underpinnings. These cognitive and physiological findings are discussed with respect to a neuroanatomical framework comprising hierarchically organized cortical sensory pathways. We advance a neurobiological theory of synesthesia that fits within this neuroanatomical framework.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Sound-colour synaesthesia: to what extent does it use cross-modal mechanisms common to us all?

              This study examines a group of synaesthetes who report colour sensations in response to music and other sounds. Experiment 1 shows that synaesthetes choose more precise colours and are more internally consistent in their choice of colours given a set of sounds of varying pitch, timbre and composition (single notes or dyads) relative to a group of controls. In spite of this difference, both controls and synaesthetes appear to use the same heuristics for matching between auditory and visual domains (e.g., pitch to lightness). We take this as evidence that synaesthesia may recruit some of the mechanisms used in normal cross-modal perception. Experiment 2 establishes that synaesthetic colours are automatically elicited insofar as they give rise to cross-modal Stroop interference. Experiment 3 uses a variant of the cross-modal Posner paradigm in which detection of a lateralised target is enhanced when combined with a non-informative but synaesthetically congruent sound-colour pairing. This suggests that synaesthesia uses the same (or an analogous) mechanism of exogenous cross-modal orienting as normal perception. Overall, the results support the conclusion that this form of synaesthesia recruits some of the same mechanisms used in normal cross-modal perception rather than using direct, privileged pathways between unimodal auditory and unimodal visual areas that are absent in most other adults.
                Bookmark

                Author and article information

                Contributors
                Journal
                Iperception
                Iperception
                pmed
                i-Perception
                Pion
                2041-6695
                2014
                27 May 2014
                : 5
                : 2
                : 132-142
                Affiliations
                School of Critical Studies, University of Glasgow, Glasgow, Scotland, UK; e-mail: anja.moos@ 123456gmail.com
                School of Critical Studies, University of Glasgow, Glasgow, Scotland, UK; e-mail: rachel.smith@ 123456glasgow.ac.uk
                Glasgow, Scotland, UK; e-mail: sam.miller.r@ 123456gmail.com
                School of Psychology, University of Glasgow, Glasgow, Scotland, UK; e-mail: david.simmons@ 123456glasgow.ac.uk
                Author notes
                []Corresponding author.
                Article
                10.1068/i0626
                4249992
                93784414-2a57-4227-bbfa-7354def8bb7f
                Copyright 2014 A Moos, R Smith, S R Miller, D R Simmons

                This open-access article is distributed under a Creative Commons Licence, which permits noncommercial use, distribution, and reproduction, provided the original author(s) and source are credited and no alterations are made.

                History
                : 17 September 2013
                : 01 May 2014
                Categories
                Article

                Neurosciences
                coloured vowels,cross-modal perception,colour vision,synaesthesia,vowel sounds
                Neurosciences
                coloured vowels, cross-modal perception, colour vision, synaesthesia, vowel sounds

                Comments

                Comment on this article