Tuesday, October 23, 2007

Synesthesia: the Flavor of Music, the Color of Touch


In the late 19th century, synesthesia, that strange and magical condition where the sense are intertwined, was the subject of much research all over Europe and America. The fact that some unspecified number of people experienced sensory crossover was fascinating, but attempting to design tests that would satisfactorily prove its existence, not to mention why it happened, was difficult. With the advent of behaviorism in the 1930s, a field which disallowed any usefulness in internal experience, interest in synesthesia waned, and it became a forgotten science. Then in the 1980s, with the cognitive revolution, science began once again to pay attention to internal states. Lo! Synesthesia slowly crept back into fashion.

We all know stereotypical synesthesia from movies and TV: the idiot savant who sees colors when he or she hears music, or perhaps the brilliant cryptographer whose different letters and/or numbers in different colors move about to solve a mystery. Because I first heard about it as a child, I had a bunch of really wild ideas about the condition, based on a description of a condition where the so-called sufferers' "senses were mixed up". I had imagined people who could taste sound, or see smells; people who felt color or pattern on their skin, or perhaps people who smelled their way through life, instead of looking.

Some of the above are actually documented, but others are (at the moment anyway) merely fancies of mine. When I started reading around in preparation of this post, though, I found a fascinating array of different perceptual issues under the same heading. In fact, as I started reading, I began to realize that I was synesthetic myself.


Drawing of the neural circuitry of a rodent hippocampus


Strangely, I had often thought how cool it would be to be synesthetic, but had assumed, like narcolepsy, that it was relatively rare and rather unmistakable. When someone I knew said she was synesthetic I figured it was a bid for attention, a way of making herself more interesting. I knew that I had some perceptual quirks, but simply put it down to being highly imaginative, or perhaps merely the leftovers of some childhood way of teaching myself things.

For example, when I was first learning my alphabet, I saw the letters as having distinct personalities. I didn't seem to have any choice about what their personalities were, but they were clearly there. Putting together words was much like putting together little conversation groups at a party: the dynamics were different if you forgot one, or put it between the wrong two letters (thus my spelling was always excellent). To this day, I still see the letters as having these same personalities (with some odd effects due to fonts - some fonts I don't like because they warp the poor letters' personalities in uncomfortable ways); however, now I gloss over it. Like so many things when we grow up, we begin to take things for granted, like the motions of driving or the walk to the mailbox. We say to ourselves, there's the oak tree, or oh, it's sunny today, but we say it in shorthand. We don't really look at the oak tree, and we certainly don't stop long enough to actually look at the way the sun is hitting the grass.

So I have been living with these little characters [sic] all my life, without really noticing them much. But if you asked me about them I could tell you all about how the "a" and the "y" don't really like each other - but that might be because the "y" is kind of stuck up, and the "a" is really very down-to-earth. And so on.

It turns out this is called Ordinal Linguistic Personification, and can be identified as true synesthesia by a test they use for many synesthetic expressions, ie. a test where the quality of the picture shown is in contrast with the automatically perceived quality as seen by the synesthete. So, for example, if the synesthete sees a "b" as female, then making a male figure out of "b"s will slow their recognition time.


This form of synesthesia often goes hand-in-hand with Grapheme-Color Synesthesia, which is the most common form: seeing letters and numbers as colored. I don't personally have this form of it, but like many forms of the condition it can be seen as actually colored, or can simply have a strong, automatic color association in the mind of the perceiver. Which makes it difficult to put a finger on, except that tests have proven that people can be confused because of the strength of their perceptions. As one person says, of her grapheme-color perceptions, "I thought this was caused by me over-thinking things." Apparently this is actually quite common, for people (like me) to simply believe they are being imaginative, or making up systems to help themselves (as I did), in school or elsewhere.

A picture of one person's number-form synesthesia, ie. the mental mapping of numbers, from Francis Galton's study, The Visions of Sane Persons


One of my favorite forms is lexical-gustatory synesthesia, where people experience phonemes as different tastes in their mouth. Can you imagine? It would be like the fairy tale of the two sisters who have jewels, frogs, etc. falling from their mouths, except all mixed together, depending on what you were saying. It might be enough to turn one into a seriously laconic individual.

What about people who "see" music, or sounds? This is another common form of synesthesia, to have colors associated with specific tones, so that listening to music becomes a more intense and complex experience. I always thought that the little thing I did, where I "imagined" the music as colored ribbons which twined above, and slightly to the left, of my vision, was a sort of game I played with myself, because like a page on a computer desktop I could minimize it if needed. But it was always there, even if I wasn't specifically thinking about it. Apparently, this is not an unusual type of synesthesia for musicians to have.

In fact, it seems to be fairly common for synesthetes to be creative people. "Some studies have suggested that synesthetes are unusually sensitive to external stimuli. Other possible associated cognitive traits include left-right confusion, difficulties with math, and difficulties with writing." [wiki]

Carol Steen's painting of a synesthetic experience of acupuncture


I find this interesting, because I have all of those traits (except writing), and am terrible with numerals. Conceptually, I'm all over math, but when I have to deal with the visual symbols I get lost. On thinking about it, I realize that seeing letters as interesting social groups actually helps me to spell, but it doesn't help with math. The personalities of the numbers confuse me when I'm trying to work with their numeric values.

This human ability to make up stories, to find systems so as to make sense of a chaotic universe, is inherent in everyone, reaching right down to some of our most basic ways of interacting with the world. Like face recognition, storytelling is one of the deep ways we recognize things and organize our world. But synesthesia lies even deeper, right down to the molecular levels of the brain. It is beginning to emerge that the characteristic is X-chromosome-linked, and there is some evidence that some of its effect (though not all) is associated with the hippocampus, a part of the limbic system of the brain which is crucial for spatial memory and navigation, and which is affected by many kinds of altered states of consciousness. LSD, for example, is said to induce synesthesia sometimes, and its effect is connected to the hippocampus. Interestingly, the limbic system is also where many emotional associations are made.

There is some researchers who believe that neonatal brains have minimal sensory differentiation, ie, that we "learn" to differentiate between the five senses; and therefore synesthetes may be people for whom these differentiations have not developed into such specifically walled-off areas. A common conception is that when sensory stimulation comes in from one area, such as the ears, there is a sort of cross-stimulation that takes place where neurons in the sight area of the cerebral cortex are activated as well, causing a visual response.

As Mr Cytowic (see below) says, "Mechanistic explanations have been plentiful throughout synesthesia's history. The notion of crossed wires turns up repeatedly. As early as 1704, Sir Isaac Newton struggled to devise mathematical formulae to equate the vibration of sound waves to a corresponding wavelength of light. Goethe noted color correspondences in his 1810 work, Zur Farbenlehre. The nineteenth century saw an alchemical zeal in the search for universal correspondences and a presumed algorithm for translating one sense into another. This mechanistic approach was consistent with the then-common view of a clockwork universe based on Newton's uniform laws of motion."

There are other aspects to it, which haven't been explored so much, which don't fit in so well with the scientific community's penchant for following single ideas down to their roots. For example, synesthetes generally have very good memory, recalling things such as conversations, directions, and verbal instructions with surprising accuracy. They are very often amazingly good at spatial location "such as the precise location of kitchen utensils, furniture arrangements and floor plans, books on shelves, or text blocks in a specific book. Perhaps related to this observation is a tendency to prefer order, neatness, symmetry, and balance. Work cannot commence until the desk is arranged just so, or everything in the kitchen is put away in its proper place. Synesthetes perform in the superior range of the Wechsler Memory Scale." [Cytowik again]


It is interesting to note how the term "synesthesia" has been used for many years in the world of literature, art and music, not as an experiential condition but as a metaphoric edifice, a sort of symbolic way of expressing things. The metaphors (that storytelling urge, again) which pervade our senses, the smell of green cut grass or the clarity of wetness, are a cultural construct, a direct connection to the arts. Despite this, there are many famous creative synesthetes, who have made their mark, directly or indirectly, on our lives. Vasily Kandinski, a well-known synesthete himself, is quoted many times in scientific literature. His desire to bring the immediacy of his perception to audiences, his exhortation to "stop thinking!" has endeared him to those people fascinated by the wild individuality of the condition, the repercussive echos that it brings to the study of the brain. For synesthesia is, at heart, that most ineffible of things: a creative experience of the world, immediate and unquantifiable, having an everlasting impact on our culture through its artists. It brings to mind what Kandinski said, back in 1910:

"Lend your ears to music, open your eyes to painting, and . . . stop thinking! Just ask yourself whether the work has enabled you to 'walk about' into a hitherto unknown world. If the answer is yes, what more do you want?"





Some links:
Richard E. Cytowic's very interesting and absorbing review of the subject from 1995, very worth taking a look at for a more detailed and sensory description.

His book, The Man Who Tasted Shapes, can be found on Amazon.

Wired Magazine's 2005 take on the phenomenon.

(Thanks to Violinist.com for the image at the top of the post)

18 comments:

theskyfullofdust said...

I went to a seminar on this last year; with a number of people (some of whom were lecturers I knew) who saw colours in words or when they heard music. For some colours 'bled' from the words, giving them an aura of sorts that helped them with spelling, structure and so forth. It was all very fascinating and I am a bit envious that I have no such gift (for me it is a gift).

Simon

Duncan M said...

Oddly enough, I just watched the latest TED talk by Vilayanur Ramachandran. He talks a bunch about the brain, and how studying brain damage can tell us a lot about how the brain is wired and how it operates.

He also talks about synesthesia and how it works and applies to creativity and how it is (possibly) caused. You might find it isteresting.

http://www.ted.com/index.php/talks/view/id/184

Crystal said...

Ian over at Wildwinter is writing a really amazing book with a central character with a form of synesthesia... http://wildwriting.blogspot.com/

wil said...

Hi, I just discovered your blog. Great post!

My wife falls somewhere on the lower end of the synesthesia spectrum: she often speaks of the personalities of numbers (also, she's a professional artist, her memory's excellent, and she has difficulty with math).

Like Simon, I'm a little jealous I don't have it.

HibiscuitsGirl said...

I was just listening to "David Copperfield" while doing a little spinning, and heard this:

"I can faintly remember learning the alphabet at her knee. To this day, when I look upon the fat black letters in the primer, the puzzling novelty of their shapes, and the easy good-nature of O and Q and S, seem to present themselves again before me as they used to do."

It is from Chapter 4, where David describes his miserable childhood after his mother remarries. I thought of this post immediately.

IanT said...

Hi Heather,
Just responding to your note on my blog - thanks very much for reading. I hope you managed to find some of the earlier episodes (rather than the one you commented on) which are much, much more rooted in Rikke's synaesthesia. If you didn't, I can point you at them!

Ian

Anonymous said...

http://www.mindhacks.com/blog/2007/10/musicophilia_goes_li.html

The above link gives my Poe paranormal-synaesthia critique of Sack's new Musicophilia book.

Enjoy.

K said...

Thanks for this entry, I really enjoyed reading it. I have mild synaesthesia (everything has a shape/color/texture). What's amazing to me is how pervasive it is through my way of thinking. Every now and then I find out that something that I thought was "normal" is actually related to synaesthesia. From this post, for instance, I learned that it may explain my left/right confusion. I read an article (in the Washington Post? perhaps.) on a conference about synaesthesia which said that a quick test psych people to to see of someone has synaesthesia is asking them "What shape is a year?" If you have an immediate answer, you have some for of synaesthesia. For me it's a square. Is it a shape for you?

MEB said...

Hey there,

I saw your musings on synesthesia and wanted to let you know about a lovely story that focuses on a character who has it: Jeff Ford's "The Empire of Ice Cream." Last I checked it was available online, possibly through Strange Horizons or Scfi.com.

If you read it, I hope you like it,
Mary
http://wondersofmaybe.blogspot.com/

Laurie Chase Kruczek said...

Hello there,

Nice to see your write up on synesthesia. I just found out recently that I have number form synesthesia. I was shocked to find out it is unusual to see days of the week, months, and years in 3D "space". I thought everyone saw it the same way. Now that science is rediscovering synesthesia, it is truly a fascinating look into the possibilities of the mind.

Anonymous said...

This is a really great write-up of synesthesia, and it's so nice to hear the people responding call it a gift. I've so often heard it referred to as a disorder, which breaks my heart. I mean, really. It's just another sense.

I have music-color and grapheme-color synesthesia. I couldn't bear to live without my colors. For me, it's an immediate association in my head. The name 'Lauren' is a pale lilac, which floats into a darker purple and then down into red. 'Chanson Triste', by Koussevitzky, is all sorts of pale yellows and greens.

I've been trying to figure this out for a while, though, if anyone could lend me a hand-
Not only do I see colors when I read words off of a page, I also see colors when they're spoken aloud by someone else. Does anyone have any insight into what sort of synesthesia this is?

Heather McDougal said...

Absolutely. There is one story (I am not at home now so don't have access to it) of a man who had very clear taste associations with different words, and other people respond very closely to sounds of all kinds. Speech is, after all, not that different from music and singing.

I don't know what it is called, however. I do have one contact which I will pursue and see if I can find out... when I get home!

Anonymous said...

That would make sense. Thanks very much.

Elindomiel said...

This same thing happened to me! Only after studying synesthesia did I realize that this was why my numbers had personalities! Then I asked my friends, and I admit to still being a bit shocked that their's didn't! The more I thought about it, the more I realized that they had colours too, but much more faintly. I actually have it for a handful of letters as well, but not for all of them, so I don't really think about it. :D

pipboyd said...

Hi there, really enjoyed reading your blog, im really interested in synesthesia and find it incredibly intriguing. I also have the habit of given everyday things a personality, such as the sky and types of food, and can often taste specific sounds. Anyways just a thank you for the interesting blog.

Anonymous said...

I think I have a different type of synesthesia. Whenever I hear music I automatically turn it into a specific story. It works best for longer, more intense pieces, like bach, mozart, etcetera. Often a piece and it's accompaniment will be a different story. A piece I just learned on the piano was a novel for teens about a guy who left his home villiage for the first time in years and went to a magical forest, with a cutscene about a duck flying and one part about a carnival and another about a see-saw. There are infinite types of synesthesia linking lots of different things.

Anonymous said...

It wasn’t until recently that I heard the word “Synesthesia” and the meaning and now I’m wondering if it’s possible I have some form of it.

When I’m touched, it’s an automatic silver. The harder the touch, darker the silver. Silver isn’t a good color to feel for it hurts.
:/ and I feel silver a lot.

I was puttering around online and found the different types of synesthesia yet nothing correlated with what I thought. Until this, The Color of Touch… yet I’m still unsure.
And now I’m questioning the personality of letters.

If anyone has an input, I would appreciate it greatly.

Bobbi said...

Looks like most of these comments are from a while ago, so maybe no one will read this, but you never know.

I associate a color with each letter and number. I also have left-right confusion and had trouble with math in school but have always been an excellent speller. I didn't realize I had synesthesia until I was an adult.

Cody, I also associate colors when people say words, but I see the word inside my head. I didn't find out this was unusual until late either: apparently, if you say the word "tree" most people picture a tree of some kind. I see the word "tree" in my head. This may be why I associate colors with spoken words as well as written ones. Is this true for you, as well?

I have another question for those of you who have said you associate a color with letters. I find that a silent letter generally does not cause a color change in the word. For instance, the word "the" is orange, brown and blue - the color of each of its component letters. However, "rake" is maroon, red and black. No blue for the silent e. Do you find this as well?

Great post and good conversation!