Untangling the mass of sound

by Elyse S. Sussman

0 Faves
Vote!
1 Star2 Stars3 Stars4 Stars5 Stars
Loading ... Loading ...

Let’s suppose we are taking a stroll through the congested streets of a city centre. Perhaps we don’t notice, but we are always “bombarded” by sounds: honking horns, chattering and shouting, the trilling of mobile phones, music blaring at full volume from clothes shops. But, in spite of all this din, we are always able to pick out the voice of a friend calling us from the other side of the road. How? It is thanks to our brains which can isolate the sound waves that hold most interest for us.  Elyse S. Sussman, Director of the Cognitive Neurophysiology Laboratory at New York’s Albert Einstein College of Medicine, has studied this complex neural mechanism for many years.

How do we manage to untangle the mass of sound that surrounds us?
In actual fact we listen more with our mind than with our ears. What is at stake is the need to give meaning to what we perceive. Everything comes from the vibration of the eardrums that are converted into electrical impulses and sent to our brain. At that point two levels come into play: an automatic system that catalogues these stimuli according to physical characteristics (frequency, spatial location intensity and timbre), and an attentive system which selects the sounds with the aim of transforming them into something that has meaning. This means we can understand whether there are two or three cars in the street, if one of them needs its brakes fixing, or whether there is wind coming from far away. No computer is able to equal the results of such a complex mechanism.

Attention seems to be fundamental …

It is attention that enables us to interpret this input which would otherwise remain a senseless sequence of sounds. For example, it allows us to resolve perceptive doubts deriving from ambiguous signals or sounds distorted by loud background noise. Attention even allows us to drag up sounds from our memory that we think we have never heard. How many times, when we are concentrating on something, our partner might ask us a question: initially we are caught on the hop and are unable to respond. A few seconds later (up to a maximum of 30) we remember what he or she asked us.

But not all sounds are the same. Why is it easier to distinguish two human voices than two musical instruments?

In an orchestra, each instrument contributes to the overall melody and harmony by playing its notes in sequence within a broad range of tonal frequencies. There are multiple parallel melodies which combine to form a harmonious result, thanks to the composer. This is why it is hard to distinguish two instruments. Human voices, however, don’t usually overlap so well in terms of harmony or rhythm. I should also mention that for human beings, words and speech have a very special meaning: this is why we are always very good at intercepting them.

We’ve talked about sounds. But how is silence interpreted?
Silence is part of the structure of sound, and at cortical level it is codified like a violation of the rhythm of a sequence. It is often forgotten by those who study how sound is processed, but it gives us important information about how the elements of sound are linked: just think of the sound of footsteps or the words in a sentence!

Noise pollution is on the increase. What are the consequences?
Cochlear mechanisms are built to handle constant stimulation. We can close our eyes to rest from visual stimulation, but we can’t “close” our ears. Unfortunately, Nature didn’t factor in those invasive technologies like mp3 readers. The risk for young people playing these things at high volumes all day is that they could have impaired hearing.

And in the most serious cases?
Those with hearing problems usually have trouble isolating individual sounds from the context, like a group of voices in a crowded restaurant. Of course, there can be various reasons for this: some of the damage is physiological and has to do with peripheral mechanisms like the middle or inner ear; others are real cognitive disorders related to serious illnesses like dyslexia, autism or schizophrenia.

You also study the way in which children perceive sound. Why are young children so good at learning sounds they have never heard before?
Every child is born with the innate ability to learn any language, and this is easy to see in the case of children whose parents speak different languages. Despite this, during the first few years of life, our neural systems adapt according to our interactions with our environment. This is why, when we try to learn another language in adulthood, we realise that things aren’t that simple. It is as if our brain was “optimised” for our native language. After a certain age, it becomes impossible to learn a foreign language without losing your original accent. There are also certain sounds that remain particularly obstinate: for example a native Japanese speaker tends to mix up the /l/ and /r/ sounds.

Interview by Mauro Scanu


Elyse S. Sussman is an associate professor at the Department of Neuroscience at the Albert Einstein College of Medicine (Bronx, New York). She is a music graduate and flautist of some talent. Renaissance music being her preferred genre, she has also learned to play the crumhorn, an ancient German wind instrument, and the Renaissance flute. She abandoned her career as a performer in favour of neuroscience, and in particular has studied the way in which the brain processes music and language. She has a passion for fast cars.


Write a comment

Click here to login
Comment required
First name required
Last name required

Nickname required
Email required
Captcha required
Captcha Code required

Information on protection of privacy I agree I don't agree

Images

  • ISIA – Higher Institute for Artistic Industries - Urbino

  • ISIA – Higher Institute for Artistic Industries - Urbino

  • Kurt Schwitters, 1927

    NEUE PLASTISCHE SYSTEMSCHRIFT. Like many new experimental types to arise from the early twentieth century avant-garde in Europe, Schwitters’ type is an attempt to remake the Western writing system through reduction, and the abandonment of idiosyncrasies. Schwitters proposed a monocase system, adopting a rectilinear interpretation of roman capitals, and contrasting these with six vowel alternate characters, A, E, I, O, Ü, and Y scaled to the same height but based upon Carolingian lowercase. The vowel alternates, though primarily used for the short sound, are used somewhat indiscriminately in his print work. Unlike his contemporaries, Herbert Bayer, Theo Van Doesburg and Jan Tschichold all who produced experimental universal alphabets that rejected uppercase, Schwitters retained the form of roman capitals.

  • George Bernard Shaw, 1912

    SHAVIAN ALPHABET. The Shavian alphabet is conceived as a way to provide simple, phonetic orthography for the English language to replace the difficulties of the conventional spelling. Shaw set a criteria for the new alphabet: it should be as phonetic as possible. The Shavian alphabet consists of three types of letters: tall, deep and short. Short letters are vowels, liquids and nasals; tall letters are unvoiced consonants. A tall letter rotated 180°, with the tall part now extending below the baseline, becomes a deep letter, representing equivalent voiced consonant.

  • Herbet Bayer, 1959

    FONETIK ALFABET. In 1959, he designed his fonetik alfabet, for English. It was sans-serif and without capital letters. He had special symbols for the suffixes “ed” “-ory”, “-ing”, and “-ion”, as well as the digraphs “ch”, “sh”, and “ng”. An underline indicated the doubling of a consonant in traditional orthography.

  • Alexander Melville Bell, 1867

    VISIBLE SPEECH. In 1867, Alexander Melville Bell published the book Visible Speech: The Science of Universal Alphabetics. The book contains information about the system of symbols created by him that indicates the pronunciation of words so accurately that it represents even regional accents. Melville Bell’s intention was to create a script in which the characters actually look like the position of the mouth when they are being pronounced. The system is useful not only because its visual representation mimics the physical act of speaking, but because it does so, these symbols may be used to write words in any language, hence the name: Universal Alphabetics.

  • Microphone

    MICROPHONE is an experimental typeface designed by Jonathan Hoefler and Tobias Frere-Jones for the periodical Fuse #15 cities, in 1995. “There are six million stories on the naked city”. The idea was to take fragments of conversations from people which where then used as a character set in the Microphone typeface. One single character in Microphone represents a phrase with an individual style, size and spacing that reflects the voices heard on the street. Microphone is different from the rest of the typefaces because it consists of text that is read more like a short story.

  • Jan Tschichold, 1926 /29

    UNIVERSAL ALPHABET. This alphabet has been designed to clean up the few multigraphs and non-phonetic spellings in the German language. He devised brand new characters to replace the multigraphs “ch” and “sch”. His intentions were to change the spelling by replacing systematically “eu” with “oi”, “w” with “v”, and “z” with “ts”. Long vowels were indicated by a macron below them, though the Umlaut was still above. The alphabet was presented in one typeface, which was sans-serif and without capital letters.

  • DSC_0016 - DSC_0012

    Citofono di una via di Urbino, nel luglio 2009.

  • DSC_0037 - DSC_0038

    Confessionale nella chiesa della Maddalena in Piazza della Maddalena a Roma, nel luglio 2009.

  • IMG_3062

    Telefono pubblico in Borgo Mercatale a Urbino, nel luglio 2009.

  • IMG_3091 - IMG_3092

    Call center in via Emanuele Filiberti a Roma, nel luglio 2009.

  • DSC_0077 - DSC_0088

    Confessionale nella chiesa di San Macuto, in piazza di San Macuto a Roma, nel luglio 2009.

  • Karlheinz Stockhausen, 1928-2007

    Hello! Repeat please. Hello! Is changed, of course. I’m always right. Mr. Stockhausen? Yes I am. Can I… No you can’t. Try to say “hello” more quiet, pretend to have a little pillow in your mouth. Hello. AH! Perfect. Wait, I’ve to record it. Wait wait wait.

  • John Cage, 1912-1992

    Who is there? Hi, this is John Cage! I’m here in the 6th Avenue and there’s a good traffic today. What? I said there’s a good traffic today! And I want to advise you! Stop listening music and come down! You don’t need music! You don’t need someone talking! The activity of sound is enough. We don’t need sound to talk to us. And today the traffic sound is awesome! Ok John I’m coming!

  • Arrigo Lora Totino, 1928

    Hello. Good morning Miss. I’m Arrigo Lora Totino and I would like to invite you to my next performance of liquid poetry. Uh, poetry you said... I am not used to read poetry. You don’t have to read, it’s a kind of sound poetry Miss. The phonetic aspects are foregrounded and the performance becomes the thing in itself. You will feel the poetry, the real poetry, with the ears and with the eyes. Sounds interesting. And what means “liquid”? I’ll explain it: with a hydromegaphone, built by my friend Piero Fogliati, I’ll try to declaim the language of fishes and other sea stuff, speaking through the water inside the hydromegaphone. Mmm... sounds funny. It is funny... It’s like a cabaret. I love cabaret. I will be there! Ah, Mister Totano* (* Squid)? Do I need an umbrella?

  • Robert Schneider, 1961

    Hello. Mr. Schneider? Yes? Oh hi! I’m Elias, the character of your new novel. Hi Elias, everything ok? Yes! Finally it happened. I see the air condensing and then expanding with incessant rhythm. I see the sound valleys and their giant mountains! Perfect! Congratulations Elias, thank you for calling.

  • La Monte Young, 1935

    Hey La Monte, can I ask you something? Of course... How can you stand the wind sound during the storms? At night I can’t sleep!! It’s easy, you can’t turn off the wind like you would turn off the radio. When the wind comes it goes on as long as it is going to last. You would find it to be very profond and very awesome.

  • Philip Glass, 1937

    Who is there? I’m Philip, your neighbour, I just want to thank you. Thank you for what? For the noises coming from your apartment, the washing machine, the dishwasher, the mixer... Oh I’m sorry Phil, I didn’t want to disturb you! Disturb me? Not at all! Your noises revealed me the use of rhythm in developing an overall structure in music!!! What? I don’t understand... Of course you don’t understand, you are accostumed to the use of rhythm in western music, where the time is divided, but if you were interested in the indian music you would have a very different conception, and you would appreciate the beats coming out from your apartment, that string together make up larger time values! Do you understand now?

  • Luigi Russolo, 1885-1947

    Hello? Bzt... bzzz... It’s me, Luigi What? I don’t understand anything! I’m Luigi... bzzz... Luigi Russolo Who? Who is there? Bzzz... bzt I can’t hear anything, there is a disturbing noise in the entry phone. Bzzz... Disturbing noise? You really believe that noise is disturbing? Our entire life is accompanied by noise! What do you mean? The noise is familiar to our ear, the sound instead, this occasional and unnecessary element, is alien to our life, but we forgot it a long time ago. Bzzz… The irregular confusion of our life create the noise which reaches us in a confused and irregular way. So we have to select, coordinate and dominate all the noise to increase our sensual pleasure... bzt

Related posts

  • No Related Posts