Group items tagged

Nice BBC clip explaining and illustrating the McGurk effect. "The McGurk effect is a compelling demonstration of how we all use visual speech information. The effect shows that we can't help but integrate visual speech into what we 'hear'."

This article talks about an illusion our brain pulls on called the McGurk effect. This is when visual speech is mismatched with auditory speech and can result in the perception of an entirely different message. The example the article uses is if the visual "ga" were combined with the sound "ba", this results in the perception of "da." Vased on the principle of causal inference, researchers were able to create an algorithm model of multi-sensory speech perception. What this means is that when your brain is given a particular pair of auditory and visual syllables, it calculates the likelihood that they are from a single talker compared to multiple talkers and uses this likelihood to determine the final speech perception.

"Mondegreen" means a misheard word or phrase that makes sense in your head, but is, in fact, entirely incorrect. Hearing is a two-step process. First, there is the auditory perception itself: the physics of sound waves making their way through your ear and into the auditory cortex of your brain. And then there is the meaning-making: the part where your brain takes the noise and imbues it with significance. That was a car alarm. That's a bird. Mondegreens occur when, somewhere between the sound and the meaning, communication breaks down. You hear the same acoustic information as everyone else, but your brain doesn't interpret it the same way.