4.4 Development #Week 12

For further understanding of the influence of auditory and visual media, I did more research about McGurk effect.

It is interesting that audio and visual difference can produce illusion. What you are seeing might be fake; what you are hearing might not true either. In this case, we can say, our eyes affect what we hear. This is because our brain is attempting to resolve what it thinks it’s hearing with a sound closer to what it visually sees. McGurk effect shows that visual information provided by mouth movements can influence and override what a person thinks he or she is hearing (Nierenberg 2017). Through editing the video, I actually accelerated some pieces of sequence since we need to match the movements of each location. But you can hardly see the accelerated part because the music plays in the same speed, which “cheat” your eyes.

According to Nierenberg (2017),  the brain is receiving auditory speech and visual speech, then putting them together to form some new elements when people watching media or communicating with others. It is called multi-sensory illusion. What if we put the same versions of music into different environment? Will audience generate the same feeling among them? I think actually it works, but would reduce the sensory experience in each scene, because each media fragment interacts with each other. Different music matched different environment, which can produce more vivid and actual scene; thus audience can be more involved.

Leave a Reply

Your email address will not be published. Required fields are marked *