The Effects of Combining Video and Music with Conflicting Emotional Content on Self-reported Emotional Experience
In film, video and music are combined to communicate or evoke an emotional response. Often video and music with similar emotional content are used to reinforce each other, but sometimes intentionally video and music with contradicting emotion is used to achieve a specific emotional effect. In this paper we will investigate this by dubbing a film fragment with several types of music with varying emotional content, and letting subjects self-assess the emotional content through the self-assessment manikin and the Geneva emotion wheel, which translate into three dimensions of emotion: pleasure, arousal and dominance. We found that the perceived pleasure dimension of the film fragment is primarily driven by the video image, regardless of the music. Also for film fragments dominance, if the music is not consistent, dominance and arousal are generally lower. Moreover, the perceived emotion varies more across subjects if the emotional content of the video and audio image are in conflict.
Jiang Zhenghua, "The Effects of Combining Video and Music with Conflicting Emotional Content on Self-reported Emotional Experience", Master's Thesis for the Media Technology programme, Leiden University (The Netherlands), 2015