Multimodal sentiment analysis: Sentiment analysis using audiovisual format

Abstract

Multimodal sentiment analysis is the analysis of emotions, attitude, and opinion from audiovisual format. A company can improve the quality of its product and services by analyzing the reviews about the product [5]. Sentiment analysis is widely used in managing customer relations. There are many textual reviews from which we cannot extract emotions by traditional sentiment analysis techniques. Some sentences in the textual reviews may derive deep emotions but do not contain any keyword to detect those emotions, so we used audiovisual reviews in order to detect emotions from the facial expressions of the customer. In this paper we take audiovisual input and extract emotions from video and audio in parallel from audiovisual input, finally classify the overall review as positive, negative or neutral based on the emotions detected.