User Attention Based Arousal Content Modeling

Published 1 October 2006

S.Kom. Agus Zainal Arifin, Peter Y. K. Cheung

DOI10.1109/icip.2006.312450

Citations10

TL;DR

A novel FPGA-based system for modeling the arousal content of a video based on user saliency and film grammar is presented.

Abstract

The affective content of a video is defined as the expected amount and type of emotion that are contained in a video. Utilizing this affective content will extend the current scope of application possibilities. The dimensional approach to representing emotion can play an important role in the development of an affective video content analyzer. The three basic affect dimensions are defined as valence, arousal and control. This paper presents a novel FPGA-based system for modeling the arousal content of a video based on user saliency and film grammar. The design is implemented on a Xilinx Virtex-II xc2v6000 on board a RC300 board.

Keywords

Computer Science

IEEE Transactions on Pattern Analysis and Machine IntelligenceA model of saliency-based visual attention for rapid scene analysis

11,180 Citations1998Laurent Itti, Christof Koch +1 more

A visual attention system, inspired by the behavior and the neuronal architecture of the early primate visual system, is presented, which breaks down the complex problem of scene understanding by rapidly selecting conspicuous locations to be analyzed in detail.

IEEE Transactions on MultimediaA generic framework of user attention model and its application in video summarization

526 Citations2005Yufei Ma, Xian‐Sheng Hua +2 more

A generic framework of a user attention model is presented, which estimates the attentions viewers may pay to video contents, and a set of modeling methods for visual and aural attentions are proposed.

IEEE Transactions on MultimediaToward automatic extraction of expressive elements from motion pictures: tempo

85 Citations2002Brett Adams, C. Dorai +1 more

This approach, motivated and directed by the existing cinematic conventions known as film grammar, uses the attributes of motion and shot length to define and compute a novel measure of tempo, confirming tempo as a useful high-level semantic construct in its own right and a promising component of others such as rhythm, tone or mood of a film.

Estimating tempo, swing and beat locations in audio recordings

64 Citations2002J. Laroche

Techniques for estimating the tempo and the swing, and locating the beats in audio recordings, under the assumption that the tempo is constant are presented.

Affect computing in film through sound energy dynamics

49 Citations2001Simon Moncrieff, Chitra Dorai +1 more

An algorithm for the detection and classification of affective sound events underscored by specific patterns of sound energy dynamics is developed with the ultimate aim of automatically structuring sections of films that contain distinct shades of emotion related to horror themes for nonlinear media access and navigation.

User-oriented affective video content analysis

41 Citations2002Alan Hanjalić, Li-Qun Xu

The article looks into a new direction in multimedia content analysis: the extraction and modeling of the affective content of an arbitrary video, using the so-called "dimensional approach to affect" concept underlined by psychophysiology studies.

Lecture notes in computer scienceDetermination of Perceptual Tempo of Music

9 Citations2005Bee Yong Chua, Guojun Lu

Experimental results show that the proposed algorithm is effective in estimating the Perceptual Tempo, which refers to listener's tempo perception as fast, moderate or slow, when he listens to a piece of music with fairly constant overall tempo.

A Novel FPGA-based Implementation of Time Adaptive Clustering for Logical Story Unit Segmentation

3 Citations2006S.Kom. Agus Zainal Arifin, Peter Y. K. Cheung

An efficient hardware implementation for approximating the TAC algorithm that is implemented on a Xilinx Virtex-II xc2v3000 on board a RC203E board and runs 27 times faster than a Pentium 4-based PC at 3.4 Ghz.