Natural Language Description of Human Activities from Video Images Based on Concept Hierarchy of Actions
International Journal of Computer VisionPublished 1 November 2002
Atsuhiro Kojima, Takeshi Tamura, Kunio Fukunaga
Citations356
SJR quartileQ1
SJR score3.14
SNIP5.15
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A method for describing human activities from video images based on concept hierarchies of actions based on semantic primitives, which demonstrates the performance of the proposed method by several experiments.
Abstract
We propose a method for describing human activities from video images based on concept hierarchies of actions. Major difficulty in transforming video images into textual descriptions is how to bridge a semantic gap between them, which is also known as inverse Hollywood problem. In general, the concepts of events or actions of human can be classified by semantic primitives. By associating these concepts with the semantic features extracted from video images, appropriate syntactic components such as verbs, objects, etc. are determined and then translated into natural language sentences. We also demonstrate the performance of the proposed method by several experiments.
Keywords
Computer ScienceSocial Sciences
Language<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.
11,687 Citations2000Adam Kilgarriff
The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.
Image and Vision ComputingMonitoring human behavior from video taken in an office environment
137 Citations2001Douglas Ayers, Mubarak Shah
A system which automatically recognizes human actions from video sequences taken of a room by using prior knowledge about the layout of the room, which is essentially content-based video compression.
Lecture notes in computer scienceAssociation of motion verbs with vehicle movements extracted from dense optical flow fields
60 Citations1994Henner Kollnig, Hans-Hellmut Nagel +1 more
This contribution addresses the problem of detection and tracking of moving vehicles in image sequences from traffic scenes recorded by a stationary camera by replacing the low level vision system component for the estimation of displacement vectors by an optical flow estimation module.
Generating natural language description of human behavior from video images
37 Citations2002Atsuhiro Kojima, Masayuki Izumi +2 more
This work proposes an approach to generating a natural language description of human behavior appearing in real video images using a model based method and a technique of machine translation.
A Vision of ‘Vision and Language’ Comprises Action: An Example from Road Traffic
37 Citations1994Hans-Hellmut Nagel
A grammar to represent a nontrivial subset of more complex driving activities on a highway is formulated and can be investigated not only at thelevel of control algorithms, but simultaneously at the level of natural language descriptions.
Artificial Intelligence ReviewA vision of ?vision and language? comprises action: An example from road traffic
24 Citations1994Hans-Hellmut Nagel
A grammar to represent a nontrivial subset of more complex driving activities on a highway is formulated and can be investigated not only at thelevel of control algorithms, but simultaneously at the level of natural language descriptions.
Lecture notes in computer scienceIntegrating vision and language: Towards automatic description of human movements
23 Citations1995Gerd Herzog, Karl Rohr
A model-based approach for the recognition of pedestrians and on the further evaluation and language production in Vitra are reported on, which aims to obtain an incremental evaluation and simultaneous description of the perceived time-varying scenes.
Artificial Intelligence ReviewIntegrating vision, motion and language through mind
14 Citations1996Naoyuki Okada
An integrated comprehension and generation system for vision, motion and language that simulates the protagonist or fox of an Aesop fable and could be expected to provide a good framework for integrated absorption and generation systems from the technological point of view.
Feedback of correcting information in postediting to a machine translation system
14 Citations1988Fujio Nishida, Shinobu Takamatsu +2 more
This paper presents an attempt to construct a feedback system PECOF which improves a Japanese-English Machine Translation system by feedback of correcting information given by posteditors.
Conceptual taxonomy of Japanese adjectives for understanding natural language and picture patterns
12 Citations1982Naoyuki Okada, Aiko Miura
S O to state S 1 as shown in Fig. 2 shows how the difference in vertical length between 00 and 01 b r i n g s about the concept of " h i gh" shows how deep s t r u c t u r e s need O 0 as an object for comparison.
Japanese-English translation through internal expressions
10 Citations1982Fujio Nishida, Shinobu Takamatsu
This paper describes an approach to Japanese-English translation through internal expressions which are similar to those used in the recent approach to English-Japanese translation, focused on construction of the internal expressions of Japanese sentences based on case structures of predicates.
Conceptual taxonomy of Japanese verbs for understanding natural language and picture patterns
9 Citations1980Naoyuki Okada
A taxonomy of "matter concepts" or concepts of verbs that play roles of governors in understanding natural language and picture patterns and the meanings common to them was applied to a translation of picture pattern sequences into natural language.
Media information processing in documents-generation of manuals of mechanical parts assembling
4 Citations2002Tadahiro Kitahashi, Makoto Ohya +2 more
The main topic is the generation of a manual of a mechanical parts assembly as an example of media integration in a document and the essential processing techniques of media information, especially document media information.
IEEJ Transactions on Electronics Information and SystemsExtracting Regions of Human Face and Hands considering Information of Color and Region Tracking
4 Citations1999Katsunori Asanuma, Masaki Onishi +2 more
This paper proposes a method of extracting and tracking regions of human face and hands appeared on sequential images considering fusion of color information and tracking region, and obtains three kinds of information based on background color, skin color and its tracking skin regions.
Generation of sketch map image and its instructions to support the understanding of geographical information
3 Citations1996Noboru Babaguchi, Shu Dan +1 more
This paper proposed a method of generating a sketch map drawing and its instructions from a structured data, called the road network, which is a graph augmented by the attributes of roads and crossings.