Combining Visual Attention, Object Recognition and Associative Information Processing in a NeuroBotic System
Lecture notes in computer sciencePublished 1 January 2005
Rebecca Fay, Ulrich Kaufmann, Andreas Knoblauch, Heiner Markert, Günther Palm
Citations26
SJR quartileQ2
SJR score0.35
SNIP0.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A neurobiologically plausible system on a robot that integrates visual attention, object recognition, language and action processing using a coherent cortex-like architecture based on neural associative memories is implemented.
Abstract
We have implemented a neurobiologically plausible system on a robot that integrates visual attention, object recognition, language and action processing using a coherent cortex-like architecture based on neural associative memories. This system enables the robot to respond to spoken commands like "bot show plum" or "bot put apple to yellow cup". The scenario for this is a robot close to one or two tables carrying certain kinds of fruit and other simple objects. Tasks such as finding and pointing to certain fruits in a complex visual scene according to spoken or typed commands can be demonstrated. This involves parsing and understanding of simple sentences, relating the nouns to concrete objects sensed by the camera, and coordinating motor output with planning and sensory processing.
Keywords
Computer ScienceNeuroscienceEngineering
Proceedings of the National Academy of SciencesNeural networks and physical systems with emergent collective computational abilities.
19,349 Citations1982J. J. Hopfield
A model of a system having a large number of simple equivalent components, based on aspects of neurobiology but readily adapted to integrated circuits, produces a content-addressable memory which correctly yields an entire memory from any subpart of sufficient size.
Choice Reviews OnlineNeural networks for pattern recognition
18,687 Citations1994
This is the first comprehensive treatment of feed-forward neural networks from the perspective of statistical pattern recognition, and is designed as a text, with over 100 exercises, to benefit anyone involved in the fields of neural computation and pattern recognition.
Neural Networks for Pattern Recognition
12,198 Citations1995Chris Bishop
The American Journal of PsychologyThe Organization of Behavior; A Neuropsychological Theory
4,856 Citations1950Fred Attneave, M. B. +1 more
Journal of the American Medical AssociationThe Organization of Behavior: A Neuropsychological Theory
4,240 Citations1950Therese Mahoney, Margaret Halliday +339 more
Complex SystemsRadial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks
3,439 Citations1988David S. Broomhead, David Lowe
The relationship between 'learning' in adaptive layered networks and the fitting of data with high dimensional surfaces is discussed, leading naturally to a picture of 'generalization in terms of interpolation between known data points and suggests a rational approach to the theory of such networks.
Pattern Recognition Principles
3,205 Citations2009
The present work gives an account of basic principles and available techniques for the analysis and design of pattern processing and recognition systems.
Digital Image Processing
1,427 Citations1991Ravi Gupta
Pattern Classification
1,092 Citations2011Ben Gold, Nelson Morgan +1 more
NatureNon-Holographic Associative Memory
1,014 Citations1969David Willshaw, O. Buneman +1 more
The features of a hologram that commend it as a model of associative memory can be improved on by other devices.
Color gamut transform pairs
861 Citations1978Alvy Ray Smith
A set of alternative models of the RGB monitor gamut based on the perceptual variables hue, saturation, and value (V) or brightness (L) are presented and algorithms for transforming between these models are derived.
Neural NetworksThree learning phases for radial-basis-function networks
519 Citations2001Friedhelm Schwenker, Hans A. Kestler +1 more
It can be observed that the performance of RBF classifiers trained with two-phase learning can be improved through a third backpropagation-like training phase of the RBF network, adapting the whole set of parameters (RBF centers, scaling parameters, and output layer weights) simultaneously.
Biological CyberneticsOn associative memory
445 Citations1980G Palm
The information storing capacity of certain associative and auto-associative memories is calculated and the usefulness of associative memories, as opposed to conventional listing memories, is discussed — especially in connection with brain modelling.
BioScienceA Comparative Review On Aggression Konrad Lorenz The Territorial Imperative Robert Ardrey
401 Citations1968Richard D. Alexander, Donald W. Tinkle
The Neuroscience of Language: On Brain Circuits of Words and Serial Order
399 Citations2003Friedemann Pulvermüller
IEEE Transactions on Robotics and AutomationMiro - middleware for mobile robot applications
329 Citations2002Hans Utz, Stefan Sablatnög +2 more
Miro is presented, which meets the aforementioned requirements and has been ported to three different mobile platforms with little effort and provides generic abstract services like localization or behavior engines, which can be applied on different robot platforms with virtually no modifications.
Cambridge University Press eBooksThe Neuroscience of Language
307 Citations2003Friedemann Pulvermüller
Medical Entomology and ZoologyNeural Assemblies: An Alternative Approach to Artificial Intelligence
301 Citations1982G. Palm
This chapter contains some general remarks on organizations and cooperativity and introduces the matchbox algorithm, which is interpreted as an algorithm for survival and thus as a model of an animal.
Sunderland Repository (University of Sunderland)Hybrid neural systems: from simple coupling to fully integrated neural networks
116 Citations1999Kenneth McGarry, Stefan Wermter +1 more
An overview and evaluation of the state of the art of several hybrid neural systems for rule-based processing of neural/symbolic techniques within a hybrid system.
Neural NetworksIterative retrieval of sparsely coded associative memory patterns
92 Citations1996Friedhelm Schwenker, Friedrich T. Sommer +1 more
In a finite size auto-associative memory, iterative retrieval achieves higher capacity and better error correction than one-step retrieval and is shown that in the finite model, binary Hebbian learning exhibits much better performance.
Digitale Bildverarbeitung
87 Citations1997Bernd Jähne
Neural NetworksConnectionist inference models
86 Citations2001Antony Browne, Ron Sun
This paper presents an extended survey of connectionist inference systems, with particular reference to how they perform variable binding and rule-based reasoning and whether they involve distributed or localist representations.
Neural NetworksImproved bidirectional retrieval of sparse patterns stored by Hebbian learning
75 Citations1999Friedrich T. Sommer, Günther Palm
The improved BAM model opens interesting new perspectives in information retrieval it allows efficient data access providing segmentation of ambiguous user input, relevance feedback and relevance ranking, and the implication of this for a more flexible version of Hebbian cell-assemblies.
Neural NetworksPattern separation and synchronization in spiking associative memories and visual areas
66 Citations2001Andreas Knoblauch, Günther Palm
An alternative model is proposed that reproduces experimental findings of synchronized and desynchronized fast oscillations more closely and derives a technical version from the biological associative memory model that accomplishes fast pattern separation parallel in O(log2 n) steps for n neurons and sparse coding.
Informatik aktuellSFB 527: Integration symbolischer und subsymbolischer Informationsverabeitung in adaptiven sensomotorischen Systemen
10 Citations1997G. Palm, Gerhard K. Kraetzschmar
Der Anfang das Jahres an der Universitat Ulm neu eingerichtete Sonderforschungsbereich 527 befast sich with dem Thema Integration symbolischer and subsymbolischer Informationsverabeitung in adaptiven sensomotorischen Systemen.