Minotaurus: A System for Affective Human–Robot Interaction in Smart Environments
Cognitive ComputationPublished 25 October 2014
Juha Röning, Jukka Holappa, Vili Kellokumpu, Antti Tikanmäki, Matti Pietikäinen
Citations18
SJR quartileQ1
SJR score0.84
SNIP1.29
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A distributed system for affective human–robot interaction which combines all the basic sensory elements and can collaborate with a smart environment and obtain further knowledge from the Internet is developed.
Abstract
A service robot should be able to detect and identify the user in order to personalize its services and guarantee security, it should recognize the user's emotions to allow affective interaction, and it should be able to communicate easily with the user and understand given commands by recognizing speech and gestures. Our research is motivated, for example, by the emerging needs of elderly care, health care, safety, and logistics. We have developed a distributed system for affective human–robot interaction which combines all the basic sensory elements and can collaborate with a smart environment and obtain further knowledge from the Internet. The realized HRI robot, Minotaurus, runs in real time and is capable of interacting with human beings. Minotaurus forms a rather generic platform for experimenting with human–robot collaboration in different applications and environments.
Keywords
PsychologyComputer Science
Histograms of Oriented Gradients for Human Detection
31,896 Citations2005Navneet Dalal, Bill Triggs
It is shown experimentally that grids of histograms of oriented gradient (HOG) descriptors significantly outperform existing feature sets for human detection, and the influence of each stage of the computation on performance is studied.
International Journal of Computer VisionRobust Real-Time Face Detection
14,193 Citations2004Paul Viola, Michael Jones
A new image representation called the “Integral Image” is introduced which allows the features used by the detector to be computed very quickly and a method for combining classifiers in a “cascade” which allows background regions of the image to be quickly discarded while spending more computation on promising face-like regions.
IEEE Transactions on Pattern Analysis and Machine IntelligenceFace Description with Local Binary Patterns: Application to Face Recognition
5,606 Citations2006T. Ahonen, Abdenour Hadid +1 more
This paper presents a novel and efficient facial image representation based on local binary pattern (LBP) texture features that is assessed in the face recognition problem under different challenges.
PsycEXTRA DatasetAffective computing
5,051 Citations1997Rosalind W. Picard
Key issues in affective computing, " computing that relates to, arises from, or influences emotions", are presented and new applications are presented for computer-assisted learning, perceptual information retrieval, arts and entertainment, and human health and interaction.
Real-time human pose recognition in parts from single depth images
3,508 Citations2011Jamie Shotton, Andrew Fitzgibbon +6 more
Robotics and Autonomous SystemsA survey of robot learning from demonstration
3,256 Citations2008Brenna Argall, Sonia Chernova +2 more
A comprehensive survey of robot Learning from Demonstration (LfD), a technique that develops policies from example state to action mappings, which analyzes and categorizes the multiple ways in which examples are gathered, as well as the various techniques for policy derivation.
IEEE Transactions on Pattern Analysis and Machine IntelligenceDynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
2,820 Citations2007Guoying Zhao, Matti Pietikäinen
IEEE Transactions on Image ProcessingEnhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions
2,806 Citations2010Xiaoyang Tan, Bill Triggs
IEEE Transactions on Pattern Analysis and Machine IntelligenceA Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
2,727 Citations2008Zhihong Zeng, Maja Pantić +2 more
IEEE Transactions on Robotics and AutomationThe vector field histogram-fast obstacle avoidance for mobile robots
2,282 Citations1991J. Borenstein, Yoram Koren
A real-time obstacle avoidance method for mobile robots which has been developed and implemented, named the vector field histogram (VFH), permits the detection of unknown obstacles and avoids collisions while simultaneously steering the mobile robot toward the target.
Communications of the ACMReal-time human pose recognition in parts from single depth images
2,053 Citations2013Jamie Shotton, Toby Sharp +6 more
This work takes an object recognition approach, designing an intermediate body parts representation that maps the difficult pose estimation problem into a simpler per-pixel classification problem, and generates confidence-scored 3D proposals of several body joints by reprojecting the classification result and finding local modes.
Computer Vision and Image UnderstandingMultimodal human–computer interaction: A survey
958 Citations2007Alejandro Jaimes, Nicu Sebe
International Journal of Social RoboticsSocial Robots for Long-Term Interaction: A Survey
841 Citations2013Iolanda Leite, Carlos Martinho +1 more
The main features of these robots are described and the main findings of the existing long-term studies are highlighted to highlight a set of directions for future research.
Human-Computer InteractionInteractive Robots as Social Partners and Peer Tutors for Children: A Field Trial
702 Citations2004Takayuki Kanda, Takayuki Hirano +2 more
Pocketsphinx: A Free, Real-Time Continuous Speech Recognition System for Hand-Held Devices
447 Citations2006David Huggins-Daines, Mohit Kumar +4 more
This paper presents a preliminary case study on the porting and optimization of CMU Sphinx-11, a popular open source large vocabulary continuous speech recognition (LVCSR) system, to hand-held devices, and is believed to be the firsthand-held LVCSR system available under an open-source license.
Proceedings of the British Machine Vision Conference 2021
393 Citations2021Nasir Rajpoot, Abhir Bhalerao
The British Machine Vision Conference is the main UK conference on machine vision and related areas and was held on 10-13 September 2007 at the University of Warwick, UK.
Autonomous RobotsHERB: a home exploring robotic butler
310 Citations2009Siddhartha S Srinivasa, Dave Ferguson +8 more
New algorithms for searching for objects, learning to navigate in cluttered dynamic indoor scenes, recognizing and registering objects accurately in high clutter using vision, manipulating doors and other constrained objects using caging grasps, grasp planning and execution in clutter, and manipulation on pose and torque constraint manifolds are presented.
Learning generative texture models with extended Fields-of-Experts
278 Citations2009Nicolas Heess, Christopher K. I. Williams +1 more
This work proposes an extended version of the Field-of-Experts (FoE) (allowing for bimodal potentials) and demonstrates that this novel formulation gives rise to a more powerful generative model of specific visual structure that produces significantly better results for the texture task.
Proceedings of the IEEEDevelopment and evaluation of interactive humanoid robots
264 Citations2004Takayuki Kanda, Hiroshi Ishiguro +2 more
A humanoid robot that autonomously interacts with humans by speaking and gesturing is developed that communicates with humans and is designed to participate in human society as a partner and suggests a new analytical approach to human-robot interaction.
Industrial Robot the international journal of robotics research and applicationRobovie: an interactive humanoid robot
261 Citations2001Hiroshi Ishiguro, Tetsuo Ono +4 more
Two important ideas in human‐robot communication through research from the viewpoint of cognitive science have been obtained – one is importance of physical expressions using the body and the other is the effectiveness of the robot’s autonomy in the robots utterance recognition by humans.
Robotics and Autonomous SystemsAffective social robots
244 Citations2009Rachel Kirby, Jodi Forlizzi +1 more
This generative model attempts to create natural, human-like affect and includes distinctions between immediate emotional responses, the overall mood of the robot, and long-term attitudes toward each visitor to the robot, with a focus on developing long-term human-robot relationships.
Proceedings - IEEE International Conference on Robotics and Automation/ProceedingsParticle RRT for Path Planning with Uncertainty
229 Citations2007Nik A. Melchior, Reid Simmons
A new extension to the rapidly-exploring random tree (RRT) path planning algorithm that explicitly considers uncertainty in its domain, similar to the operation of a particle filter.
Human Activity Recognition Using a Dynamic Texture Based Method
164 Citations2008Paul Crook, Vili Kellokumpu +2 more
The method uses dynamic texture descriptors to describe human movements in a spatiotemporal way and works on image data rather than silhouettes, following recent trends in computer vision research.
IEEE Intelligent SystemsInteractive Humanoid Robots for a Science Museum
163 Citations2007Masahiro Shiomi, Takayuki Kanda +2 more
Communications of the ACMPerceptual user interfaces (introduction)
163 Citations2000Matthew Turk, George Robertson
IEEE Transactions on RoboticsAdapting Robot Behavior for Human--Robot Interaction
156 Citations2008Noriaki Mitsunaga, Christian Smith +3 more
An adaptation mechanism based on reinforcement learning that reads subconscious body signals from a human partner, and uses this information to adjust interaction distances, gaze meeting, and motion speed and timing in human-robot interactions is proposed.
IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)Survey of Non-facial/Non-verbal Affective Expressions for Appearance-Constrained Robots
153 Citations2007Cindy L. Bethel, Robin R. Murphy
This correspondence identifies five main methods of non-facial and non-verbal affective expression and ranks their effectiveness for appearance-constrained robots operating within the intimate, personal, and social proximity zones of a human corresponding to interagent distances of approximately 3 m or less.
Proceedings of the IEEEHerb 2.0: Lessons Learned From Developing a Mobile Manipulator for the Home
126 Citations2012Siddhartha S Srinivasa, Dmitry Berenson +9 more
Some of the structure present in everyday environments that Herb 2.0 has been able to harness for manipulation and interaction are revealed and some of the lessons learned from extensively testing the integrated platform in kitchen and office environments are described.
Lecture notes in computer scienceMultimodal Human Computer Interaction: A Survey
115 Citations2005Alejandro Jaimes, Nicu Sebe
This paper focuses on body, gesture, gaze, and affective interaction (facial expression recognition, and emotion in audio) in multimodal human computer interaction from a computer vision perspective.
Perceptual User Interfaces
110 Citations2001Matthew Turk
This chapter describes the emerging Perceptual User Interfaces field and then reports on three PUI-motivated projects: computer vision-based techniques to visually perceive relevant information about the user, and three projects to accommodate a wider range of scenarios, tasks, users and preferences.
Qualitative SociologyUnspoken Diversity: Cultural Differences in Gestures
95 Citations1997Dane Archer
Magnetic field-based SLAM method for solving the localization problem in mobile robot floor-cleaning task
88 Citations2011Ilari Vallivaara, Janne Haverinen +2 more
The method can be used to acquire maps that are accurate enough to be utilized in the robot coverage problem, thus reducing over-cleaning and the minimalistic sensory requirements of the method make it a very viable alternative for low-cost domestic robots.
Simultaneous localization and mapping using ambient magnetic field
84 Citations2010Ilari Vallivaara, Janne Haverinen +2 more
The proposed approach provides a simple, low-cost, and space-efficient solution for solving the SLAM problem present in many domestic and swarm robotics application domains.
Lecture notes in computer scienceElderly Users in Ambient Intelligence: Does an Avatar Improve the Interaction?
61 Citations2007Amalia Ortiz, María del Puy Carretero +5 more
It is concluded that virtual characters could improve the interaction between elderly people and machines, but this would depend greatly on the request task.
Age Classification in Unconstrained Conditions Using LBP Variants
41 Citations2016Juha Ylioinas, Abdenour Hadid
This paper proposes a novel method for age classification in unconstrained conditions and provides extensive performance evaluation on benchmark datasets with standard protocols, thus allowing a fair comparison and an easy reproduction of the results.
IEEE Transactions on Circuits and Systems for Video TechnologyAn Image-Based Visual Speech Animation System
35 Citations2012Ziheng Zhou, Guoying Zhao +2 more
An image-based visual speech animation system that represents a video sequence by a low-dimensional continuous curve embedded in a path graph and establishes a map from the curve to the image domain to preserve the video dynamics of a talking face.
Lecture notes in computer scienceCombining Contrast Information and Local Binary Patterns for Gender Classification
28 Citations2011Juha Ylioinas, Abdenour Hadid +1 more
A new facial representation is investigated which combines both measures and extensively evaluate the proposed representation on the gender classification problem, showing interesting results.
Optics LettersParticle RRT for Path Planning in Very Rough Terrain
13 Citations2007Nik A. Melchior, Jun-young Kwak
The photoluminescence enhancement by the LSPR effect through adjusting the thickness of silica shell and the Ag@SiO2 NP concentration is proposed and a metal-enhanced Bi-2-S-3-sub quantum dot (QD) fluorescence system may have promising applications in optoelectronic device.
Asia-Pacific Signal and Information Processing Association Annual Summit and ConferenceA spoken dialogue system using virtual conversational agent with augmented reality
10 Citations2012Shinji Miyake, Akinori Ito
A spoken dialogue system using virtual conversational agent with augmented reality that shows better response accuracy than the system without agents and increased user's feeling of vividness of conversation and easiness to talk to the system.