Autonomous Agents and Ethical Decision-Making
Cognitive ComputationPublished 19 October 2015
José-Antonio Cervantes, Luis-Felipe Rodríguez, Sonia López, Félix Ramos, Francisco Robles
Citations34
SJR quartileQ1
SJR score0.84
SNIP1.29
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The proposed model implements a mechanism for integrating the results of diverse assessments into a unique cue, and takes into account the agent’s preferences, good and bad past experiences, ethical rules, and current emotional state as the main factors involved in choosing the most appropriate option.
Abstract
Machine ethics, also known as artificial morality, is a newly emerging field concerned with ensuring appropriate behavior of machines toward humans and other machines. In this article, we discuss the importance of machine ethics and present a computational model of ethical decision-making for autonomous agents. The proposed model implements a mechanism for integrating the results of diverse assessments into a unique cue, and takes into account the agent's preferences, good and bad past experiences, ethical rules, and current emotional state as the main factors involved in choosing the most appropriate option. The design of the model is based on theories and models developed in fields such as neuroscience, psychology, artificial intelligence, and cognitive informatics. In particular, the model attempts to emulate neural mechanisms of the human brain involved in ethical decision-making.
Keywords
Social SciencesNeuroscience
Annual Review of NeuroscienceAn Integrative Theory of Prefrontal Cortex Function
12,795 Citations2001Earl K. Miller, Jonathan D. Cohen
It is proposed that cognitive control stems from the active maintenance of patterns of activity in the prefrontal cortex that represent goals and the means to achieve them, which provide bias signals to other brain structures whose net effect is to guide the flow of activity along neural pathways that establish the proper mappings between inputs, internal states, and outputs needed to perform a given task.
American Journal of SociologyEmotion Work, Feeling Rules, and Social Structure
5,559 Citations1979Arlie Russell Hochschild
Cognitive Brain ResearchPremotor cortex and the recognition of motor actions
4,748 Citations1996Giacomo Rizzolatti, Luciano Fadiga +2 more
It is suggested that the development of the lateral verbal communication system in man derives from a more ancient communication system based on recognition of hand and face gestures.
Annual Review of NeuroscienceThe Neural Basis of Decision Making
4,002 Citations2007Joshua I. Gold, Michael N. Shadlen
This work focuses on simple decisions that can be studied in the laboratory but emphasize general principles likely to extend to other settings, including deliberation and commitment.
Cambridge University Press eBooksRATIONAL CHOICE AND THE FRAMING OF DECISIONS
3,771 Citations1988Amos Tversky, Daniel Kahneman
Cerebral CortexEmotion, Decision Making and the Orbitofrontal Cortex
3,533 Citations2000Antoine Bechara
The somatic marker hypothesis provides a systems-level neuroanatomical and cognitive framework for decisionMaking and the influence on it by emotion and the relationship between emotion, decision making and other cognitive functions of the frontal lobe, namely working memory is reviewed.
Psychological BulletinMood and judgment: The affect infusion model (AIM).
3,197 Citations1995Joseph P. Forgas
A new integrative theory, the affect infusion model (AIM), is proposed as a comprehensive explanation of these effects of affective states in social judgments, and predicts that judgments requiring heuristic or substantive processing are more likely to be infused by affect than are direct access or motivated judgments.
Robotics and Autonomous SystemsA survey of socially interactive robots
3,060 Citations2003Terrence Fong, Illah Nourbakhsh +1 more
The context for socially interactive robots is discussed, emphasizing the relationship to other research fields and the different forms of “social robots”, and a taxonomy of design methods and system components used to build socially interactive Robots is presented.
Philosophical Transactions of the Royal Society B Biological SciencesThe somatic marker hypothesis and the possible functions of the prefrontal cortex
2,808 Citations1996António R. Damásio
The hypothesis rejects attempts to limit human reasoning and decision making to mechanisms relying, in an exclusive and unrelated manner, on either conditioning alone or cognition alone.
NeuronThe Neural Bases of Cognitive Conflict and Control in Moral Judgment
2,640 Citations2004Joshua D. Greene, Leigh E. Nystrom +3 more
The present results indicate that brain regions associated with abstract reasoning and cognitive control are recruited to resolve difficult personal moral dilemmas in which utilitarian values require "personal" moral violations, violations that have previously been associated with increased activity in emotion-related brain regions.
Journal of MacromarketingA General Theory of Marketing Ethics
2,585 Citations1986Shelby D. Hunt, Scott J. Vitell
Artificial IntelligenceSOAR: An architecture for general intelligence
2,396 Citations1987John E. Laird, Allen Newell +1 more
SOAR, an implemented proposal for a foundation for a system capable of general intelligent behavior, is presented and its organizational principles, the system as currently implemented, and demonstrations of its capabilities are described.
Nature reviews. NeuroscienceThe human orbitofrontal cortex: linking reward to hedonic experience
2,155 Citations2005Morten L. Kringelbach
The functional neuroanatomy of the human orbitofrontal cortex is described and a new integrated model of its functions proposed, including a possible role in the mediation of hedonic experience.
The prefrontal cortex
2,099 Citations1997Joaquı́n M. Fuster
The Prefrontal Cortex, Fifth Edition, provides users with a thoroughly updated version of this comprehensive work that has historically served as the classic reference on this part of the brain.
Psychological ReviewAre there basic emotions?
2,066 Citations1992Paul Ekman
The evidence on universals in expression and in physiology strongly suggests that there is a biological basis to the emotions that have been studied and the utility of the basic emotions approach is shown in terms of the research it has generated.
Nature NeuroscienceAbstract reward and punishment representations in the human orbitofrontal cortex
2,031 Citations2001John P. O’Doherty, Morten L. Kringelbach +3 more
Findings indicate that one emotional involvement of the human orbitofrontal cortex is its representation of the magnitudes of abstract rewards and punishments, such as receiving or losing money.
Basic Emotions
2,012 Citations1999Paul Ekman
The development of Honda humanoid robot
1,925 Citations2002Kazuo Hirai, Masato Hirose +2 more
Due to its unique posture stability control, the Honda humanoid robot is able to maintain its balance despite unexpected complications such as uneven ground surfaces and to perform simple operations via wireless teleoperation.
ScienceThe Neural Basis of Loss Aversion in Decision-Making Under Risk
1,759 Citations2007Sabrina M. Tom, Craig R. Fox +2 more
Investigation of neural correlates of loss aversion while individuals decided whether to accept or reject gambles that offered a 50/50 chance of gaining or losing money predicted individual differences in behavioral loss aversion.
Journal of MarketingA Contingency Framework for Understanding Ethical Decision Making in Marketing
1,743 Citations1985O. C. Ferrell, Larry G. Gresham
American Journal of PsychiatryDevelopmental Neurocircuitry of Motivation in Adolescence: A Critical Period of Addiction Vulnerability
1,706 Citations2003R. Andrew Chambers, Jane R. Taylor +1 more
An exploration of developmental changes in neurocircuitry involved in impulse control has significant implications for understanding adolescent behavior, addiction vulnerability, and the prevention of addiction in adolescence and adulthood.
ScienceFrames, Biases, and Rational Decision-Making in the Human Brain
1,604 Citations2006Benedetto De Martino, Dharshan Kumaran +2 more
It is found that the framing effect was specifically associated with amygdala activity, suggesting a key role for an emotional system in mediating decision biases and how the brain may modulate the effect of these biasing influences to approximate rationality.
Cerebral CortexThe Orbitofrontal Cortex and Reward
1,584 Citations2000Edmund T. Rolls
Evidence shows that the orbitofrontal cortex is involved in decoding and representing some primary reinforcers such as taste and touch; in learning and reversing associations of visual and other stimuli to these primary rein forcers; and in controlling and correcting reward-related and punishment-related behavior, and thus in emotion.
Current Opinion in NeurobiologyReward representations and reward-related learning in the human brain: insights from neuroimaging
1,423 Citations2004John P. O’Doherty
This review outlines recent findings from human neuroimaging concerning the role of a highly interconnected network of brain areas including orbital and medial prefrontal cortex, amygdala, striatum and dopaminergic mid-brain in reward processing.
Journal of Business EthicsA Review of The Empirical Ethical Decision-Making Literature: 1996–2003
1,402 Citations2005Michael J. O’Fallon, Kenneth D. Butterfield
Cerebral CortexAddiction, a Disease of Compulsion and Drive: Involvement of the Orbitofrontal Cortex
1,248 Citations2000Nora D. Volkow
Journal of Business EthicsEthical decision making: A review of the empirical literature
1,219 Citations1994Robert C. Ford, Woodrow D. Richardson
Brain and CognitionThe role of emotion in decision-making: Evidence from neurological patients with orbitofrontal damage
1,148 Citations2004Antoine Bechara
Evidence is reviewed in support of "The Somatic Marker Hypothesis", which provides a systems-level neuroanatomical and cognitive framework for decision-making and suggests that the process of decision- making depends in many important ways on neural substrates that regulate homeostasis, emotion, and feeling.
The MIT Press eBooksThe Soar Cognitive Architecture
1,067 Citations2012John E. Laird
This book offers the definitive presentation of Soar from theoretical and practical perspectives, providing comprehensive descriptions of fundamental aspects and new components, and proposes requirements for general cognitive architectures and explicitly evaluates how well Soar meets those requirements.
Nature NeuroscienceOptimal decision making and the anterior cingulate cortex
976 Citations2006Steven W. Kennerley, Mark E. Walton +3 more
It is demonstrated that the ACC's critical role in reinforcement-guided behavior is neither in detecting nor in correcting errors, but in guiding voluntary choices based on the history of actions and outcomes.
Robotics and Autonomous SystemsToward sociable robots
945 Citations2003Cynthia Breazeal
This paper explores the topic of social robots—the class of robots that people anthropomorphize in order to interact with them and identifies four such classes: socially evocative, social interface, socially receptive, and sociable.
Cerebral CortexReward Processing in Primate Orbitofrontal Cortex and Basal Ganglia
943 Citations2000W Schultz
The investigated cortical and basal ganglia structures showed multiple, heterogeneous, partly simultaneous activations which were related to specific aspects of rewards, which suggest an access to central representations of rewards which may be used for the neuronal control of goaldirected behavior.
Annual Review of NeuroscienceOrbitofrontal Cortex and Its Contribution to Decision-Making
927 Citations2007Joni D. Wallis
Brain Research BulletinThe cortico-basal ganglia integrative network: The role of the thalamus
715 Citations2008Suzanne N. Haber, Roberta Calzavara
The thalamus may serve as an important center of integration of networks that underlie the ability to modulate behaviors through non-reciprocal connections between the striatum and substantia nigra and within "hot spots" of convergence between corticostriatal projections from different functional regions.
Journal of Business EthicsThe effects of culture on ethical decision-making: An application of Hofstede's typology
655 Citations1993Scott J. Vitell, Saviour L. S. Nwachukwu +1 more
Journal of MarketingA Contingency Framework for Understanding Ethical Decision Making in Marketing
632 Citations1985O. C. Ferrell, Larry G. Gresham
Biological PsychiatryNeurobiology of Decision Making: A Selective Review from a Neurocognitive and Clinical Perspective
553 Citations2005Monique Ernst, Martin P. Paulus
A temporal map of key processes that occur during decision making is presented, which consists of three stages: formation of preferences among options, selection and execution of an action, and experience or evaluation of an outcome.
Biological PsychiatryDistinct portions of anterior cingulate cortex and medial prefrontal cortex are activated by reward processing in separable phases of decision-making cognition
401 Citations2004Robert D. Rogers, Narender Ramnani +5 more
Neural activity within the medial and lateral orbitofrontal cortex, pregenual ACC, and striatum mediate distinct representations of reward-related information that are deployed at different stages during a decision-making episode.
Journal of Cognitive NeuroscienceConsequences, Action, and Intention as Factors in Moral Judgments: An fMRI Investigation
357 Citations2006Jana Schaich Borg, Catherine A. Hynes +3 more
Functional magnetic resonance imaging findings suggest that different kinds of moral judgment are preferentially supported by distinguishable brain systems.
Journal of Experimental & Theoretical Artificial IntelligenceProlegomena to any future artificial moral agent
309 Citations2000Colin Allen, Gary Varner +1 more
The ethical disputes are surveyed, the possibility of a ‘moral Turing Test’ is considered and the computational difficulties accompanying the different types of approach are assessed.
IEEE Intelligent SystemsCreating an Ambient-Intelligence Environment Using Embedded Agents
297 Citations2004Hani Hagras, Vic Callaghan +4 more
This work developed the Essex intelligent dormitory, or iDorm, as a test bed for this work, and an exemplar of this approach, to provide online, lifelong, personalized learning of anticipatory adaptive control to realize the ambient-intelligence vision in ubiquitous-computing environments.
Advanced RoboticsiCub: the design and realization of an open humanoid platform for cognitive and neuroscience research
277 Citations2007Nikos G. Tsagarakis, Giorgio Metta +9 more
The design of the mechanisms and structures forming the basic 'body' of the iCub are described and kinematic structures dynamic design criteria, actuator specification and selection, and detailed mechanical and electronic design are considered.
Topics in Cognitive ScienceMoral Satisficing: Rethinking Moral Behavior as Bounded Rationality
268 Citations2010Gerd Gigerenzer
Only by accepting the fact that behavior is a function of both mind and environmental structures can realistic prescriptive means of achieving moral goals be developed.
NatureIntegration of target and body-part information in the premotor cortex when planning action
252 Citations2000Eiji Hoshi, Jun Tanji
The lateral sector of the dorsal premotor cortex is known to receive both visual and somatosensory input, and it is shown here that neurons in this area gather information about both the target and the body part, while subsequent activity specifies the planned action.
ACR North American AdvancesThe Neural Basis of Loss Aversion in Decision-Making Under Risk
239 Citations2008Sabrina M. Tom, Craig R. Fox +2 more
Cognition & EmotionEffects of negative mood states on risk in everyday decision making
222 Citations2000G. Robert J. Hockey, A. John Maule +2 more
Journal of Business EthicsThe Effects of Cultural Dimensions on Ethical Decision Making in Marketing: An Exploratory Study
213 Citations1999Long-Chuan Lu, Gregory M. Rose +1 more
International Journal of Cognitive Informatics and Natural IntelligenceRTPA
159 Citations2008Yingxu Wang
Real-time process algebra (RTPA) is a denotational mathematical structure for denoting and manipulating system behavioral processes for intelligent and software system modeling, specification, refinement, and implementation.
AI & SocietyMachine morality: bottom-up and top-down approaches for modelling human moral faculties
154 Citations2007Wendell Wallach, Colin Allen +1 more
The value and limitations inherent in the architectures for morally intelligent agents fall within two broad approaches: the top-down imposition of ethical theories, and the bottom-up building of systems that aim at goals or standards which may or may not be specified in explicitly theoretical terms.
Neural NetworksAn architectural model of conscious and unconscious brain functions: Global Workspace Theory and IDA
148 Citations2007Bernard J. Baars, Stan Franklin
This work describes a "hybrid" cognitive architecture that is implementable in neuronal nets, and which has uniform brainlike features, including activation-passing and highly distributed "codelets," implementable as small-scale neural nets.
Review of Political EconomyBeyond Utilitarianism and Deontology: Ethics in Economics
142 Citations2007Irene van Staveren
Topics in Cognitive ScienceA Conceptual and Computational Model of Moral Decision Making in Human and Artificial Agents
122 Citations2010Wendell Wallach, Stan Franklin +1 more
This study discusses how LIDA, an AGI model of human cognition, can be adapted to model both affective and rational features of moral decision making and describes how the LIDA model helps integrate emotions into the human decision-making process.
Ethics and Information TechnologyRobot minds and human ethics: the need for a comprehensive model of moral decision making
118 Citations2010Wendell Wallach
Working through methods for building AMAs will have a profound effect in deepening an appreciation for the many mechanisms that contribute to a moral acumen, and the manner in which these mechanisms work together.
Journal of NeurophysiologyArea-Selective Neuronal Activity in the Dorsolateral Prefrontal Cortex for Information Retrieval and Action Planning
116 Citations2004Eiji Hoshi, Jun Tanji
Sensorimotor transformations in the dorsolateral PFC appear to be time-variant and region-selective.
European Journal of NeuroscienceOrbitofrontal involvement in the processing of unpleasant auditory information
111 Citations2000Stephen Frey, Penelope Kostopoulos +1 more
The results indicated that the caudal orbitofrontal cortex, area 13, which is powerfully linked to the medial temporal limbic region and is involved in the regulation of autonomic responses, is a key part of the frontal cortex responding in the face of unpleasant incoming information.
Cognitive ComputationAutonomous Driver Based on an Intelligent System of Decision-Making
97 Citations2015Michał Czubenko, Zdzisław Kowalczuk +1 more
It proves that the xDriver system may behave on the road as a very inexperienced driver, as well as presenting some results of simulation.
International Journal of Cognitive Informatics and Natural IntelligenceInference Algebra (IA)
92 Citations2011Yingxu Wang
Cerebral CortexDevelopment of Inferior Temporal Cortex in the Monkey
80 Citations1994Hillary R. Rodman
It is suggested that IT undergoes an extended period of postnatal development, during which both visual experience and the maturation of other brain structures may contribute to the emergence of mechanisms of pattern recognition within IT.
Brain Research ReviewsNeural circuitry of judgment and decision mechanisms
79 Citations2005Ioan Opriş, Charles J. Bruce
A systems neuroscience approach is shown of the visual saccade decision circuit and the interaction between its components during decision formation and links between sensory input and behavioral output responsible for response selection are shown.
International Journal of Cognitive Informatics and Natural IntelligenceOn the Cognitive Processes of Human Perception with Emotions, Motivations, and Attitudes
79 Citations2007Yingxu Wang
This work is the detailed description of a part of the layered reference model of the brain (LRMB) that provides a comprehensive model for explaining the fundamental cognitive processes of the head and their interactions.
Cambridge University Press eBooksAn Integrated Reasoning Approach to Moral Decision Making
77 Citations2011Morteza Dehghani, Ken Forbus +2 more
Psychology of sport and exerciseNon-consciously controlled decision making for fast motor reactions in sports—A priming approach for motor responses to non-consciously perceived movement features
65 Citations2006Armin Kibele
It is assumed that rapid motor reactions are primed by the perception of non-consciously represented movement features embedded in the movement sequences of sports partners, and a two-stage process is suggested to describe the acquisition and the execution of the reported motor reaction behavior.
Lecture notes in computer scienceThe LIDA Framework as a General Tool for AGI
65 Citations2011Javier Snaider, Ryan J. McCall +1 more
The LIDA framework is described, a customizable implementation of the LIDA model of cognition, and it is argued that its characteristics make it suitable for wider use in developing AGI cognitive architectures.
Journal of Experimental Social PsychologyShould I save or should I not kill? How people solve moral dilemmas depends on which rule is most accessible
56 Citations2011R. Broeders, Kees van den Bos +2 more
Social Choice and WelfareA theory of prudential values and a rule utilitarian theory of morality
52 Citations1995JohnC. Harsanyi
International Journal of Cognitive Informatics and Natural IntelligenceInference Algebra (IA)
49 Citations2012Yingxu Wang
A novel denotational mathematical means for formal inferences known as Inference Algebra IA is presented, structured as a set of algebraic operators on aSet of formal causations.
Cognitive ComputationAffective Robotics: Modelling and Testing Cultural Prototypes
48 Citations2014Paul Wilson, Barbara Lewandowska‐Tomaszczyk
The intra-linguistic differences that were found in the profile of emotion features suggest that weightings based on this profile can be used in robotic modelling to create emotion-sensitive socially interacting robots.
NeuropsychologiaTwo networks involved in producing and realizing plans
39 Citations2012Cristiano Crescentini, Shima Seyed‐Allaei +2 more
AI & SocietyImplementing moral decision making faculties in computers and robots
39 Citations2007Wendell Wallach
This paper will offer a brief overview of the many dimensions of this new field of inquiry, including machine ethics, machine morality, artificial morality, or computational morality.
IEEE International Conference on Cognitive InformaticsFormal description of the cognitive process of decision making
38 Citations2004Yingxu Wang, Liu Dong +1 more
Formal description of the cognitive process of decision making
37 Citations2004Yingxu Wang, Dong Liu +1 more
This paper presents a decision making process on the basis of the layered reference model of the brain (LRMB), which is modeled as a sequence of Cartesian-product based selections and a rigorous description of the decision process in real-time process algebra (RTPA).
Cambridge University Press eBooksCognitive Agents Interacting in Real and Virtual Worlds
35 Citations2005Bradley J. Best, Christian Lebière
This chapter describes a unified approach to developing ACT-R agents for these environments that takes advantage of the synergies presented by these environments.
Behaviour and Information TechnologySmall group decision-making in face-to-face and computer-mediated environments: the role of personality
34 Citations2003Andrew Thatcher, Anthony De La Cour
It is suggested that personality plays a minor role in differentiating between the media conditions and repeated measures ANOVAs across the outcome dimensions and the psychological type scores.
Journal of Artificial General IntelligenceConceptual Commitments of the LIDA Model of Cognition
32 Citations2013Stan Franklin, Steve Strain +2 more
The intention is to initiate a discussion among AGI researchers about which conceptual commitments are essential, or particularly useful, toward creating AGI agents, and to describe the hypotheses underlying one such model, the Learning Intelligent Distribution Agent (LIDA) Model.
An artificial neural network approach for creating an ethical artificial agent
27 Citations2009Ali Reza Honarvar, Nasser Ghasem-Aghaee
An artificial neutral network which considered various effective factors for ethical assessment of an action to determine that if a behavior or an action is ethically permissible or not is integrated to the BDI-Agent model.
University of Zagreb University Computing Centre (SRCE)Rationality and Emotions in Decision Making
21 Citations2009Olga Markič
Cognitive ComputationMinotaurus: A System for Affective Human–Robot Interaction in Smart Environments
18 Citations2014Juha Röning, Jukka Holappa +3 more
A distributed system for affective human–robot interaction which combines all the basic sensory elements and can collaborate with a smart environment and obtain further knowledge from the Internet is developed.
Lecture notes in computer scienceCasuist BDI-Agent: A New Extended BDI Architecture with the Capability of Ethical Reasoning
15 Citations2009Ali Reza Honarvar, Nasser Ghasem-Aghaee
Casuist BDI-Agent architecture is proposed which extends the power of BDI architecture and combines CBR method in AI and bottom up casuist approach in ethics in order to add capability of ethical reasoning to B DI-Agent.
International Journal of Software Science and Computational IntelligenceCognitive Computational Models of Emotions and Affective Behaviors
12 Citations2012Luis-Felipe Rodríguez, Félix Ramos +1 more
How cognitive models serve as the theoretical basis of computational models of emotions is explored, which leads to the machine simulated emotions for cognitive robots and autonomous agent systems in cognitive informatics and cognitive computing.
A novel decision grid theory for dynamic decision making
10 Citations2005Yingxu Wang
A new decision and operation theory, known as the decision grid, for modeling and supporting dynamic and serial decision making, is introduced and the properties of decision grids are rigorously described.
Context-Sensitive Ecosystem of Intelligent Environments
3 Citations2012Rodolfo Ostos, Francisco J. Cervantes +3 more
An agent-based architecture to create an ecosystem of Intelligent Environments that takes into account the changing needs of the environment's dwellers, that is, the IE is sensitive to the context, and it allows the user to move among the ecosystem's elements freely.
Decision Making for Agent Moral Conducts
3 Citations2010Hélder Coelho, António Carlos da Rocha +1 more
The proposal of a new architecture is supported on the clarification of the organization and structure of an agent, ie.
…