The Computation and Comparison of Value in Goal-directed Choice

These are not rigid categories, but they provide a useful and reasonable decomposition of decision-making into its composite parts.

Abstract

Value-based decision-making is a complex process that requires, at the very least, the deployment of five basic types of computations. First, a representation of the decision problem needs to be constructed. This entails identifying potential courses of action (e.g., to pursue a prey item or not), as well internal states (e.g., the hunger level) and external states (e.g., the threat level). Second, a value needs to be assigned to the different actions under consideration. In order to make sound decisions, these values need to be aligned with the benefits associated with each action. Third, the valuations are compared in order to make a choice. Fourth, after implementing the decision, the brain needs to measure the desirability of the outcomes that follow. Finally, this feedback is used to update the other processes in order to improve the quality of future decisions. These are not rigid categories, but they provide a useful and reasonable decomposition of decision-making into its composite parts.