INCENTIVE THEORY: IV. MAGNITUDE OF REWARD
Journal of the Experimental Analysis of BehaviorPublished 1 May 1985Open access
Peter R. Killeen
Citations112
SJR quartileQ2
SJR score0.94
SNIP0.97
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Incentive theory is successfully applied to data from experiments in which the amount of food reward is varied. This is accomplished by assuming that incentive value is a negatively accelerated function of reward duration. The interaction of the magnitude of a reward with its delay is confirmed, and the causes and implications of this interaction are discussed.
Keywords
Psychology
Journal of the Experimental Analysis of BehaviorON TWO TYPES OF DEVIATION FROM THE MATCHING LAW: BIAS AND UNDERMATCHING<sup>1</sup>
1,462 Citations1974William M. Baum
The generalized matching law predicts that bias should take this form (adding a constant proportion of responding to the favored alternative) and data from a variety of experiments indicate that it generally does.
Journal of the Experimental Analysis of BehaviorCHOICE AND RATE OF REINFORCEMENT<sup>1,</sup><sup>2</sup>
511 Citations1969Edmund Fantino
Journal of the Experimental Analysis of BehaviorINCENTIVE THEORY: II. MODELS FOR CHOICE
177 Citations1982Peter R. Killeen
Journal of the Experimental Analysis of BehaviorEFFECTS OF REINFORCEMENT MAGNITUDE ON CHOICE AND RATE OF RESPONDING<sup>1</sup>
162 Citations1967Allen Neuringer
The present work attempted to analyze this disparity by comparing, in a single experimental situation, a pigeon's choices with its response rates, and found that choices varied directly with reinforcement duration, rates of responding were comparatively insensitive to duration changes.
Journal of the Experimental Analysis of BehaviorCHOICE BETWEEN REWARDS DIFFERING IN AMOUNT AND DELAY: TOWARD A CHOICE MODEL OF SELF CONTROL
154 Citations1980Leonard Green, Mark Snyderman
Journal of Experimental Psychology Animal Behavior ProcessesStimulus and response contingencies in the misbehavior of rats.
147 Citations1982William Timberlake, Glenda Wahl +1 more
In general, misbehavior was affected by both stimulus- and response-reward contingencies but showed characteristic organization and topography under both types of contingency.
Journal of the Experimental Analysis of BehaviorREINFORCER EFFECTIVENESS AS A FUNCTION OF REINFORCER RATE AND MAGNITUDE: A COMPARISON OF CONCURRENT PERFORMANCES<sup>1</sup>
126 Citations1973John W. Schneider
Pigeons' pecks on each of two concurrently available response keys were reinforced under a variable-interval schedule that sometimes allotted food-pellet deliveries to one key and sometimes to the other.
Journal of the Experimental Analysis of BehaviorINTERACTION OF FREQUENCY AND MAGNITUDE OF REINFORCEMENT ON CONCURRENT PERFORMANCES<sup>1</sup>
118 Citations1973João Cláudio Todorov
Journal of the Experimental Analysis of BehaviorTHE MATCHING LAW
116 Citations1972Peter R. Killeen
The theoretical matching law is but one of many possible ways to define utility, and it may eventually be rejected in favor of a more useful definition.
Journal of the Experimental Analysis of BehaviorCHOICE BEHAVIOR OF RATS IN A CONCURRENT‐CHAINS SCHEDULE: AMOUNT AND DELAY OF REINFORCEMENT
107 Citations1982Masato Ito, Kazue Asaki
Journal of the Experimental Analysis of BehaviorEFFECTS OF REINFORCEMENT MAGNITUDE ON INTERVAL AND RATIO SCHEDULES<sup>1</sup>
104 Citations1974C. Fergus Lowe, Graham C. L. Davey +1 more
The major effect of increasing the reinforcement magnitude was in determining the duration of the following postreinforcement pause, and changes in the response rate reflected this main effect.
Journal of the Experimental Analysis of BehaviorCONFIRMATION OF LINEAR SYSTEM THEORY PREDICTION: CHANGES IN HERRNSTEIN'S k AS A FUNCTION OF CHANGES IN REINFORCER MAGNITUDE
102 Citations1984J. J. McDowell, Helena M. Wood
For all subjects, the y-asymptote of the hyperbola increased with increasing reinforcer magnitude and its reciprocal was a linear function of the reciprocal of reinforcement magnitude.
Journal of the Experimental Analysis of BehaviorCHOICE BEHAVIOR AND THE ACCESSIBILITY OF THE REINFORCER<sup>1</sup>
98 Citations1972Edmund Fantino, Nancy K. Squires +2 more
In Experiment 1, matching of relative response rates to relative rates of reinforcement was obtained in concurrent variable-interval schedules when the absolute values of the two concurrent Variable-Interval schedules varied from 6 sec and 12 sec to 600 sec and 1200 sec.
Journal of the Experimental Analysis of BehaviorA MULTIVARIATE RATE EQUATION FOR VARIABLE‐INTERVAL PERFORMANCE
85 Citations1979J. J. McDowell, Robert Kessel
A value-like parameter is introduced into a rate equation for describing variable-interval performance and preliminary tests of the rate equation show that it handles univariate data as well as Herrnstein's hyperbola.
Journal of the Experimental Analysis of BehaviorDELAY AND AMOUNT OF REWARD IN A CONCURRENT CHAIN
83 Citations1983Mark Snyderman
Journal of the Experimental Analysis of BehaviorTHE EFFECT OF REINFORCEMENT MAGNITUDE UPON RESPONDING UNDER FIXED‐RATIO SCHEDULES<sup>1</sup>
79 Citations1969Robert Powell
Responding under fixed-ratio schedules was studied, and only one of the four pigeons studied showed a consistently higher response rate, exclusive of post-reinforcement pause, as a function of the longer access to food.
Journal of the Experimental Analysis of BehaviorDISCRETE‐TRIAL CHOICE IN PIGEONS: EFFECTS OF REINFORCER MAGNITUDE
78 Citations1981John S. Young
There was greater preference for the response alternative associated with uncertain reinforcement than would be expected on the basis of net reinforcer value as well as a linear function of the magnitude of the certain reinforcer.
Journal of Experimental Psychology Animal Behavior ProcessesPerception of contingency in conditioning: Scalar timing, response bias, and erasure of memory by reinforcement.
69 Citations1984Peter R. Killeen, James P. Smith
It was shown that the discriminative criteria did not change with changes in distribution of noise events in an optimal fashion and that the pigeons therefore were not "ideal detectors," and it was noted that the memory trace for a stimulus change decays at the same rate as the primary reinforcement gradient but that it decays faster when the delay is filled with an event such as reinforcement.
Journal of the Experimental Analysis of BehaviorCONCURRENT SCHEDULES OF RESPONSE‐INDEPENDENT REINFORCEMENT: DURATION OF A REINFORCING STIMULUS
54 Citations1971Aaron J. Brownstein
Grain presentation durations associated with the illumination conditions were varied from 1.5 to 4.5 sec, and the proportion of the total session time spent in an illumination condition closely approximated the relative grain presentation duration provided in that illumination.
Journal of the Experimental Analysis of BehaviorPREFERENCE FOR AND EFFECTS OF VARIABLE‐AS OPPOSED TO FIXED‐REINFORCER DURATION<sup>1</sup>
52 Citations1974Susan M. Essock, Ellen P. Reese
Pigeons were trained on multiple schedules in which a fixed number of pecks produced either a fixed or a variable period of access to food, the average variable-duration reinforcement equalling the fixed, and revealed an initial preference for variable- duration reinforcement for all subjects; for most subjects, this preference was sustained.
Journal of the Experimental Analysis of BehaviorDYNAMIC EFFECTS OF FOOD MAGNITUDE ON INTERIM‐TERMINAL INTERACTION
29 Citations1983Alliston K. Reid, Robert Dale
The amount of schedule-induced drinking and the form of the drinking distributions in this experiment can be accurately explained by two assumptions: (a) Food presentation facilitates food-related behavior through elicitation and anticipation; and (b) food- related behavior and drinking are reciprocally, linearly related.
Journal of the Experimental Analysis of BehaviorCONCURRENT VARIABLE‐INTERVAL SCHEDULE PERFORMANCE: FIXED VERSUS MIXED REINFORCER DURATIONS
26 Citations1984Michael Davison, Ian Hogsden
The effects of varying reinforcer durations in concurrent schedules cannot be described using the generalized matching law with constant parameters and it is suggested more generally that this quantitative relation may not describe performance either when reinforcing situations differ in duration or when response requirements differ induration.
Journal of the Experimental Analysis of BehaviorSHOCK INTENSITY AND DURATION INTERACTIONS ON FREE‐OPERANT AVOIDANCE BEHAVIOR<sup>1</sup>
22 Citations1973J. David Leander
With all measures of the avoidance performance, shock intensity and shock duration combine in a multiplicative fashion to determine theavoidance performance.
Animal Learning & BehaviorPreference for fixed over variable access to food
20 Citations1979Ronald L. Menlove, Herb M. Inden +1 more
Previous results of fixed- vs. variable-reward studies cannot be used to argue that animals do not prefer information over uncertainty, if preference is determined by differential weighting of reward values, and preference is independent of whether a reward is fixed or variable.
Journal of the Experimental Analysis of BehaviorAMOUNT CONSUMED VARIES AS A FUNCTION OF FEEDER DESIGN
17 Citations1985R. Epstein
Reports of studies in which magazine-cycle duration is varied should identify the design of the feeder employed, and in some cases, authors should consider determining the feeding functions for those feeders.
Journal of the Experimental Analysis of BehaviorQUANTIFICATION OF RATS' BEHAVIOR DURING REINFORCEMENT PERIODS
10 Citations1983Kenneth P. Gunn
It is suggested that rapidly fluctuating excitatory processes can account for many of these findings and that such processes are functionally significant in terms of behavioral compensation.