Preference reversal and delayed reinforcement
Animal Learning & BehaviorPublished 1 December 1981Open access
George Ainslie, R. J. Herrnstein
Citations386
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Pigeons chose, in a two-key discrete-trial procedure, between 2- and 4-sec access to grain, with the larger amount always presented 4 sec later than the smaller. As the delay between the choice and the availability of the smaller reinforcement was varied from .01 to 12 sec, all subjects reversed preference from the small-early to the large-late reinforcement. The values of delay at which preference reversed were approximately consistent with the matching law as adapted for delayed reinforcement.
Keywords
PsychologyAgricultural and Biological Sciences
Myopia and Inconsistency in Dynamic Utility Maximization
2,815 Citations1973Robert H. Strotz
Journal of the Experimental Analysis of BehaviorCOMMITMENT, CHOICE AND SELF‐CONTROL<sup>1</sup>
1,207 Citations1972Howard Rachlin, Leonard Green
The preference for the large delayed alternative with long durations of T parallels everyday instances of advance commitment to a given course of action and may be seen as a prototype for self-control.
Journal of the Experimental Analysis of BehaviorIMPULSE CONTROL IN PIGEONS<sup>1</sup>
765 Citations1974George Ainslie
Journal of the Experimental Analysis of BehaviorCHOICE AS TIME ALLOCATION<sup>1</sup>
738 Citations1969William M. Baum, Howard Rachlin
Journal of the Experimental Analysis of BehaviorCHOICE AND DELAY OF REINFORCEMENT<sup>1</sup>
538 Citations1967Shin‐Ho Chung, R. J. Herrnstein
Journal of the Experimental Analysis of BehaviorCHOICE IN A “SELF‐CONTROL” PARADIGM: EFFECTS OF A FADING PROCEDURE
364 Citations1978Joanna Mazur, A. W. Logue
The results indicate that fading procedures can lead to increased "self-control" in pigeons in a choice between a large delayed reinforcer and a small immediate reinforcer.
Learning and MotivationAn experimental analysis of impulsivity and impulse control in humans
258 Citations1980Jay V. Solnick, Catherine H. Kannenberg +2 more
The data support the Ainslie-Rachlin model and extend it to human choice behavior and show that some humans committed themselves to the large reward when commitment could be made some time before presentation of the reward alternatives.
Introduction to modern behaviorism
166 Citations1970Howard Rachlin
Journal of the Experimental Analysis of BehaviorEFFECTS ON CHOICE OF REINFORCEMENT DELAY AND CONDITIONED REINFORCEMENT<sup>1</sup>
123 Citations1978Ben A. Williams, Edmund Fantino
Reanalysis of previous evidence for matching showed that matching in fact did not occur, as the preferences of their subjects for the shorter of two delays also increased with the absolute size of the delays.
Psychonomic ScienceImmediate reward followed by extinction vs. later reward without extinction
96 Citations1966Edmund Fantino
Pigeons could obtain reinforcements either by pecking at a key immediately after it was trans-illuminated by red light or by delaying their pecks until the light turned green, and their tendency to do so increased in proportion to the advantages of delaying.
Animal Learning & BehaviorFeedback functions for reinforcement: A paradigmatic experiment
48 Citations1978Dražen Prelec, R. J. Herrnstein
