Calibration of Probabilities: The State of the Art
Published 1 January 1977
Sarah Lichtenstein, Baruch Fischhoff, Lawrence D. Phillips
Citations473
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
From the subjectivist point of view (de Finetti, 1937) a probability is a degree of belief in a proposition whose truth has not been ascertained and there is no “right” or “correct” probability that resides somewhere “in reality” against which it can be compared.
Abstract
From the subjectivist point of view (de Finetti, 1937) a probability is a degree of belief in a proposition whose truth has not been ascertained. A probability expresses a purely internal state; there is no "right" or "correct" probability that resides somewhere "in reality" against which it can be compared. However, in many circumstances, it may become possible to verify the truth o£ falsity of the proposition to which a probability was attached. Today, we assess the probability of the proposition"it will rain tomorrow". Tomorrow, we go outside and look at the rain gauge to see whether or not it has rained. When verification is possible, we can use it to gauge the adequacy of our probability assessments.
Keywords
Decision SciencesMathematicsArts and Humanities
ScienceJudgment under Uncertainty: Heuristics and Biases
28,003 Citations1974Amos Tversky, Daniel Kahneman
Three heuristics that are employed in making judgements under uncertainty are described: representativeness, availability of instances or scenarios, which is often employed when people are asked to assess the frequency of a class or the plausibility of a particular development.
Judgment under Uncertainty: Heuristics and Biases
23,088 Citations1975Amos Tversky, Daniel Kahneman
Signal detection theory and psychophysics
9,998 Citations1966David Marvin Green, John A. Swets
This book discusses statistical decision theory and sensory processes in signal detection theory and psychophysics and describes how these processes affect decision-making.
Psychological ReviewDecision processes in perception.
1,299 Citations1961John A. Swets, Wilson P. Tanner +1 more
A brief review of the theory of statistical decision is reviewed and a description of the elements of the theories appropriate to human observers is presented, including a quantitative measure of the criterion.
Journal of the American Statistical AssociationElicitation of Personal Probabilities and Expectations
1,190 Citations1971Leonard J. Savage
Organizational Behavior and Human PerformanceDo those who know more also know more about how much they know?
1,086 Citations1977Sarah Lichtenstein, Baruch Fischhoff
Journal of applied meteorologyA New Vector Partition of the Probability Score
1,057 Citations1973Allan H. Murphy
Organizational Behavior and Human PerformanceI knew it would happen
689 Citations1975Baruch Fischhoff, Ruth Beyth
Journal of applied meteorology“Good” Probability Assessors
331 Citations1968Robert L. Winkler, Allan H. Murphy
Journal of the American Statistical AssociationElicitation of Personal Probabilities and Expectations
282 Citations1971Leonard J. Savage
PsycEXTRA DatasetFrom Shakespeare to Simon: Speculations-and Some Evidence- About Man's Ability to Process Information
274 Citations1972Paul Slovic
Organizational Behavior and Human PerformanceProbabilistic forecasting: An experiment related to the stock market
250 Citations1972Carl-Axel S. Staël von Holstein
An attempt to tie an experiment to a “practical” situation involving the development of buying prices on the Stock Exchange and the results confirm that people can quantify their beliefs reasonably well in probabilistic terms.
Journal of applied meteorologyScalar and Vector Partitions of the Probability Score: Part I. Two-State Situation
120 Citations1972Allan H. Murphy
Organizational Behavior and Human PerformanceEliciting subjective probability distributions on continuous variables
107 Citations1978David A. Seaver, Detlof von Winterfeldt +1 more
The Journal of the Acoustical Society of AmericaConfidence Ratings, Message Reception, and the Receiver Operating Characteristic
82 Citations1958Irwin Pollack, Louis R. Decker
Bulletin of the American Meteorological SocietySubjective Probability Forecasting Experiments in Meteorology: Some Preliminary Results
53 Citations1974Allan H. Murphy, Robert L. Winkler
Decision SciencesA STUDY OF THE PERFORMANCE OF SUBJECTIVE PROBABILITY ASSESSORS
50 Citations1974Robert C. Pickhardt, John Wallace
Acta PsychologicaThe assessment of subjective probability distributions: A training experiment
48 Citations1973Ralf E. Schaefer, Katrin Borcherding
In this experiment 22 Ss especially trained to assess subjective probability distributions for proportions concerning student characteristics received feedback about their performance in the previous session(s), and learned to assess more realistic distributions.
The Journal of the Acoustical Society of AmericaConfidence Ratings, Second-Choice Responses, and Confusion Matrices in Intelligibility Tests
46 Citations1960Frank R. Clarke
Bulletin of the American Meteorological SocietyForecasters and Probability Forecasts: Some Current Problems
41 Citations1971Allan H. Murphy, Robert L. Winkler
Journal of applied meteorologyAn Experiment in Probabilistic Weather Forecasting
39 Citations1971Carl-Axel S. Staël von Holstein
Probabilistic forecasts were given for temperature and precipitation for 2 and 5-day periods and the scores were given as feedback to the participants together with the actual outcomes, indicating some explanations for this.
Bulletin of the American Meteorological SocietyCredible Interval Temperature Forecasts
39 Citations1972Cameron R. Peterson, Kurt J. Snapper +1 more
The results of the experiment indicate that forecasters can use credible intervals to quantify this information, information which may be important to potential users of these forecasts.
Quantifying Uncertainty into Numerical Probabilities for the Reporting of Intelligence
33 Citations1973Thomas A. Brown, Emir H. Shuford
Any degree of uncertainty over these events or the information can be quantified into numerical probabilities, which can then be readily and accurately communicated within the system.
Instructional ScienceElicitation of personal probabilities and their assessment
27 Citations1975Emir H. Shuford, Thomas A. Brown
The rationale underlying a procedure for eliciting personal estimates of probabilities utilizing a proper scoring rule is described, and some new techniques for calibrating those probabilities and providing better feedback to students learning to assess uncertainty are illustrated.
Bulletin of the American Meteorological SocietyThe Use of Confidence Factors in Forecasting
19 Citations1951Philip L. Williams
The Journal of the Acoustical Society of AmericaConfidence Ratings and Message Reception for Filtered Speech
16 Citations1958Louis R. Decker, Irwin Pollack
The statistical decision model, which has achieved outstanding success in describing the detection of signals in noise, was applied to the reception of filtered speech and the relation between correct confirmations and false alarms obtained with filtered speech corresponds with that typically obtained with noise interference.
The Use of Credible Intervals in Temperature Forecasting: Some Experimental Results
10 Citations1977Allan H. Murphy, Robert L. Winkler
Bulletin of the Atomic ScientistsVirtues and limitations of risk analysis
9 Citations1975Robert K. Weatherwax
Journal of applied meteorologyProbability Statements in Weather Forecasting
8 Citations1962Halbert E. Root
Defense Technical Information Center (DTIC)Odds Versus Probabilities for Categorical Events.
6 Citations1973Hazard,Ted H., Peterson,Cameron R.