A review of human linguistic probability processing: General principles and empirical evidence
The Knowledge Engineering ReviewPublished 1 March 1995
Thomas S. Wallsten, David V. Budescu
Citations160
SJR quartileQ2
SJR score0.69
SNIP1.47
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Research on how people use and understand linguistic expressions of uncertainty is reviewed, with a view toward the needs of researchers and others interested in artificial intelligence systems.
Abstract
Abstract This article reviews research on how people use and understand linguistic expressions of uncertainty, with a view toward the needs of researchers and others interested in artificial intelligence systems. We discuss and present empirical results within an inductively developed theoretical framework consisting of two background assumptions and six principles describing the underlying cognitive processes.
Keywords
PsychologyComputer ScienceArts and Humanities
The Quarterly Journal of EconomicsRisk, Ambiguity, and the Savage Axioms
7,774 Citations1961Daniel Ellsberg
Journal of the American Statistical AssociationOptimal Statistical Decisions.
3,492 Citations1972David Siegmund, Morris H. DeGroot
Medical Entomology and ZoologyDecision analysis and behavioral research
3,065 Citations1986Detlof von Winterfeldt, Ward Edwards
Journal of Risk and UncertaintyRecent developments in modeling preferences: Uncertainty and ambiguity
1,822 Citations1992Colin F. Camerer, Martin Weber
Cambridge University Press eBooksCalibration of probabilities: The state of the art to 1980
1,804 Citations1982Sarah Lichtenstein, Baruch Fischhoff +1 more
Psychological ReviewContingent weighting in judgment and choice.
1,565 Citations1988Amos Tversky, Shmuel Sattath +1 more
Information SciencesA procedure for ordering fuzzy subsets of the unit interval
1,407 Citations1981Ronald R. Yager
A function to help in the ordering of fuzzy subsets of the unit interval is introduced, which is the integral of the mean of the level sets associated with the fuzzy subset.
Marketing ScienceDecision-Making Under Uncertainty: Capturing Dynamic Brand Choice Processes in Turbulent Consumer Goods Markets
1,261 Citations1996Tülin Erdem, Michael P. Keane
Cambridge University Press eBooksEconomic Theory of Choice and the Preference Reversal Phenomenon
1,193 Citations2006David M. Grether, Charles R. Plott
Fuzzy Sets and SystemsA review of some methods for ranking fuzzy subsets
940 Citations1985G. Bortolan, R. Degani
Psychological ReviewAmbiguity and uncertainty in probabilistic inference.
796 Citations1985Hillel J. Einhorn, Robin M. Hogarth
Journal of ForecastingHow probable is probable? A numerical translation of verbal probability expressions
528 Citations1982Ruth Beyth‐Marom
The results indicate that (a) there is a high variability in the interpretation of verbal probability expressions and (b) the variability is even higher in context.
International Journal of Approximate ReasoningMeasures of similarity among fuzzy concepts: A comparative analysis
524 Citations1987Rami Zwick, Edward Carlstein +1 more
It is found that measures that account for ordering on the base variable proved to be more highly correlated with subjects' actual similarity judgments, and, surprisingly, the best measures were ones that focus on only one “slice” of the membership function.
Journal of Experimental Psychology GeneralMeasuring the vague meanings of probability terms.
500 Citations1986Thomas S. Wallsten, David V. Budescu +3 more
Cambridge University Press eBooksUnreliable probabilities, risk taking, and decision making
348 Citations1988Peter Gärdenfors, Nils‐Eric Sahlin
Organizational Behavior and Human Decision ProcessesVerbal probabilities: Ambiguous, context-dependent, or both?
320 Citations1988Wibecke Brun, Karl Halvor Teigen
Organizational Behavior and Human Decision ProcessesConsistency in interpretation of probabilistic phrases
309 Citations1985David V. Budescu, Thomas S. Wallsten
Psychonomic ScienceEmpirical scaling of common verbal phrases associated with numerical probabilities
303 Citations1967Sarah Lichtenstein, J. Robert Newman
Bulletin of the Psychonomic SocietyPreferences and reasons for communicating probabilistic information in verbal or numerical terms
298 Citations1993Thomas S. Wallsten, David V. Budescu +2 more
New England Journal of MedicineHow Medical Professionals Evaluate Expressions of Probability
283 Citations1986Augustine Kong, G. Octo Barnett +2 more
The average numerical values presented here for various qualitative expressions of probability could well be used to enhance communication among medical professionals and between physicians and patients.
Journal of Applied PsychologyMagnitude estimations of expressions of frequency and amount.
281 Citations1974Bernard M. Bass, Wayne F. Cascio +1 more
International Journal of Approximate ReasoningThe problem of linguistic approximation in clinical decision making
266 Citations1988R. Degani, G. Bortolan
Management ScienceComparing the Calibration and Coherence of Numerical and Verbal Probability Judgments
244 Citations1993Thomas S. Wallsten, David V. Budescu +1 more
Journal of Experimental Psychology Human Perception & PerformanceDecisions based on numerically and verbally expressed uncertainties.
236 Citations1988David V. Budescu, Shalva Weinberg +1 more
Organizational Behavior and Human Decision ProcessesVerbal versus numerical probabilities: Efficiency, biases, and the preference paradox
231 Citations1990Ido Erev, Brent L. Cohen
Journal of Memory and LanguageBase rate effects on the interpretations of probability and frequency expressions
220 Citations1986Thomas S. Wallsten, Samuel Fillenbaum +1 more
Organizational Behavior and Human Decision ProcessesProbability judgment accuracy: China, Japan, and the United States
208 Citations1989J. Frank Yates, Ying Zhu +4 more
Journal of Experimental Psychology Human Perception & PerformanceContextual effects in the interpretations of probability words: Perceived base rate and severity of events.
203 Citations1990Elke U. Weber, Denis Hilton
Fuzzy Sets and SystemsA model for the measurement of membership and the consequences of its empirical implementation
201 Citations1984Alan M. Norwich, İ.B. Türkşen
Organizational Behavior and Human Decision ProcessesThe center and range of the probability interval as factors affecting ambiguity preferences
188 Citations1985Shawn P. Curley, J. Frank Yates
Statistical ScienceQuantifying Probabilistic Expressions
181 Citations1990Frederick Mosteller, Cleo Youtz
Medical Entomology and ZoologyCommunicating Quantities: A Psychological Perspective
174 Citations1993Linda M. Moxey, Anthony J. Sanford
Journal of Cross-Cultural PsychologyCultural Differences in Probabilistic Thinking
170 Citations1978George Wright, Lawrence D. Phillips +5 more
Journal of Applied PsychologyQuantitative meanings of verbal probability expressions.
168 Citations1989Robert Timothy Reagan, Frederick Mosteller +1 more
The meanings of 18 verbal probability expressions were studied in 3 ways: frequency distributions of what single number best represented each expression; word-to-number acceptability functions from which expressions were appropriate for multiples of 5% from 5% to 95%.
The American Journal of MedicineNumbers are better than words
164 Citations1983Michael A. Nakao, Seymour Axelrod
Verbal expressions of frequency should be eliminated from medical communications; failing that, the author should specify numerically the frequency he intends when he uses any such expression.
Organizational Behavior and Human Decision ProcessesInformation Displays and Choice Processes: Differential Effects of Organization, Form, and Sequence
144 Citations1994David Schkade, Don N. Kleinmuntz
Cognitive PsychologyComparative judgments with numerical reference points
141 Citations1978Keith J. Holyoak
Organizational Behavior and Human Decision ProcessesSelection of verbal probabilities: A solution for some problems of verbal probability expression
140 Citations1991Robert M. Hamm
Bulletin of the American Meteorological SocietyMisinterpretations of Precipitation Probability Forecasts
132 Citations1980Allan H. Murphy, Sarah Lichtenstein +2 more
Risk AnalysisUncertainties in Nuclear Probabilistic Risk Analyses
113 Citations1984W.E. Vesely, D.M. Rasmuson
Representing Uncertain Knowledge
113 Citations1993Paul Krause, Dominic A. Clark
The Dempster-Shafer model for uncertain reasoning is used to associate belief measures to each possible label for the elements in the construction hierarchy, enabling the most likely interpretation of the perceived image in terms of the expected image to be identified.
Current PsychologyVerbal uncertainty expressions: A critical review of two decades of research
112 Citations1990Dominic A. Clark
Empirical studies of verbal uncertainty expressions spanning two decades of research between 1967 and 1987 conclude that people are highly internally consistent in their use ofverbal uncertainty expressions and that assessments of the meaning of the mean may be conditioned by the prior perceived probabilities of the events they describe.
Organizational Behavior and Human Decision ProcessesNumeric and linguistic information representation in multiattribute choice
109 Citations1991Dan N. Stone, David Schkade
Results indicate that, relative to numbers, words lead to more alternative-based information search and less compensatory processing, and it is found that the number and similarity of alternatives have important moderating influences on the effects of information representation.
Acta PsychologicaThe language of uncertainty
98 Citations1988Karl Halvor Teigen
By asking subjects to compare the appropriateness of selected verbal expressions under different circumstances, it is possible to identify important semantic components of such expressions, in addition to those elicited by probability scaling techniques.
Quarterly Journal of SpeechThe specific meanings of certain terms indicating differing degrees of frequency
92 Citations1944Ray H. Simpson
Journal of Research in PersonalitySometimes frequently means seldom: Context effects in the interpretation of quantitative expressions
90 Citations1974Susan Pepper, Lubomir S. Prytulak
Journal of General Internal MedicinePatients’ interpretations of probability terms
89 Citations1991Dennis J. Mazur, David H. Hickam
The numerical meanings that patients ascribe to probability terms fall into identifiable patterns, while patients vary in the actual values they assign to terms, the relative meanings of terms show consistent trends.
Journal of Applied Social PsychologyRatings of Orally Presented Verbal Expressions of Probability by a Heterogeneous Sample
86 Citations1992Valerie A. Clarke, Coral L. Ruffin +2 more
Journal of Behavioral Decision MakingAxiomatic measures of perceived risk: Some tests and extensions
83 Citations1989Elke U. Weber, William P. Bottom
Organizational Behavior and Human Decision ProcessesDyadic decisions with numerical and verbal probabilities
74 Citations1990David V. Budescu, Thomas S. Wallsten
Bulletin of the American Meteorological SocietyForecast Terminology: Composition and Interpretation of Public Weather Forecasts2,3
73 Citations1983Allan H. Murphy, Barbara G. Brown
This paper focuses on forecast terminology and the understanding of such terminology in the context of short-range public weather forecasts with respect to six basic aspects or facets of worded forecasts.
Language & CommunicationComprehension of verbal probability expressions in children and adolescents
71 Citations1991Étienne Mullet, Isabelle Rivet
Social Science & MedicineCommunicating probabilistic information to cancer patients: Is there ‘noise’ on the line?
66 Citations1991Heather J. Sutherland, Gina Lockwood +4 more
There was no consensus about numerical meaning of a given word, and that interviewers can systematically influence numerical interpretations, within this group of patients.
Medical Decision MakingVerbal Expressions of Probability in Informed Consent Litigation
64 Citations1991Jon F. Merz, Marek J. Drużdżel +1 more
It was found that subjective verbal expressions of probability are used in the litigation setting, and that such expressions represent broad ranges of numeric probabilities.
Memory & CognitionThe language of possibility and probability: Effects of negation on meaning
64 Citations1981Valerie F. Reyna
Modal adjectives (e.g., “possible” and “probable”) have been the subject of much discussion by linguists and logicians and it was found that an important aspect of the meaning of modal adjective is that they can all be used to qualify the truth of a statement.
Mathematical ModellingDirect and indirect scaling of membership functions of probability phrases
62 Citations1987A. Rapoport, Thomas S. Wallsten +1 more
A direct and an indirect procedure, magnitude estimation and graded pair-comparison, are compared in the context of establishing membership functions for probability phrases such as probable, rather likely, very unlikely, and so forth.
Acta PsychologicaWhen are low-probability events judged to be ‘probable’? Effects of outcome-set characteristics on verbal probability estimates
56 Citations1988Karl Halvor Teigen
Journal of Experimental Psychology Human Perception & PerformanceContextual effects in the interpretations of probability words: Perceived base rate and severity of events.
54 Citations1990Elke U. Weber, Denis Hilton
Fuzzy sets in psychology
50 Citations1988Tamás Zétényi
IEEE Transactions on Systems Man and CyberneticsThe Technology Utility Assessment
49 Citations1977Edgar M. Johnson, George W. Huber
Guidelines are developed for improving the probability of success in applying utility assessment, and suggestions are made for the research necessary to further improve the technology of utility assessment.
Memory & CognitionTimed magnitude comparisons of numerical and nonnumerical expressions of uncertainty
48 Citations1989Amanda Jaffe-Katz, David V. Budescu +1 more
Consistent distance and congruity effects were obtained, illustrating that both numerical and nonnumerical expressions of uncertainty contain subjective magnitude information, and suggesting that similar processes are employed in manipulating and comparing numerical and verbal terms.
Acta PsychologicaUnderstanding and using linguistic uncertainties
48 Citations1988Thomas S. Wallsten, David V. Budescu +1 more
A theory that may reconcile the differences is outlined and supported by data from a choice study, and improvements to the theory may also account for the effects of context on phrase meaning.
Contemporary Accounting ResearchInterpretation of uncertainty expressions*
47 Citations1986George Richard Chesley
An extensive and detailed examination of the ambiguity of interpretations in the communication of uncertainty using a vocabulary familiar to accountants and auditors demonstrates that ambiguity exists and that this ambiguity is reasonably stable for the vocabulary of the accountant.
International Journal of Man-Machine StudiesCombining stochastic uncertainty and linguistic inexactness: theory and experimental evaluation of four fuzzy probability models
45 Citations1989Rami Zwick, Thomas S. Wallsten
Acta PsychologicaRevision of opinion with verbally and numerically expressed uncertainties
44 Citations1990Amnon Rapoport, Thomas S. Wallsten +2 more
The American Journal of PsychologySome Effects of Vocabulary and Communication Task on the Understanding and Use of Vague Probability Expressions
43 Citations1991Samuel Fillenbaum, Thomas S. Wallsten +2 more
Journal of Experimental Psychology Learning Memory and CognitionEffects of probability mode on preference reversal.
37 Citations1992Claudia González‐Vallejo, Thomas S. Wallsten
The pattern of results was predicted by and supports the hypothesis that the relative importance given to the dimensions of a prospect depends on the form in which the information is displayed.
Journal of Behavioral Decision MakingThe effect of constant outcome value on judgments and decision making given linguistic probabilities
35 Citations1992Brent L. Cohen, Thomas S. Wallsten
PsycEXTRA DatasetNumerical encoding of qualitative expressions of uncertainty.
34 Citations1973Edgar M. Johnson
The American Journal of PsychologyDo Decision Quality and Preference Order Depend on Whether Probabilities Are Verbal or Numerical?
31 Citations1994Claudia González‐Vallejo, Ido Erev +1 more
Psychological ScienceVagueness, Ambiguity, and the Cost of Mutual Understanding
29 Citations1991Ido Erev, Thomas S. Wallsten +1 more
Journal of Verbal Learning and Verbal BehaviorRecognition confusions among quantifiers
27 Citations1978Keith J. Holyoak, Arnold L. Glass
Advances in psychologyQuantifiers as Fuzzy Concepts
22 Citations1988Stephen E. Newstead
This chapter reviews work on the interpretation of quantifiers as a possible explanation for errors in syllogistic reasoning, and attempts to synthesize the findings from the disparate areas.
Applied ErgonomicsHow much is a large part?
20 Citations1976M. Hammerton
It was found that there was remarkably high concordance between subjects in rank ordering, but that numerical equivalents are notably more variable.
Advances in psychologyAn Empirical Study of the Integration of Linguistic Probabilities
18 Citations1988Rami Zwick, David V. Budescu +1 more
This chapter describes the various theoretical models which have been proposed in the fuzzy set literature for the aggregation operations, and reviews the empirical work in this area, and illustrates an experiment in which subjects are required to consider simultaneously two vague probabilistic judgments and their responses are compared with predictions generated by fuzzy set theory.
Scandinavian Journal of PsychologyAttractiveness of decision alternatives characterized by numerical and non‐numerical information
17 Citations1986Ola Svenson, Gunnar Karlsson
Journal of Experimental Psychology GeneralOn measuring fuzziness: A comment on "A fuzzy set approach to modifiers and vagueness in natural language."
16 Citations1979David C. Rubin
Hersh and Caramazza's application of fuzzy set theory to vagueness in natural language is criticized for including in their measures of fuzziness response variability due to experimental and statistical procedures.
International Journal of Man-Machine StudiesIntegration of linguistic probabilities
13 Citations1990David V. Budescu, Rami Zwick +2 more
The entire pattern of results in the Zwick et al. (1988) and the present study is used to argue against the indiscriminate application of mathematically prescribed, but empirically unsupported operations in computerized expert systems intended to represent and combine linguistic information.
A fuzzy logic approach to the management of linguistically expressed uncertainty
9 Citations1988Ramón López de Mántaras, Pedro Meseguer +3 more
A description of the expert system shell called MILORD, which can be used to perform three different calculi of uncertainty, on an expert-defined set of linguistic labels, depending on three different models of the conjunction, disjunction, and implication operators, and its management of uncertainty.
…