A note on fuzzy information measures
Pattern Recognition LettersPublished 1 May 1997
Xiu-Gang Shang, Jiang Weisun
Citations185
SJR quartileQ1
SJR score1.00
SNIP1.43
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A new entropy of a fuzzy set is defined based on the membership functions of the intersection and union of the set and its complement set and the concept of fuzzy cross-entropy is introduced.
Abstract
A new entropy of a fuzzy set is defined based on the membership functions of the intersection and union of the set and its complement set. The concept of fuzzy cross-entropy is also introduced and its definition is given by analogy with the cross-entropy of probability distributions. Their possible applications are highlighted.
Keywords
Computer ScienceDecision SciencesMathematics
IEEE Transactions on Information TheoryDivergence measures based on the Shannon entropy
5,027 Citations1991Jinfeng Lin
A novel class of information-theoretic divergence measures based on the Shannon entropy is introduced, which do not require the condition of absolute continuity to be satisfied by the probability distributions involved and are established in terms of bounds.
Information and ControlA definition of a nonprobabilistic entropy in the setting of fuzzy sets theory
2,260 Citations1972Aldo de Luca, S. Termini
A functional defined on the class of generalized characteristic functions (fuzzy sets), called “entropy≓, is introduced using no probabilistic concepts in order to obtain a global measure of the indefiniteness connected with the situations described by fuzzy sets.
Information SciencesFuzzy entropy and conditioning
616 Citations1986Bart Kosko
A new nonprobabilistic entropy measure is introduced in the context of fuzzy sets or messages and the theory of subsethood is shown to solve one of the major problems with Bayes-theorem learning and its variants—the problem of requiring that the space of alternatives be partitioned into disjoint exhaustive hypotheses.
International Journal of General SystemsON THE MEASURE OF FUZZINESS AND NEGATION Part I: Membership in the Unit Interval
579 Citations1979Ronald R. Yager
It is suggested that fuzziness can be related to the lack of distinction between a set and its negation and the concept of compatibility is used to develop linguistic measures of fuzziness.
IEEE Transactions on Information TheoryProperties of cross-entropy minimization
403 Citations1981John E. Shore, Ryan F. Johnson
The principle of minimum cross-entropy (minimum directed divergence, minimum discrimination information) is a general method of inference about an unknown probability density when there exists a prior estimate of the density and new information in the form of constraints on expected values.
Information SciencesSome new information measures for fuzzy sets
351 Citations1993Dinabandhu Bhandari, Nikhil R. Pal
A new informative measure for discrimination between two fuzzy sets is introduced and it is shown that this discriminating measure reduces to the nonprobabilistic entropy of Deluca and Termini under a special condition.
IEE Proceedings E Computers and Digital TechniquesObject-background segmentation using new definitions of entropy
306 Citations1989Nikhil R. Pal, Sankar K. Pal
The definition of Shannon's entropy in the context of information theory is critically examined and some of its applications to image processing problems are reviewed.
Pattern Recognition LettersAutomatic grey level thresholding through index of fuzziness and entropy
141 Citations1983Sankar K. Pal, Robert A. King +1 more
Algorithms for automatic thresholding of grey levels (without reference to histogram) are described using the terms 'index of fuzziness' and 'entropy' of a fuzzy set to be minimum when the crossover point of an S-function corresponds to boundary levels among different regions in image space.
Information SciencesHigher order fuzzy entropy and hybrid entropy of a set
112 Citations1992Nikhil R. Pal, Sankar K. Pal
New entropy measures such as higher order fuzzy entropy and hybrid entropy of a set have been introduced and various properties along with their proofs have been included.
IEEE Transactions on Pattern Analysis and Machine IntelligenceMinimum Cross-Entropy Pattern Classification and Cluster Analysis
104 Citations1982John E. Shore, Robert M. Gray
The approach is a generalization of a recently developed speech coding technique called speech coding by vector quantization based on the minimization of cross-entropy, and can be viewed as a refinement of a general classification method due to Kullback.