The dimensionality of discourse
Proceedings of the National Academy of SciencesPublished 1 March 2010Open access
I. Doxas, Simon Dennis, W. L. Oliver
Citations25
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The paragraph spaces of five text corpora all show the same two-scale structure, with the dimension at short distances being lower than at long distances, and the observed topology places important constraints on the way in which authors construct prose.
Abstract
The paragraph spaces of five text corpora, of different genres and intended audiences, in four different languages, all show the same two-scale structure, with the dimension at short distances being lower than at long distances. In all five cases the short-distance dimension is approximately eight. Control simulations with randomly permuted word instances do not exhibit a low dimensional structure. The observed topology places important constraints on the way in which authors construct prose, which may be universal.
Keywords
Computer ScienceSocial Sciences
Springer series in statisticsThe Elements of Statistical Learning
24,344 Citations2001Trevor Hastie, J. Friedman +1 more
Computers in PhysicsSavitzky-Golay Smoothing Filters
11,624 Citations1990William H. Press, Saul A. Teukolsky
HAL (Le Centre pour la Communication Scientifique Directe)Lecture Notes in Mathematics
10,101 Citations2011Stéphane Crépey, Olivier Guéant +4 more
Communications of the ACMA vector space model for automatic indexing
7,434 Citations1975Gerard Salton, Anita M.-Y. Wong +1 more
An approach based on space density computations is used to choose an optimum indexing vocabulary for a collection of documents, demonstating the usefulness of the model.
Physica D Nonlinear PhenomenaMeasuring the strangeness of strange attractors
5,643 Citations1983Peter Grassberger, Itamar Procaccia
Algorithms for Non-negative Matrix Factorization
5,463 Citations2000Daniel D. Lee, H. Sebastian Seung
Two different multiplicative algorithms for non-negative matrix factorization are analyzed and one algorithm can be shown to minimize the conventional least squares error while the other minimizes the generalized Kullback-Leibler divergence.
Discourse ProcessesAn introduction to latent semantic analysis
4,817 Citations1998Thomas K. Landauer, Peter W. Foltz +1 more
The adequacy of LSA's reflection of human knowledge has been established in a variety of ways, for example, its scores overlap those of humans on standard vocabulary and subject matter tests; it mimics human word sorting and category judgments; it simulates word‐word and passage‐word lexical priming data.
Springer series in statisticsThe Elements of Statistical Learning
4,270 Citations2009Trevor Hastie, Robert Tibshirani +1 more
Applied mathematical sciencesRegular and Chaotic Dynamics
2,174 Citations1992A. J. Lichtenberg, M. A. Lieberman
Psychology Press eBooksHandbook of Latent Semantic Analysis
1,565 Citations2007Thomas K. Landauer
This book discusses Latent Semantic Analysis as a Theory of Meaning, its application in Cognitive Theory, and its applications in Educational Applications.
IEEE Transactions on Information TheoryA new metric for probability distributions
1,171 Citations2003Dominik Endres, J.E. Schindelin
A metric for probability distributions is introduced, which is bounded, information-theoretically motivated, and has a natural Bayesian interpretation, and the square root of the well-known /spl chi//sup 2/ distance is an asymptotic approximation.
Psychological ReviewTopics in semantic representation.
1,137 Citations2007Thomas L. Griffiths, Mark Steyvers +1 more
This article analyzes the abstract computational problem underlying the extraction and use of gist, formulating this problem as a rational statistical inference that leads to a novel approach to semantic representation in which word meanings are represented in terms of a set of probabilistic topics.
Journal of the Optical Society of America AEstimating fractal dimension
951 Citations1990James Theiler
The purpose of this paper is to survey briefly the kinds of fractals that appear in scientific research, to discuss the application of Fractals to nonlinear dynamical systems, and to review more comprehensively the state of the art in numerical methods for estimating the fractal dimension of a strange attractor.
Neural Information Processing SystemsHierarchical Topic Models and the Nested Chinese Restaurant Process
938 Citations2003Thomas L. Griffiths, Michael I. Jordan +2 more
A Bayesian approach is taken to generate an appropriate prior via a distribution on partitions that allows arbitrarily large branching factors and readily accommodates growing data collections.
Maximum Likelihood Estimation of Intrinsic Dimension
709 Citations2004Elizaveta Levina, Peter J. Bickel
A new method for estimating intrinsic dimension of a dataset derived by applying the principle of maximum likelihood to the distances between close neighbors is proposed, which has the best overall performance compared with two other intrinsic dimension estimators.
Behavior Research Methods, Instruments, & ComputersImproving the retrieval of information from external sources
576 Citations1991Susan Dumais
A statistical method is described called latent semantic indexing, which models the implicit higher order structure in the association of words and objects and improves retrieval performance by up to 30%.
Schizophrenia ResearchQuantifying incoherence in speech: An automated methodology and novel application to schizophrenia
340 Citations2007Brita Elvevåg, Peter W. Foltz +2 more
In conclusion, LSA can be used to assay disordered language production so as to both complement human clinical ratings as well as experimentally parse this incoherence in a theory-driven manner.
Physical Review AMetric character of the quantum Jensen-Shannon divergence
142 Citations2008Pedro W. Lamberti, A. P. Majtey +3 more
Physics Letters ACalculating the dimension of attractors from small data sets
139 Citations1986N. B. Abraham, A. M. Albano +6 more
International Journal of Bifurcation and ChaosIMPROVED CORRELATION DIMENSION CALCULATION
96 Citations2001J. C. Sprott, G. Rowlands
A method for collecting data at large scales and extrapolating to the limit of zero scale is proposed and the result is a vastly reduced required number of data points for a given accuracy in the measured dimension.
Psychonomic Bulletin & ReviewUsing context to build semantics
89 Citations2005Peter J. Kwantes
A memory model is described that creates semantic representations for words that are similar in form to those created by LSA, but instead of applying dimension reduction, the model builds the representations by using a retrieval mechanism from a well-known account of episodic memory.
Journal of the American Statistical AssociationBent-Cable Regression Theory and Applications
84 Citations2006Grace S. Chiu, Richard Lockhart +1 more
Physics Letters AEstimating attractor dimensions from limited data: A new method, with error estimates
72 Citations1988Stephen P. Ellner
Geophysical Research LettersIs the AE index the result of nonlinear dynamics?
23 Citations1993Dean Prichard, C. P. Price