Developments in Linear Regression Methodology: 1959–l982
TechnometricsPublished 1 August 1983
R. R. Hocking
Citations166
SJR quartileQ1
SJR score1.41
SNIP1.93
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
The developments in linear regression methodology that have taken place during the 25-year history of Technometrics are summarized. Major topics covered are variable selection, biased estimation, robust estimation, and regression diagnostics.
Keywords
ChemistryMathematicsDecision Sciences
Journal of the Society for Industrial and Applied MathematicsAn Algorithm for Least-Squares Estimation of Nonlinear Parameters
30,435 Citations1963Donald W. Marquardt
Psychology Press eBooksApplied Multiple Regression/Correlation Analysis for the Behavioral Sciences
20,853 Citations2014Patricia Cohen, Patricia Cohen +2 more
TechnometricsApplied Regression Analysis
18,042 Citations2005
This tutorial discusses simple and multiple linear regression, diagnostics, model selection, models with categorical variables, and nonlinear models; logistic regression.
Journal of the Royal Statistical Society Series B (Statistical Methodology)An Analysis of Transformations
15,066 Citations1964George E. P. Box, David R. Cox
Journal of the Royal Statistical Society Series B (Statistical Methodology)Cross-Validatory Choice and Assessment of Statistical Predictions
10,527 Citations1974M. Stone
TechnometricsRidge Regression: Biased Estimation for Nonorthogonal Problems
8,927 Citations1970Arthur E. Hoerl, Robert W. Kennard
TechnometricsApplied Regression Analysis and Other Multivariable Methods
8,351 Citations1989Esteban Walker, David G. Kleinbaum +2 more
Journal of the Operational Research SocietyRegression Diagnostics -- Identifying Influential Data and Sources of Collinearity
6,517 Citations1981Chris Beaumont, D. A. Belsley +2 more
Journal of the American Statistical AssociationIntroduction to Linear Regression Analysis.
5,446 Citations1993Renato Assunção, Paul D. Sampson +2 more
Journal of the American Statistical AssociationRegression Analysis by Example.
3,231 Citations1980Jan Kmenta, Samprit Chatterjee +1 more
Journal of the American Statistical AssociationApplied Regression Analysis (2nd ed).
3,064 Citations1981José Ferreira de Carvalho, Norman R. Draper +1 more
This book brings together a number of procedures developed for regression problems in current use and includes material that either has not previously appeared in a textbook or if it has appeared is not generally available.
Linear Regression Analysis
2,763 Citations2013Seber, George A. F. 1938-, Lee, Alan J. 1946-
TechnometricsRidge Regression: Applications to Nonorthogonal Problems
2,624 Citations1970Arthur E. Hoerl, Robert W. Kennard
Journal of the American Statistical AssociationThe Influence Curve and its Role in Robust Estimation
2,481 Citations1974Frank R. Hampel
The Annals of StatisticsRobust Regression: Asymptotics, Conjectures and Monte Carlo
2,356 Citations1973Peter J. Huber
TechnometricsDetection of Influential Observation in Linear Regression
2,304 Citations2000R. Dennis Cook
Communication in Statistics- Theory and MethodsRobust regression using iteratively reweighted least-squares
2,111 Citations1977Paul W. Holland, Roy E. Welsch
The weight functions that are discussed are a part of a semi-portable subroutine library called ROSEPACK (RObust Statistical Estimation PACKage) that has been developed by the authors and Virginia Klema at the Computer Research Center of the National Bureau of Economic Research, Inc in Cambridge, Mass.
BiometricsResiduals and Influence in Regression.
1,922 Citations1983Anthony C. Atkinson, R. Dennis Cook +1 more
TechnometricsThe Relationship Between Variable Selection and Data Agumentation and a Method for Prediction
1,361 Citations1974David M. Allen
It is shown that data augmentation provides a rather general formulation for the study of biased prediction techniques using multiple linear regression and a way to obtain predictors given a credible criterion of good prediction is proposed.
TechnometricsValidation of Regression Models: Methods and Examples
1,232 Citations1977Ronald D. Snee
It is concluded that data splitting is an effective method of model validation when it is not practical to collect new data to test the model.
Journal of the Royal Statistical Society Series A (General)Sampling and Bayes' Inference in Scientific Modelling and Robustness
936 Citations1980George E. P. Box
Predictive checking functions for transformation, serial correlation, bad values, and their relation with Bayesian options are considered, and robustness is seen from a Bayesian viewpoint and examples are given.
TechnometricsTransformation of the Independent Variables
905 Citations1962George E. P. Box, Paul W. Tidwell
The American StatisticianRidge Regression in Practice
863 Citations1975Donald W. Marquardt, Ronald D. Snee
The American StatisticianThe Hat Matrix in Regression and ANOVA
855 Citations1978David C. Hoaglin, Roy E. Welsch
A projection matrix known as the hat matrix contains this information and, together with the Studentized residuals, provides a means of identifying exceptional data points and simplifies the calculations involved in removing a data point.
Multiple Regression Analysis
803 Citations2007
TechnometricsThe Modified Gauss-Newton Method for the Fitting of Non-Linear Regression Functions by Least Squares
791 Citations1961H. O. Hartley
Journal of the American Statistical AssociationInfluential Observations in Linear Regression
764 Citations1979R. Dennis Cook
Journal of the American Statistical AssociationComparison of Stopping Rules in Forward “Stepwise” Regression
745 Citations1977Robert B. Bendel, Abdelmonem A. Afifi
The Annals of Mathematical StatisticsThe 1972 Wald Lecture Robust Statistics: A Review
643 Citations1972Peter J. Huber
Journal of the Royal Statistical Society Series B (Statistical Methodology)Relative Curvature Measures of Nonlinearity
600 Citations1980Douglas M. Bates, Donald G. Watts
Journal of the American Statistical AssociationApplied Statistics: Analysis of Variance and Regression.
595 Citations1976Peter B. Imrey, Olive Jean Dunn +1 more
TechnometricsMean Square Error of Prediction as a Criterion for Selecting Variables
540 Citations1971David M. Allen
TechnometricsThe Examination and Analysis of Residuals
524 Citations1963F. J. Anscombe, John W. Tukey
Journal of the American Statistical AssociationAn Analysis of Transformations Revisited
517 Citations1981Peter J. Bickel, Kjell A. Doksum
Journal of the Royal Statistical Society Series B (Statistical Methodology)Confidence Regions in Non-Linear Estimation
479 Citations1960E. M. L. Beale
TechnometricsMean Square Error of Prediction as a Criterion for Selecting Variables
365 Citations1971David M. Allen
Journal of the American Statistical AssociationAn Appraisal of Least Squares Programs for the Electronic Computer from the Point of View of the User
360 Citations1967James W. Longley
If the full potential of the electronic computer is to be achieved, an understanding of the basic arithmetic operations and their effect on the a...
Journal of the Royal Statistical Society Series C (Applied Statistics)An Alternative Family of Transformations
357 Citations1980J. A. John, Norman R. Draper
AIBS BulletinMethods of Correlation and Regression Analysis
351 Citations1960Vincent Schultz, Mordecai Ezekiel +1 more
Journal of the American Statistical AssociationEfficient Bounded-Influence Regression Estimation
340 Citations1982William S. Krasker, Roy E. Welsch
TechnometricsCharacterizations of an Empirical Influence Function for Detecting Influential Cases in Regression
334 Citations1980R. Dennis Cook, Sanford Weisberg
The American StatisticianEfficient Computing of Regression Diagnostics
315 Citations1981Paul F. Velleman, Roy E. Welsch
This article attempts to make regression diagnostics more readily available to those who compute regressions with packaged statistics programs, highlighting ambiguities of terminology and relationships among similar methods.
Journal of the American Statistical AssociationLinear Programming Techniques for Regression Analysis
310 Citations1959Harvey M. Wagner
Journal of the American Statistical AssociationA Simulation Study of Alternatives to Ordinary Least Squares
300 Citations1977A. P. Dempster, Martin Schatzoff +1 more
Journal of the Royal Statistical Society Series B (Statistical Methodology)Finding the Outliers that Matter
295 Citations1978David Andrews, Daryl Pregibon
Journal of the American Statistical AssociationA Simulation Study of Some Ridge Estimators
291 Citations1981Diane Galarneau Gibbons
TechnometricsSelection of the Best Subset in Regression Analysis
285 Citations1967R. R. Hocking, R. N. Leslie
TechnometricsRegression Analysis and Its Application: A Data-Oriented Approach
275 Citations1981Gregory A. Mack, Richard F. Gunst +1 more
TechnometricsSelection of Variables for Fitting Equations to Data
274 Citations1966John W. Gorman, R. J. Toman
BiometrikaTwo graphical displays for outlying and influential observations in regression
269 Citations1981Anthony C. Atkinson
TechnometricsThe Use of Partial Residual Plots in Regression Analysis
259 Citations1972Wayne A. Larsen, Susan J. McCleary
Communication in Statistics- Theory and MethodsCommunications in statistics: 1972-1976
256 Citations1978Richard F. Gunst, Tsushung A. Hua
BiometrikaThe discarding of variables in multivariate analysis
244 Citations1967E. M. L. Beale, M. G. Kendall +1 more
Cut-off rules are developed that enable us to find the best solution to both problems by partial enumeration by maximizing the multiple correlation between the selected variables and the dependent variable.
BiometricsResistant Fits for Some Commonly Used Logistic Models with Medical Applications
236 Citations1982Daryl Pregibon
Logistic regression-type models are used in many applications and are fitted by the method of maximum likelihood, which, like least squares, is sensitive to atypical observations.
BiometricsEfficient Screening of Nonnormal Regression Models
235 Citations1978Jerald F. Lawless, K. Singhal
BiometricsBuilding Multiple Regression Models Interactively
225 Citations1981H. V. Henderson, Paul F. Velleman
The methods are illustrated with reanalyses of the two data sets used by Hocking (1976, Biometrics 32, 1-44) to illustrate the use of automated regression methods.
TechnometricsRidge Regression and James-Stein Estimation: Review and Comments
214 Citations1979Norman R. Draper, R. Craig Van Nostrand
Journal of the American Statistical AssociationA Critique of Some Ridge Regression Methods
211 Citations1980Gary Smith, Frank W. Campbell
Journal of Educational MeasurementTHE SELECTION OF VARIABLES IN MULTIPLE REGRESSION ANALYSIS
209 Citations1970Ronald S. Halinski, Leonard S. Feldt
TechnometricsOn Biased Estimation in Linear Models
201 Citations1973Lawrence S. Mayer, Thomas A. Willke
TechnometricsA Class of Biased Estimators in Linear Regression
199 Citations1976R. R. Hocking, F. M. Speed +1 more
International Statistical ReviewSelection of Variables in Multiple Regression: Part I. A Review and Evaluation
192 Citations1978Mary Lou Thompson
Journal of the Royal Statistical Society Series C (Applied Statistics)On Quick Choice of Power Transformation
187 Citations1977D. V. Hinkley
Journal of the Royal Statistical Society Series B (Statistical Methodology)Regression Diagnostics, Transformations and Constructed Variables
187 Citations1982Anthony C. Atkinson
TechnometricsLatent Root Regression Analysis
174 Citations1974J. T. Webster, Richard F. Gunst +1 more
TechnometricsTransformation of the Independent Variables
167 Citations1962G. E. P. Box, Paul W. Tidwell
TechnometricsInfluential Observations and Outliers in Regression
164 Citations1981Norman R. Draper, J. A. John
TechnometricsInflation of R <sup>2</sup> in Best Subset Regression
161 Citations1980Alvin C. Rencher, Fu Ceayong Pun
Communications in StatisticsRegression analysis and problems of multicollinearity
150 Citations1975Richard F. Gunst, J. T. Webster
Journal of the Royal Statistical Society Series B (Statistical Methodology)Topics in the Investigation of Linear Relations Fitted by the Method of Least Squares
142 Citations1967F. J. Anscombe
TechnometricsThe Examination and Analysis of Residuals
136 Citations1963F. J. Anscombe, John W. Tukey
TechnometricsAn Explicit Solution for Generalized Ridge Regression
126 Citations1975William J. Hemmerle
Communication in Statistics- Theory and MethodsThe regression dilemma
125 Citations1983R. R. Hocking, O J Pendleton
TechnometricsThe Use of an <i>F</i> -Statistic in Stepwise Regression Procedures
119 Citations1972P. T. Pope, J. T. Webster
BiometrikaOn prediction and the power transformation family
119 Citations1981Raymond J. Carroll, David Ruppert
Communications in Statistics - Simulation and ComputationA revised simplex algorithm for the absolute deviation curve fitting problem
118 Citations1979Ronald D. Armstrong, E. L. Frome +1 more
Journal of the Royal Statistical Society Series B (Statistical Methodology)Testing Transformations to Normality
109 Citations1973Anthony C. Atkinson
Journal of the American Statistical AssociationThe Acceptability of Regression Solutions: Another Look at Computational Accuracy
109 Citations1976Albert E. Beaton, Donald B. Rubin +1 more
TechnometricsPrediction, Linear Regression and the Minimum Sum of Relative Errors
108 Citations1977Subhash C. Narula, John F. Wellington
Journal of the Royal Statistical Society Series B (Statistical Methodology)A Robust Method for Testing Transformations to Achieve Approximate Normality
103 Citations1980Raymond J. Carroll
TechnometricsAll Possible Regressions with Less Computation
102 Citations1971George M. Furnival
Two methods are given for computing all possible regressions for a set of independent variables and the second may compare favorably with the procedure suggested by Hocking and Leslie for finding the best subset without evaluating all possible subsets.
TechnometricsCalculation of the Residual Sum of Squares for all Possible Regressions
101 Citations1972Joseph Morgan, Jan Tatar
TechnometricsSimultaneous Inference and the Choice of Variable Subsets in Multiple Regression
100 Citations1974Murray Aitkin
International Statistical ReviewSelection of Variables in Multiple Regression: Part II. Chosen Procedures, Computations and Examples
100 Citations1978Mary Lou Thompson
RePEc: Research Papers in EconomicsRegression Sensitivity Analysis and Bounded-Influence Estimation
95 Citations1980Roy E. Welsch
The American StatisticianCorrelation in Polynomial Regression
88 Citations1979Ralph A. Bradley, Sushil S. Srivastava
TechnometricsEfficient Calculation of All Possible Regressions
86 Citations1968Martin Schatzoff, R. Tsao +1 more
Efficient computational procedures for calculating all possible 2 k − 1 regressions of a dependentv ariable upon subsets of k independent variables are described, and efficiency comparisons among five different procedures are provided.
BiometrikaExact confidence regions for the parameters in non-linear regression laws
83 Citations1964H. O. Hartley
…