Best Subsets Logistic Regression

The purpose of this note is to illustrate that for one of the more frequently used nonnormal regression models, logistic regression, one may perform the Lawless-Singhal analysis with any best subsets linear regression program that allows for case weights.

Abstract

Selection of covariates is an important step in any regression modeling situation. An effective strategy when the model is a linear regression with normal errors is to use a software package that implements a best subsets selection algorithm. A number of years ago Lawless and Singhal (1978) proposed a method for efficiently screening nonnormal regression models, thus providing the basis for best subsets nonlinear regression. Recently Lawless and Singhal (1987a, 1987b) have made available a software package that implements their method. The purpose of this note is to illustrate that for one of the more frequently used nonnormal regression models, logistic regression, we may perform the Lawless-Singhal analysis with any best subsets linear regression program that allows for case weights. The methods presented may also be obtained from the general method for model selection proposed by Gilks (1986). We also discuss the use and interpretation of Mallows's measure of predictive squared error as a statistic for comparing models with different subsets of variables.