Reluctant Generalised Additive Modelling
A multi‐stage algorithm, called reluctant generalised additive modelling (RGAM), that can fit sparse GAMs at scale and is guided by the principle that, if all else is equal, one should prefer a linear feature over a non‐linear feature.
Abstract
<jats:title>Summary</jats:title><jats:p>Sparse generalised additive models (GAMs) are an extension of sparse generalised linear models that allow a model's prediction to vary non‐linearly with an input variable. This enables the data analyst build more accurate models, especially when the linearity assumption is known to be a poor approximation of reality. Motivated by reluctant interaction modelling, we propose a multi‐stage algorithm, called <jats:italic>reluctant generalised additive modelling (RGAM)</jats:italic>, that can fit sparse GAMs at scale. It is guided by the principle that, if all else is equal, one should prefer a linear feature over a non‐linear feature. Unlike existing methods for sparse GAMs, RGAM can be extended easily to binary, count and survival data. We demonstrate the method's effectiveness on real and simulated examples.</jats:p>