In epidemiology and biostatistics, a continuous predictor such as age can be divided into intervals and represented with a step function. Each age bin receives a separate constant response level, allowing a model to represent changes that occur across age ranges.

University of Michigan - Ann Arbor

Google

A step-function model replaces one global linear fit with several flat pieces. First, split the predictor range into intervals, or bins. Then estimate a separate constant response level within each bin.

Because the fitted value changes only when the predictor crosses a bin boundary, the model is easy to interpret: each interval has its own average outcome. This makes a continuous variable behave like an ordered categorical variable, which can be helpful when the response changes in distinct ranges rather than smoothly.

Step Functions

Regression splines combine the benefits of polynomial curve fitting and step functions to provide a more flexible estimated function. By dividing the range of the independent variable $$X$$ into enough regions, we can theoretically fit any function. However, this flexibility comes at the expense of potential overfitting and reduced interpretability of the coefficients. Therefore, a trade-off must be considered when deciding on the number of regions.

Learn Before

Related