Simple filtering options with sequential search.

[pinehowe]

The sequential search method for variable selection is excellent, although there are some simple tweaks that could make it easier to use, like adding in a variable correlation filter for forward selection. That would be an easy way to avoid collinearity issues with some tree-based machine learning models like XGBoost & random forest where including collinear variables decreases the interpretability of individual variable effects.