Does DifficultyEstimator require preprocessing?

[thomasmeissnercrm]

Hi,

in a Kaggle competition I try to epxlore the Crepes library. In the ReadMe a DifficultyEstimator is used, which calls KNN under the hood.

As I used LGBM as the main regressor, I did not scale the data. However I wonder if this is required once I make use of the DifficultyEstimator. Or is this done by Crepes already?

The question came up, because this notebook performs much worse than another one where I only used the WrapRegressor. So I assume I have some issue in the code, may it be some missing preprocessing or something else.

For reference the notebooks:

• WrapRegressor only
• Mondrian with DifficultyEstimator.

[henrikbostrom]

Hi,

The call to k-NN does indeed scale the data, so this is not required.

If something is missing from the documentation, as in this case, you may peek directly into the code by following the [source] link just to the right of the documented class/function; in this case you may look at the code here and you will find the call to the scaler just after "if self.estimator_type == "knn".

Best regards,
Henrik