Evaluation of Meta-learning initialization(MI) for Sequential Model-Based Optimization(SMBO) with Tree Parzen Estimator(TPE). Roughly follows [Feurer et al. 2015].
Works as follows:
- Downloads the datasets used in the paper from OpenML
- Extracts metafeatures
- Random Search for best hyperparameters
- Evaluate MI-TPE and TPE in leave-one-dataset-out fashion with warm starting MI-TPE on the data from step 3
Run:
python3 MI_TPE.py