Skip to content

Latest commit

 

History

History
60 lines (53 loc) · 2.59 KB

README_DACBench.md

File metadata and controls

60 lines (53 loc) · 2.59 KB
Raw

DACBench

Documentation Status Run Python Tests

DACBench is a benchmark library for Dynamic Algorithm Configuration. Its focus is on reproducibility and comparability of different DAC methods as well as easy analysis of the optimization process.

If you use DACBench in you research or application, please cite us:

@inproceedings{eimer-ijcai21,
  author    = {T. Eimer and A. Biedenkapp and M. Reimer and S. Adriaensen and F. Hutter and M. Lindauer},
  title     = {DACBench: A Benchmark Library for Dynamic Algorithm Configuration},
  booktitle = {Proceedings of the Thirtieth International Joint Conference on
               Artificial Intelligence ({IJCAI}'21)},
  year      = {2021},
  month     = aug,
  publisher = {ijcai.org},
}

Installation

We recommend to install DACBench in a virtual environment. Note that even if you choose to not use a virtual env, please make sure you run all experiments using python 3.6 as some benchmarks are not compatible with other python versions! To install DACBench including the dependencies to run examples:

conda create -n dacbench python=3.6
conda activate dacbench
git clone https://github.com/automl/DACBench.git
cd DACBench
git submodule update --init --recursive
pip install -e .[example]

When using the Fast Downward Benchmark, you need to build it separately (we recommend cmake version 3.10.2). Make sure you have previously called:

git submodule update --init --recursive

Then run:

./dacbench/envs/rl-plan/fast-downward/build.py

If want to work on DACBench as a developer you can use the dev extra option instead:

pip install -e .[dev]

To install all extras (dev, example and docs) run:

pip install -e .[dev,example,docs]

Using DACBench

After installing DACBench, you can start developing immediately. For an introduction to the interface and structure of DACBench, see the "Getting Started" jupyter notebook. You can also take a look at our examples in the repository or our documentation. You can find baseline data of static and random policies for a given version of DACBench on our TNT project site.