Skip to content

Commit

Permalink
Document the experiments
Browse files Browse the repository at this point in the history
  • Loading branch information
mirkobunse committed Jun 12, 2023
1 parent 51466ad commit b8ec2b8
Show file tree
Hide file tree
Showing 2 changed files with 52 additions and 0 deletions.
51 changes: 51 additions & 0 deletions docs/source/experiments.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
# Experiments

We validate the performance of `qunfold`, in comparison to [QuaPy](https://github.com/HLT-ISTI/QuaPy), through experiments with the [LeQua2022 data](LeQua2022.github.io/). We document these experiments for transparency and to facilitate implementations of similar experiments.


## Setup

You can install the dependencies either in an isolated [Docker](https://docs.docker.com/) environment or locally with `venv`.

### Docker setup (optional)

We provide an isolated Docker environment for conveniently running the experiments. To create the image and start a container from it, call

```bash
cd docker/
make
./run.sh
```

Inside the container, navigate to the `qunfold` repository and install the dependencies

```bash
cd /mnt/home/.../qunfold/
pip install .[experiments]
```

### Local setup (alternative)

Without Docker, use `venv` to install the dependencies

```bash
python -m venv venv
venv/bin/pip install -e .[experiments]
```


## Running the experiments

The experiments are implemented through a main function that you can call as follows:

```bash
venv/bin/python -m qunfold.experiments.lequa lequa_results.csv
```

With the `--is_test_run` switch, you can execute the entire code path with minimal effort, to test whether the experiment is working. This functionality is particularly helpful if you make changes to the experiments.

Finally, the tables with average performance values are created as follows:

```bash
venv/bin/python -m qunfold.experiments.create_table lequa_results.csv lequa_results.tex
```
1 change: 1 addition & 0 deletions docs/source/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
self
api
developer-guide
experiments
```

# Quickstart
Expand Down

0 comments on commit b8ec2b8

Please sign in to comment.