-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
51466ad
commit b8ec2b8
Showing
2 changed files
with
52 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,51 @@ | ||
# Experiments | ||
|
||
We validate the performance of `qunfold`, in comparison to [QuaPy](https://github.com/HLT-ISTI/QuaPy), through experiments with the [LeQua2022 data](LeQua2022.github.io/). We document these experiments for transparency and to facilitate implementations of similar experiments. | ||
|
||
|
||
## Setup | ||
|
||
You can install the dependencies either in an isolated [Docker](https://docs.docker.com/) environment or locally with `venv`. | ||
|
||
### Docker setup (optional) | ||
|
||
We provide an isolated Docker environment for conveniently running the experiments. To create the image and start a container from it, call | ||
|
||
```bash | ||
cd docker/ | ||
make | ||
./run.sh | ||
``` | ||
|
||
Inside the container, navigate to the `qunfold` repository and install the dependencies | ||
|
||
```bash | ||
cd /mnt/home/.../qunfold/ | ||
pip install .[experiments] | ||
``` | ||
|
||
### Local setup (alternative) | ||
|
||
Without Docker, use `venv` to install the dependencies | ||
|
||
```bash | ||
python -m venv venv | ||
venv/bin/pip install -e .[experiments] | ||
``` | ||
|
||
|
||
## Running the experiments | ||
|
||
The experiments are implemented through a main function that you can call as follows: | ||
|
||
```bash | ||
venv/bin/python -m qunfold.experiments.lequa lequa_results.csv | ||
``` | ||
|
||
With the `--is_test_run` switch, you can execute the entire code path with minimal effort, to test whether the experiment is working. This functionality is particularly helpful if you make changes to the experiments. | ||
|
||
Finally, the tables with average performance values are created as follows: | ||
|
||
```bash | ||
venv/bin/python -m qunfold.experiments.create_table lequa_results.csv lequa_results.tex | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -4,6 +4,7 @@ | |
self | ||
api | ||
developer-guide | ||
experiments | ||
``` | ||
|
||
# Quickstart | ||
|