git clone [email protected]:dl4aed-20/code.git- Attention: Some submodules are large (most files are in Git LFS, see below in Git LFS how to work with it)
git submodule update --initgit submodule update -r
- We suggest to use the
docker_environment.shfile and adapting it, whether you have a GPU or not - Connect to the Jupyter interface of the container and login with the token printed by the container
- Open a terminal or run it a notebook with a bash cell or export ENV Variables within the code:
pip install -r requirements.txtexport WANDB_PROJECT=<desired project>- For local testing only please also use(is default):
export WANDB_MODE=dryrun
- For online tracking of the training use:
export WANDB_MODE=run
- For synced training(online) run in a terminal(you need an W&B account for this):
wandb login
- Execute "Data_Preprocessing.ipynb" once (saves the dataset e.g. in /tmp/ folder)
- Execute "Training.ipynb" once per training (trains model and saves it into models/ folder)
- Execute "ANN_Inference.ipynb" once per trained model to evalute embedding and classify genres/songs (creates ANN/Plots/Metrics of a model)
- The data preparation and the model training is configured via the "config.json"
- You can also use command line arguments (also via W&B) and overwrite config settings during the execution
- Leave it as it is, to reproduce our results
export WANDB_ENTITY=dl4aedexport WANDB_API_KEY=<your api key>
export WANDB_NOTEBOOK_NAME=Training
- Integrate classifier model into training loop. ✅
- Build Inference pipeline: embed -> song-recognition. ✅
- Inspect & maybe implement Transfer Learning (for spectrograms?). 🔜
- Prepare slides. ✅
- Build ResNet-Model. ✅
- Test different dataset. ✅
- Extending scope lenght of each image (1 image should have longer temporal view than ~3 sec.). 🔜
- Install it on your local system: https://www.atlassian.com/git/tutorials/git-lfs#installing-git-lfs
- If you don't want to download the LFS files use
GIT_LFS_SKIP_SMUDGE=1right before yourgit cloneorgit submodule - If you want to fetch all of them later use in the command
git lfs fetch --allor just fetching specific folders or excluding a file: https://github.com/git-lfs/git-lfs/blob/main/docs/man/git-lfs-fetch.1.ronn#options - To checkout the fetched files into your repo use
git lfs checkout - Ignore errors like
error: somefile: cannot add to the index - missing --add option?the file is still downloaded - If you did something wrong, discard all changes
git reset --hard
- Is the file: "paper.pdf"