Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] GNN model #18

Closed
wants to merge 52 commits into from
Closed

[Feature] GNN model #18

wants to merge 52 commits into from

Conversation

matteobettini
Copy link
Collaborator

This PR aims at introducing a GNN model customizable via torch_geometric.

This is currently on hold because of:

pytorch/rl#1576

matteobettini and others added 30 commits August 24, 2023 18:35
Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
[Algorithm] ISAC
Signed-off-by: Matteo Bettini <[email protected]>
[Algorithm] QMIX
Signed-off-by: Matteo Bettini <[email protected]>
[Algorithm] VDN
Signed-off-by: Matteo Bettini <[email protected]>
[Algorithm] IQL
Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
[Config] Hydra config
* update defaults

Signed-off-by: Matteo Bettini <[email protected]>

* update defaults

Signed-off-by: Matteo Bettini <[email protected]>

---------

Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
---------

Signed-off-by: Matteo Bettini <[email protected]>
* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* ippo one optim

Signed-off-by: Matteo Bettini <[email protected]>

* revert ippo

Signed-off-by: Matteo Bettini <[email protected]>

* cfg

Signed-off-by: Matteo Bettini <[email protected]>

* update task config

Signed-off-by: Matteo Bettini <[email protected]>

* remove callback

Signed-off-by: Matteo Bettini <[email protected]>

* readme loggers

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

---------

Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* ippo one optim

Signed-off-by: Matteo Bettini <[email protected]>

* revert ippo

Signed-off-by: Matteo Bettini <[email protected]>

* cfg

Signed-off-by: Matteo Bettini <[email protected]>

* update task config

Signed-off-by: Matteo Bettini <[email protected]>

* remove callback

Signed-off-by: Matteo Bettini <[email protected]>

* readme loggers

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* allow wandb loading

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* add finishing logging

Signed-off-by: Matteo Bettini <[email protected]>

* more printing

Signed-off-by: Matteo Bettini <[email protected]>

* more printing

Signed-off-by: Matteo Bettini <[email protected]>

* fixes

Signed-off-by: Matteo Bettini <[email protected]>

* fixes

Signed-off-by: Matteo Bettini <[email protected]>

* fixes

Signed-off-by: Matteo Bettini <[email protected]>

* add .pt

Signed-off-by: Matteo Bettini <[email protected]>

* move saving

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

---------

Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
matteobettini and others added 21 commits September 15, 2023 10:29
Signed-off-by: Matteo Bettini <[email protected]>
* smac

Signed-off-by: Matteo Bettini <[email protected]>

* smac

Signed-off-by: Matteo Bettini <[email protected]>

* render smac

Signed-off-by: Matteo Bettini <[email protected]>

* render smac

Signed-off-by: Matteo Bettini <[email protected]>

* render smac

Signed-off-by: Matteo Bettini <[email protected]>

* render smac

Signed-off-by: Matteo Bettini <[email protected]>

* render smac

Signed-off-by: Matteo Bettini <[email protected]>

* render smac

Signed-off-by: Matteo Bettini <[email protected]>

* render smac

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* remove suprlus

Signed-off-by: Matteo Bettini <[email protected]>

---------

Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* empty

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* remove hydra dependency

Signed-off-by: Matteo Bettini <[email protected]>

* rename folder

Signed-off-by: Matteo Bettini <[email protected]>

* rename file

Signed-off-by: Matteo Bettini <[email protected]>

* update tasks

Signed-off-by: Matteo Bettini <[email protected]>

* update models

Signed-off-by: Matteo Bettini <[email protected]>

* update models

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* update algos

Signed-off-by: Matteo Bettini <[email protected]>

* add test

Signed-off-by: Matteo Bettini <[email protected]>

---------

Signed-off-by: Matteo Bettini <[email protected]>
* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* add test

Signed-off-by: Matteo Bettini <[email protected]>

* add test

Signed-off-by: Matteo Bettini <[email protected]>

* add test

Signed-off-by: Matteo Bettini <[email protected]>

* add test

Signed-off-by: Matteo Bettini <[email protected]>

* add test

Signed-off-by: Matteo Bettini <[email protected]>

* add test

Signed-off-by: Matteo Bettini <[email protected]>

---------

Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
* update

Signed-off-by: Matteo Bettini <[email protected]>

* update

Signed-off-by: Matteo Bettini <[email protected]>

* update

Signed-off-by: Matteo Bettini <[email protected]>

* update

Signed-off-by: Matteo Bettini <[email protected]>

* update

Signed-off-by: Matteo Bettini <[email protected]>

* update

Signed-off-by: Matteo Bettini <[email protected]>

* make eps init and end standardized

Signed-off-by: Matteo Bettini <[email protected]>

* remove prioritised buffers

Signed-off-by: Matteo Bettini <[email protected]>

* update

Signed-off-by: Matteo Bettini <[email protected]>

* update

Signed-off-by: Matteo Bettini <[email protected]>

* finish removal of prioritised buffers

Signed-off-by: Matteo Bettini <[email protected]>

---------

Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
* temp

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

* amend

Signed-off-by: Matteo Bettini <[email protected]>

---------

Signed-off-by: Matteo Bettini <[email protected]>
Signed-off-by: Matteo Bettini <[email protected]>
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants