Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

robosuite #92

Closed
wants to merge 30 commits into from
Closed

robosuite #92

wants to merge 30 commits into from

Conversation

saikrishna-1996
Copy link
Contributor

No description provided.

cloderic and others added 14 commits July 15, 2022 11:21
- action mask
- turn based play
- connect four UI
* add debugger for docs in the next branch

* correct the typo
* Fix config bug

* Fix pytorch multiproccessing bug

* Move torch specific multiprocessing config to torch imports

* Add space to pass license test

Co-authored-by: saikrishnagv_1996 <[email protected]>
* fix SimpleQueue issue

* add a2c run config and reference in experiment

* ToDos

* black formatting

* fix override_run in simple_a2c/cartpole
@saikrishna-1996 saikrishna-1996 self-assigned this Sep 21, 2022
@saikrishna-1996 saikrishna-1996 marked this pull request as draft September 21, 2022 15:25
@saikrishna-1996 saikrishna-1996 marked this pull request as ready for review September 24, 2022 20:23
@saikrishna-1996
Copy link
Contributor Author

There are no continuous action based agents yet in the next branch. So couldn't test the performance with an agent yet but the environment is running - test with python -m main +experiment=simple_a2c/robosuite (do not forget to install the new requirements added in requirements.txt )

saikrishna-1996 and others added 4 commits October 2, 2022 00:47
* add ppo for continuous actions

* fix lint

* remove debug folder

* fix lint

* fix lint

* refactor gym env wrapper

* latest code

* multi envs with a single agent for ppo

* remove debugger

* latest code

* clean code

* fixed lint

* remove time profiler results

* uncomment the render option for gym

* revised version according to the reviewers feedback
* remove duplicates in gym adapter

* remove duplicates in gym adapter

* fix lint
saikrishna-1996 and others added 6 commits November 3, 2022 17:13
* TD3

* add exploration noise, black format

* remove unused imports

* new test

* hacky fix to sample_space

* add random action

* current

* fix shape bug in critic loss, add extra model params

* current

* converrging rewards afrer 400K time steps

* black formatting

* fix pylint issues

* chill out pylint

* disable pylint in td3.py
* isaac adapter, configs

* add isaacgym requirements

* arrange imports

* add isaacgym installation instructions in README

* fix import issue

* edit requirements, readme, mlflow port

* fixes

* hydra config

* add extra instructions for isaac gym

* add full readme instructions

* black format

* Update config.yaml

* Update import_class.py

* Update environment.py

* remove unused imports

* disable pylint

* pylint

* pylint test

* fixed some issues for isaac gym

* black format

* fixed some bugs

* fix vugs (#102)

* fix vugs

* fix gym adapter

Co-authored-by: Luong-Ha Nguyen <[email protected]>

* black formatting

* fix pylint

* pylint

* handle both discrete and continous actions

* no cuda imposition in simple_a2c

* config.environment_specs

* pylint fix in TD3

* modified random action size

* put replaybuffer back

* fixed lint

Co-authored-by: Luong-Ha Nguyen <[email protected]>
Co-authored-by: Luong-Ha Nguyen <[email protected]>
Co-authored-by: Luong-Ha Nguyen <[email protected]>
… using a tunnelling system (#109)

* Fix missing constructor parameters

* Introduce a trial lobby

* Fix copyright notices

* Adding documentation for ngrok based tunnel

* Take into account review
Base automatically changed from next to main January 24, 2023 19:32
@sagarkurandwad sagarkurandwad self-requested a review January 30, 2023 21:35
@saikrishna-1996
Copy link
Contributor Author

moving to #124

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants