Update openai-gym fork #1

* Update pendulum.py * version warnings * black * try except * update notices version * Exception * nosec * black * no loop, stderr * black

* Update box2d/toy_text docs * md format and additional fixes * grammar

* update frozen_lake docs * add version history to frozen lake

* Changed Ant docstring * Changed half cheetah docstring * Changed Hopper docstring, modified formulations for Ant, HalfCheetah * Changed humanoid docstring * Changed HumanoidStandup, InvertedDoublependulum, InvertedPendulum docstrings * Updated remaining docstrings, updated names of reward terms, added notes about info

* Update pendulum.py * version warnings * black * try except * update notices version * Exception * nosec * black * no loop, stderr * black * convert ## to ### * correct subheader * black * despace * spacing

* Update pendulum.py * version warnings * black * try except * update notices version * Exception * nosec * black * no loop, stderr * black * convert ## to ### * correct subheader * black * despace * spacing * frozen lake fixes

* Make `NormalizeObservation` compatible with pybullet * Quick fix * Update test cases * Quick fix * pre-commit

* Changed snippet in README.md to show off new API * Added new line in snippet

* Update pendulum.py * version warnings * black * try except * update notices version * Exception * nosec * black * no loop, stderr * black * convert ## to ### * correct subheader * black * despace * spacing * frozen lake fixes * rename render modes/fps * fix API test * fix API test * fix more API tests * black * add render fps

* Removed Striker and Thrower * Removed from init as well * Removed assets

* Locked framerate in human-mode rendering for box2d and classic_control * Fixed pyright errors * Use the new metadata key for FPS, add toytext environments

* Fix RandomNumberGenerator pickling * Add test for RNG pickling fix * Fix Python 3.7 compatibility about tuple unpacking See: https://bugs.python.org/issue32117 * Fix formatting issue * Add test for space pickling

* Box Boundedness determined using get_inf instead of np.inf * Store original array entries for determining boundedness * Capture the boundedness before casting away the np.inf * Removed requirement that integer spaces be bounded above and below * np full casts away the inf, so using dtype float for boundedness evaluation * Removed commented code * But the type ignore hint back in * Spacing change from black code formatter

* compatibility for loading legacy Discrete states * super * format

* Remove display initialization when not rendering in human mode * Fix formatting

* Update pendulum.py * version warnings * black * try except * update notices version * Exception * nosec * black * no loop, stderr * black * convert ## to ### * correct subheader * black * despace * spacing * frozen lake fixes * rename render modes/fps * fix API test * fix API test * fix more API tests * black * add render fps * render_fps API test * black * Update env_checker.py

* gym.spaces.Tuple inherits from collections.abc.Sequence Following the PR I did a few months back (#2446), the tuple wrapper of gym should inherits from the abstract interface of Python. It is important for type check via `isinstance` and enable using such objects transparently with libraries such as [dmtree](https://github.com/deepmind/tree). It will bring a way helper methods along the way but it cannot be avoided to interoperability: : `__iter__`, `__reversed__`, `index`, and `count` Personally I don't think it is an issue since it is new features and it is not conflicting. As the previous PR, this patch is NOT removing any existing feature and should not break backward compatibility. * Add unit test * Fix unit tests * Final fix. * Remove irrelevant comment. * Fix black formatter.

* Fix flatten utils to handle Discrete.start * Fix vector space utils to handle Discrete.start * More granular dispatch in vector utils * Fix Box including the high end of the interval

* Make `VideoRecorder` backward-compatible to `gym<0.23` * Format * format

* Fix issues with pygame event handling * Fix display initialization and exit for jupyter

As is described in https://peps.python.org/pep-0561/#packaging-type-information

`pip install gym[atari]` will not install opencv. Correct way to install opencv is `pip install gym[other]` .

* Pusher Docs * Fix precommit * remove striker and thrower archive files

* Pusher Docs * Fix precommit

* Updated cartpole-v0 to v1 to prevent warning and added pytest.mark.filterwarnings for tests where warnings are unavoidable * Change np.bool to bool as numpy raises a warning and bool is the suggested solution * Seeding randint is deprecated in the future, integers is new solution * Fixed errors thrown when the video recorder is deleted but not closed * spaces.Box expects a floating array, updated all cases where this was not true and modified float32 to float64 as float array default to float64. Otherwise space.Box raises warning that dtype precision (float32) is lower than array precision (float64). * Added pytest.mark.filterwarnings to preventing the raising of an intended warning * Added comment to explain why a warning is raised that can't be prevented without version update to the environment * Added comment to explain why warning is raised * Changed values to float as expected by the box which default to float64 * Removed --forked from pytest as the pytest-forked project is no being maintained and was not raising warnings as expected * When AsyncVectorEnv has shared_memory=True then a ValueError is raised before _state is initialised. Therefore, on the destruction on the env an error is thrown in .close_extra as _state does not exist * Possible fix that was causing an error in test_call_async_vector_env by ensuring that pygame resources are released * Pygame throws an error with ALSA when closed, using a fix from PettingZoo (https://github.com/Farama-Foundation/PettingZoo/blob/master/pettingzoo/__init__.py). We use the dsp audiodriver to prevent this issue * Modification due to running pre-commit locally * Updated cartpole-v0 to v1 to prevent warning and added pytest.mark.filterwarnings for tests where warnings are unavoidable * Change np.bool to bool as numpy raises a warning and bool is the suggested solution * Seeding randint is deprecated in the future, integers is new solution * Fixed errors thrown when the video recorder is deleted but not closed * spaces.Box expects a floating array, updated all cases where this was not true and modified float32 to float64 as float array default to float64. Otherwise space.Box raises warning that dtype precision (float32) is lower than array precision (float64). * Added pytest.mark.filterwarnings to preventing the raising of an intended warning * Added comment to explain why a warning is raised that can't be prevented without version update to the environment * Added comment to explain why warning is raised * Changed values to float as expected by the box which default to float64 * Removed --forked from pytest as the pytest-forked project is no being maintained and was not raising warnings as expected * When AsyncVectorEnv has shared_memory=True then a ValueError is raised before _state is initialised. Therefore, on the destruction on the env an error is thrown in .close_extra as _state does not exist * Possible fix that was causing an error in test_call_async_vector_env by ensuring that pygame resources are released * Pygame throws an error with ALSA when closed, using a fix from PettingZoo (https://github.com/Farama-Foundation/PettingZoo/blob/master/pettingzoo/__init__.py). We use the dsp audiodriver to prevent this issue * Modification due to running pre-commit locally

* Update pendulum.py * version warnings * black * try except * update notices version * Exception * nosec * black * no loop, stderr * black * convert ## to ### * correct subheader * black * despace * spacing * frozen lake fixes * rename render modes/fps * fix API test * fix API test * fix more API tests * black * add render fps * render_fps API test * black * Update env_checker.py * black

numpy has been import at the beginning of this file: https://github.com/openai/gym/blob/master/gym/spaces/space.py#L13

* Fixed bug for issue 2702 where blackjack and frozen lake won't close the render on jupyter notebook * As screen is initialised outside __init__, close needs to check if screen exists as an attribute before quitting pygame

#2714)

* added autoreset wrapper and tests * added basic inline documentation for autoreset wrapper * changes to comply with flake8 style * redid autoreset wrapper * compliance with flake8 * added final_info to info * removed unnecessary override from autoreset wrapper * fixed ordering mistake * fixed flake8 compliance * improved clarify of inline documentation * changes to address code review * changed autoreset terminal state keys, added message to key overlap check assert statement, updated autoreset wrapper docstring

add a call to __del__ of parent class Revert "add a call to __del__ of parent class" This reverts commit 24d40d8.

* feat: add `isort` to `pre-commit` * ci: skip `__init__.py` file for `isort` * ci: make `isort` mandatory in lint pipeline * docs: add a section on Git hooks * ci: check isort diff * fix: isort from master branch * docs: add pre-commit badge * ci: update black + bandit versions * feat: add PR template * refactor: PR template * ci: remove bandit * docs: add Black badge * ci: try to remove all `|| true` statements * ci: remove lint_python job - Remove `lint_python` CI job - Move `pyupgrade` job to `pre-commit` workflow * fix: avoid messing with typing * docs: add a note on running `pre-cpmmit` manually * ci: apply `pre-commit` to the whole codebase

* Added check for return_info, only warn about missing render_fps if human mode is available * Require render_fps if any kind of rendering is implemented

…er.py (#2703) * Fixed warnings produced by test_record_video.py and test_video_recorder.py by using the self._frames_per_sec value as default value if video.frames_per_second is missing * The default backward compatible values if video.frames_per_second and video.output_frames_per_seconds are the updated frames_per_sec and output_frames_per_sec values

* Moved pygame imports into render * Formatting

* isort * update pre commit

* Moved pygame imports into render * Formatting * Make pygame optional for box2d, try to make formatting work * fix tests, fix pre-commit. Co-authored-by: Ariel Kwiatkowski <[email protected]> Co-authored-by: Gianluca De Cola <[email protected]>

* Moved pygame imports into render * Formatting * Make pygame optional for box2d, try to make formatting work * fix tests, fix pre-commit. * Update ci linter config. * fix type hints for latest pyright version and backward compatibility with numpy <= 1.21.5 * pre-commit. Co-authored-by: Ariel Kwiatkowski <[email protected]> Co-authored-by: Gianluca De Cola <[email protected]>

* added autoreset wrapper and tests * added basic inline documentation for autoreset wrapper * changes to comply with flake8 style * redid autoreset wrapper * compliance with flake8 * added final_info to info * removed unnecessary override from autoreset wrapper * fixed ordering mistake * fixed flake8 compliance * improved clarify of inline documentation * changes to address code review * changed autoreset terminal state keys, added message to key overlap check assert statement, updated autoreset wrapper docstring * auto-reset integration draft * changed arg name to autoreset for consistency * pre commit compliance * formatting compliance * addressed code review * removed commented out line

…ebugging easier (#2740)

* Add some missing typehints for bipedal walker * fix bounds * fix boudns

* fix impulse sample bug and add adjustable gravity * revert weird sample thing * assertation * add wind * fix wind to use applyforce * black * add tests for wind * fix test bug * run lunar lander tests over 10 runs * reduce wind for heuristic landing * made wind power kwarg * reduce wind power for heuristic landing * update doc * remove wind power from kwarg * fix tests by deleting tests ;) * Add back wind power as kwarg * the black sheep * remove rogue plus

* first commit domain randomize * black * update doc * add some type hints and internalized some functions * we were told, the black bear is innocent; but I should not like to trust myself wit him * Don't need two color conventions * don't multiply twice * hardcore -> domain_randomize & register * remove rogue decorator

… the variable names (#2755)

* fix impulse sample bug and add adjustable gravity * revert weird sample thing * assertation * add wind * fix wind to use applyforce * black * add tests for wind * fix test bug * run lunar lander tests over 10 runs * reduce wind for heuristic landing * made wind power kwarg * reduce wind power for heuristic landing * update doc * remove wind power from kwarg * fix tests by deleting tests ;) * Add back wind power as kwarg * the black sheep * remove rogue plus * slight doc fix and variable rename * fix bug with track turn indicators * black

* refactoring play function. Tests for keys to action mapping. * Add mocking pygame events. * partial event processing in class. * pre-commit. * quit pygame after tests. * fix typos in functions names. * Add type hint. * Add test for play function. * remove mockKeyEvent. * remove unused main code. * Adding type hints. * catch custom exception in tests. * Fix magic numbers. * Add test with an actual environment. * fix comment. * Add TODO memo on env.render. * change map with list comprehension. * remove unused imports. * Add type hint. * typo. * docstring.

* reduce wind power further for heuristic landing * remove wind tests for lunar lander * don't need to reduce wind for heuristic

* Rephrase * Rephrase

* First version of the new registration * Almost done * Hopefully final commit * Minor fixes * Missing error * Type fixes * Type fixes * Add some type hinting stuff * Fix an error? * Fix literal import * Add a comment * Add some docstrings Remove old tests * Add some docstrings, rename helper functions * Rename a function * Registration check fix * Consistently use `register` instead of `envs.register` in tests * Fix the malformed registration error message to not use a write-only format * Change an error back to a warning when double-registering an environment

… 2680 (#2727) * Add a case for the Box shape where the low and high values are both scalars * Add seeding.RandomNumberGenerator parameter to Dict seed. Modify __repr__ for the dictionary space string looks similar to an actual dictionary * Add seeding.RandomNumberGenerator parameter to Multi Binary seed * Add seeding.RandomNumberGenerator parameter to Multi Binary seed. Modify nvec typing to include np.ndarray * Space seed typing can be a seeding.RandomNumberGenerator. If a seeding.RNG is provided then it is assigned to _np_random and .seed is not run * Fixed the tuple seeding type as List[int] is not a valid Space seed type * Added typing to batch_space. The batch_space seed is equal to the space's seeding * Fixed the seeding type * Add test for batch space seeds are identical to the original space's seeding * Add equivalence function for RandomNumberGenerator comparing the bit_generator.state * The batch_space functions uses a copy of the seed for the original space * Set the action space seed for sync_vector_env seed testing * Add test for the seeding of the sync vector environment * Update the test_batch_space_seed to check the resulting sampling are equivalent for testing * Revert representation back to the original version * Remove additional Box shape initialisation * Remove additional typing of MultiDiscrete * Fixed bug of Space batch space where the original space's np_random is not a complete copy of the original space * Add CustomSpace to the batched space seed test * Modify the CustomSpace sample to produce a random number not a static value * Fix CustomSpace to reflect the sample function * Copy the space.np_random for the batched_space seed to ensure that the original space doesn't sampling doesn't effect the batched_space * Parameterized the batch_space_seed, added testing for rng_different_at_each_index and test_deterministic * Black and isort pre-commit changes * Pre-commit fix * MacOS, test_read_from_shared_memory throws an error that the inner _process_write function was unpicklable. Making the function a top-level function solves this error * Fixed typing of seed where a space's seed function differs from Space.seed's typing * Added check that the sample lengths are equal and explicitly provided the number of batched spaces n=1 * Removed relative imports for absolute imports * Use deepcopy instead of copy * Replaces `from numpy.testing._private.utils import assert_array_equal` with `from numpy.testing import assert_array_equal` * Using the seeding `__eq__` function, replace `np_random.bit_generator.state` with `np_random` * Added docstrings and comments to the tests to explain their purpose * Remove __eq__ from RandomNumberGenerator and add to tests/vector/utils * Add sync vector determinism test for issue #2680 * Fixed bug for https://github.com/openai/gym/pull/2727/files/462101d3846bc35ff3fad9f65979c693472a93a8#r850740825 * Made the new seeds a list of integers

* Remove orphan comment The comment used to be due to the line that is not there anymore, like: ```python from gym.envs.mujoco.mujoco_env import MujocoEnv # ^^^^^ so that user gets the correct error # message if mujoco is not installed correctly ``` Now the comment is useless. * Update __init__.py

I have a copy of this string in another project and it failed the darglint docstring style check. This fixes that, if it's something you care to fix.

* Improved documentation to specify decode state space * Improve taxi documentation

* Remove additional ignores from flake8 * Remove all unused imports * Remove all unused imports * Update flake8 and pyupgrade * F841, removed unused variables * E731, removed lambda assignment to variables * Remove E731, F403, F405, F524 * Remove E722, bare exceptions * Remove E712, compare variable == True or == False to is True or is False * Remove E402, module level import not at top of file * Added --pre-file-ignores * Add --per-file-ignores removing E741, E302 and E704 * Add E741, do not use variables named ‘l’, ‘O’, or ‘I’ to ignore issues in classic control * Fixed issues for pytest==6.2 * Remove unnecessary # noqa * Edit comment with the removal of E302 * Added warnings and declared module, attr for pyright type hinting * Remove unused import * Removed flake8 E302 * Updated flake8 from 3.9.2 to 4.0.1 * Remove unused variable

* fix impulse sample bug and add adjustable gravity * revert weird sample thing * assertation * add wind * fix wind to use applyforce * black * add tests for wind * fix test bug * run lunar lander tests over 10 runs * reduce wind for heuristic landing * made wind power kwarg * reduce wind power for heuristic landing * update doc * remove wind power from kwarg * fix tests by deleting tests ;) * Add back wind power as kwarg * the black sheep * remove rogue plus * slight doc fix and variable rename * fix bug with track turn indicators * black * add discrete environment for carracing * update docs * reduce acceleration magnitude * reduce wind power to near nothing for heuristic landings * undo change on this branch * change actions * remove redundant import * fix docs

* Place try except around all imports for pygame and optional modules in box2d, classic_control and toy_text * Updated all ImportErrors to DependencyNotInstalled * Re-add comment on why pygame is imported

…heir actual file not __init__.py import (#2791)

…nd actions (#2803) (#2804)

) * add call, set_attr, __del__ to VecEnvWrapper * add docstring for test

* Added pydocstyle to pre-commit * Added docstrings for tests and updated the tests for autoreset * Add pydocstyle exclude folder to allow slowly adding new docstrings * Add docstrings for setup.py and gym/__init__.py, core.py, error.py and logger.py * Check that all unwrapped environment are of a particular wrapper type * Reverted back to import gym.spaces.Space to gym.spaces * Fixed the __init__.py docstring * Fixed autoreset autoreset test * Updated gym __init__.py top docstring * Remove unnecessary import * Removed "unused error" and make APIerror deprecated at gym 1.0 * Add pydocstyle description to CONTRIBUTING.md * Added docstrings section to CONTRIBUTING.md * Added :meth: and :attr: keywords to docstrings * Added :meth: and :attr: keywords to docstrings * Update the step docstring placing the return type in the as a note. * Updated step return type to include each element * Update maths notation to reward range * Fixed infinity maths notation

* Added docstrings for spaces, WIP * Formatting changes * Use raw docstring for Box.sample * Formatting fix * Formatting fix * Use :class:, :meth:, formatting fixes, resolve TODO, use Optional

…except natively (#2816)

* Improve performance for car racing rendering This change eliminates unnecessary drawing by pygame if it is out of bounds * Fix format with black * Fix out of bounds condition

* Add NOOP to play, allow for unordered key combination, strings as keys * Extended type hint

* create torque function * create comment for torque function * remove second arg from ApplyTorque * lower torque mag wind power to 20% * Add torque_power as kwarg * Use torque_power in ApplyTorque function * Set torque_wind kwarg default to 1.5 * Update version history for torque_power * Updated version 2 history for 0.24 * Updated arguments to include torque_power * Update assert for wind_power and torque_power can equal 0.0 * Update version history for v2 * Change torque_wind to turbulance_wind * Remove assert for wind_power, turbulence_power. Add warnings for wind_power, turbulence_power. Add recommendations for wind_power, turbulence_power to docs. * Update docs definition/recommended values for wind_power, turbulence_power * Add `v` before `0.24` version description

* Add action in bound checks. * add correct dtype to clip_action test. * ensure correct dtype in tests. * action check in car_racing no more needed. * Prune PR. parametrize tests with spec_list. * revert changes. * remove file. * remove magic number. * test both upper and lower bound for every action. * assert oob is really out of bound. also bugfix in action performed * valide car racing discrete action. Add docstrings. Include car racing discrete in tests. Co-authored-by: Gianluca De Cola <[email protected]>

* Fix edge case for out of bounds This deals with the edge case where an object's corner may not be in the screen, but the object still overlaps and should be drawn. * Calculate maximum diagonal for out of bounds calculation

* Add a minimal env checker on make * Unpack the space checker for custom messages * Update some dummy envs to use the right API * Try to fix observation space checking * And again * Wrong env * Swap the minimal env checker to the regular env checker. Change the argument name * Disable env checker for two test envs * Conver env checker exception into warnings. * Reenable env checker for test envs, it should only raise warning, no exceptions

* Added some compat methods * Some missing methods * Update registration.py * Style fix

@Markus28

* Added pydocstyle to pre-commit * Added docstrings for tests and updated the tests for autoreset * Add pydocstyle exclude folder to allow slowly adding new docstrings * Add docstrings for setup.py and gym/__init__.py, core.py, error.py and logger.py * Check that all unwrapped environment are of a particular wrapper type * Reverted back to import gym.spaces.Space to gym.spaces * Fixed the __init__.py docstring * Fixed autoreset autoreset test * Updated gym __init__.py top docstring * Fix examples in docstrings * Add docstrings and type hints where known to all functions and classes in gym/utils and gym/vector * Remove unnecessary import * Removed "unused error" and make APIerror deprecated at gym 1.0 * Add pydocstyle description to CONTRIBUTING.md * Added docstrings section to CONTRIBUTING.md * Added :meth: and :attr: keywords to docstrings * Added :meth: and :attr: keywords to docstrings * Imported annotations from __future__ to fix python 3.7 * Add __future__ import annotations for python 3.7 * isort * Remove utils and vectors for this PR and spaces for previous PR * Update gym/envs/classic_control/acrobot.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/envs/classic_control/acrobot.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/envs/classic_control/acrobot.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/spaces/dict.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/utils/env_checker.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/utils/env_checker.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/utils/env_checker.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/utils/env_checker.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/utils/env_checker.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/utils/ezpickle.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/utils/ezpickle.py Co-authored-by: Markus Krimmel <[email protected]> * Update gym/utils/play.py Co-authored-by: Markus Krimmel <[email protected]> * Pre-commit * Updated docstrings with :meth: * Updated docstrings with :meth: * Update gym/utils/play.py * Update gym/utils/play.py * Update gym/utils/play.py * Apply suggestions from code review Co-authored-by: Markus Krimmel <[email protected]> * pre-commit * Update gym/utils/play.py Co-authored-by: Markus Krimmel <[email protected]> * Updated fps and zoom parameter docstring * Update play docstring * Apply suggestions from code review Added suggested corrections from @Markus28 Co-authored-by: Markus Krimmel <[email protected]> * Pre-commit magic * Update the `gym.make` docstring with a warning for `env_checker` * Updated and fixed vector docstrings * Update test names for reflect the project filename style Co-authored-by: Markus Krimmel <[email protected]>

* Shift relative position of coordinates in render * Format file

* Up the ale-py version * Updates the ale-py version

* WIP refactor info API sync vector. * Add missing untracked file. * Add info strategy to reset_wait. * Add interface and docstring. * info with strategy pattern on async vector env. * Add default to async vecenv. * episode statistics for asyncvecnev. * Add tests info strategy format. * Add info strategy to reset_wait. * refactor and cleanup. * Code cleanup. Add tests. * Add tests for video recording with new info format. * fix test case. * fix camelcase. * rename enum. * update tests, docstrings, cleanup. * Changes brax strategy to numpy. add_strategy method in StrategyFactory. Add tests. * fix docstring and logging format. * Set Brax info format as default. Remove classic info format. Update tests. * breaking the wrong loop. * WIP: wrapper. * Add wrapper for brax to classic info. * WIP: wrapper with nested RecordEpisodeStatistic. * Add tests. Refactor docstrings. Cleanup. * cleanup. * patch conflicts. * rebase and conflicts. * new pre-commit conventions. * docstring. * renaming. * incorporate info_processor in vecEnv. * renaming. Create info dict only if needed. * remove all brax references. update docstring. Update duplicate test. * reviews. * pre-commit. * reviews. * docstring. * cleanup blank lines. * add support for numpy dtypes. * docstring fix. * formatting. * naming. * assert correct info from wrappers chaining. Test correct wrappers chaining. naming. * simplify episode_statistics. * change args orer. * update tests. * wip: refactor episode_statistics. * Add test for add_vecore_episode_statistics.

* Fixed minor docstring issues found on the website * Updated the top docstrings with mujoco environments that fixed the observation and action tables. Added v4 gym.make code

* Updated docstrings using darglint, ignoring 402 and 202 plus shortened lines into multiple where they were overflowing * Remove abstract method decorators, for a future PR * Add __future__ import annotation for python 3.7+ notion * Added missing bracket * Fix minor docstring tables

* Add support for python 3.6 * Add support for python 3.6 * Added check for python 3.6 to not install mujoco as no version exists * Fixed the install groups for python 3.6 * Re-added python 3.6 support for gym * black * Added support for dataclasses through dataclasses module in setup that backports the module * Fixed install requirements * Re-added dummy env spec with dataclasses * Changed type for compatability for python 3.6 * Added a python 3.6 warning * Fixed python 3.6 typing issue * Removed __future__ import annotation for python 3.6 support * Fixed python 3.6 typing

Inserting operations in the xml file cases MuJoCo to ignore the operation and set to zero the following numbers

* Update registration.py * Style

Co-authored-by: Mark Towers <[email protected]>

* test hardcore environment creation. * add type hint. * typo.

…2858)

* fix arguments key callback * close env in renderer * mujoco_rendering close base method

…ent access to the `_np_random` in wrappers (#2857)

* Updated testing requirements based off extra["testing"] * Updated setup to check the version is valid, added testing and all dependency groups and collects the requirements from requirements.txt to keep everything standardized. * Updated requirements.txt based on the current minimum gym requirements.txt to work * Updated requirements.txt based on the current minimum gym requirements.txt to work * Updated test_requirements.txt based on the current gym full testing requirements * Pre-commit updates * Add integer check for the `n` parameter * The type of self.spaces is an Iterable which is absorbed by the tuple. * Simplifies the environment checker to two files, env_checker.py and passive_env_checker.py with a new wrapper env_checker.py * Adds the passive environment checker on `gym.make` * Ignore the `check_env` warn parameter * Ignore the `check_env` warn parameter * Use the `data_equivalence` function * Revert rewrite setup.py changes * Remove smart formatting for 3.6 support * Fixed `check_action_space` and `check_observation_space` * Added disable_env_checker to vector.make such that env_checker would only run on the first environment created. * Removing check that different seeds would produce different initialising states * Use the unwrapped environment np_random * Fixed vector environment creator

* Updated testing requirements based off extra["testing"] * Updated setup to check the version is valid, added testing and all dependency groups and collects the requirements from requirements.txt to keep everything standardized. * Updated requirements.txt based on the current minimum gym requirements.txt to work * Updated requirements.txt based on the current minimum gym requirements.txt to work * Updated test_requirements.txt based on the current gym full testing requirements * Pre-commit updates * Add integer check for the `n` parameter * The type of self.spaces is an Iterable which is absorbed by the tuple. * Simplifies the environment checker to two files, env_checker.py and passive_env_checker.py with a new wrapper env_checker.py * Adds the passive environment checker on `gym.make` * Ignore the `check_env` warn parameter * Ignore the `check_env` warn parameter * Use the `data_equivalence` function * Remove env_checker PR changes * Move pip install pytest and mock to py 3.6 * Update setup.py and requirements.txt

* add pygame GUI for frozen_lake.py env * add new line at EOF * pre-commit reformat * improve graphics * new images and dynamic window size * darker tile borders and fix ICC profile * pre-commit hook * adjust elf and stool size * Update frozen_lake.py * reformat * fix #2600 * #2600 * add rgb_array support * reformat * test render api change on FrozenLake * add render support for reset on frozenlake * add clock on pygame render * new render api for blackjack * new render api for cliffwalking * new render api for Env class * update reset method, lunar and Env * fix wrapper * fix reset lunar * new render api for box2d envs * new render api for mujoco envs * fix bug * new render api for classic control envs * fix tests * add render_mode None for CartPole * new render api for test fake envs * pre-commit hook * fix FrozenLake * fix FrozenLake * more render_mode to super - frozenlake * remove kwargs from frozen_lake new * pre-commit hook * add deprecated render method * add backwards compatibility * fix test * add _render * move pygame.init() (avoid pygame dependency on init) * fix pygame dependencies * remove collect_render() maintain multi-behaviours .render() * add type hints * fix renderer * don't call .render() with None * improve docstring * add single_rgb_array to all envs * remove None from metadata["render_modes"] * add type hints to test_env_checkers * fix lint * add comments to renderer * add comments to single_depth_array and single_state_pixels * reformat * add deprecation warnings and env.render_mode declaration * fix lint * reformat * fix tests * add docs * fix car racing determinism * remove warning test envs, customizable modes on renderer * remove commments and add todo for env_checker * fix car racing * replace render mode check with assert * update new mujoco * reformat * reformat * change metaclass definition * fix tests * implement mark suggestions (test, docs, sets) * check_render Co-authored-by: J K Terry <[email protected]>

…posite case than was intended to (#2871)

* Fix TimeLimit wrapper and add tests * Slip test

* allow mode as argument * change Wrapper render doc

* fix: add render_mode getter to Wrappers * fix: add render args to mujoco init * reformat * add type hints

…2921)

…envs. (#2921)" (#2923) This reverts commit af918d8.

…2920)

… rgb_array-rendering (#2719)

* Allows a new RNG to be generated with seed=-1 and updated env_checker to fix bug if environment doesn't use np_random in reset * Revert "fixed `gym.vector.make` where the checker was being applied in the opposite case than was intended to (#2871)" This reverts commit 519dfd9. * Remove bad pushed commits * Fixed spelling in core.py * Pins pytest to the last py 3.6 version * Add support for action masking in Space.sample(mask=...) * Fix action mask * Fix action_mask * Fix action_mask * Added docstrings, fixed bugs and added taxi examples * Fixed bugs * Add tests for sample * Add docstrings and test space sample mask Discrete and MultiBinary * Add MultiDiscrete sampling and tests * Remove sample mask from graph * Update gym/spaces/multi_discrete.py Co-authored-by: Markus Krimmel <[email protected]> * Updates based on Marcus28 and jjshoots for Graph.py * Updates based on Marcus28 and jjshoots for Graph.py * jjshoot review * jjshoot review * Update assert check * Update type hints Co-authored-by: Markus Krimmel <[email protected]>

* Allows a new RNG to be generated with seed=-1 and updated env_checker to fix bug if environment doesn't use np_random in reset * Revert "fixed `gym.vector.make` where the checker was being applied in the opposite case than was intended to (#2871)" This reverts commit 519dfd9. * Remove bad pushed commits * Fixed spelling in core.py * Pins pytest to the last py 3.6 version * Allow Box automatic scalar shape * Add test box and change default from () to (1,) * update Box shape inference with more strict checking * Update the box shape and add check on the custom Box shape * Removed incorrect shape type and assert shape code * Update the Box and associated tests

* Remove step initialization for mujoco obs spaces * remove step initialization for mujoco obs space * pre-commit pytest obs space mujoco

* Update pyproject.toml * Maybe fix typing for frozen lake and taxi * Clean up pyproject a bit * Reenable box2d pyright * Disable box2d pyright * Fix typing for toy text envs * Narrow down pyright excludes for almost everything except mujoco * Fix a wrapper test typing * Remove env checker from excludes * Remove redundant type hints which mess up pyright. And a typo fix. * Remove test_spaces exclude * Remove some redundant warnings * Change pyright ignore to more specific * Fix a weird private variable which gets explicitly exported for whatever reason. It's still exported for backwards compatibility, but internal code now uses a public variable. * re-export the private variable * Fix lunar_lander typing * Remove lunar lander from excludes * Small fix

…remove carracingdomainrandomize registration (#2931) * add option to change colour on carracing through "option" * fix dict bug * black * add docs for reset arg * fix thing * remove randomize from registration * update doc * update docs * update docs * remove unnecessary argument * fix thing * fix thing * f * update docs * add test * remove unused import * Update registration.py

)

* Allows a new RNG to be generated with seed=-1 and updated env_checker to fix bug if environment doesn't use np_random in reset * Revert "fixed `gym.vector.make` where the checker was being applied in the opposite case than was intended to (#2871)" This reverts commit 519dfd9. * Remove bad pushed commits * Fixed spelling in core.py * Pins pytest to the last py 3.6 version * Allow Box automatic scalar shape * Add test box and change default from () to (1,) * update Box shape inference with more strict checking * Update the box shape and add check on the custom Box shape * Removed incorrect shape type and assert shape code * Update the Box and associated tests * Remove all folders and files from pyright exclude * Revert issues * Push RedTachyon code review * Add Python Platform * Remove play from pyright check * Fixed CI issues * remove mujoco env type hinting * Fixed pixel observation test * Added some new type hints * Fixed CI errors * Fixed CI errors * Remove play.py from exlucde pyright * Fixed pyright issues

…ecker wrapper (#2903)

* Allows a new RNG to be generated with seed=-1 and updated env_checker to fix bug if environment doesn't use np_random in reset * Revert "fixed `gym.vector.make` where the checker was being applied in the opposite case than was intended to (#2871)" This reverts commit 519dfd9. * Remove bad pushed commits * Fixed spelling in core.py * Pins pytest to the last py 3.6 version * Add Text space * Add Text space * Added Text space * Updated comment * Allow Box automatic scalar shape * Add test box and change default from () to (1,) * Refactored conditional * Refactored contains() * update Box shape inference with more strict checking * Update the box shape and add check on the custom Box shape * Removed incorrect shape type and assert shape code * Update the Box and associated tests * Move dependency error to inside the atari environment * Update the gym version to v0.25.0 * Fixed bugs in Text space and tests * Code review by Drew Co-authored-by: Ryan Rudes <[email protected]>

* Allows a new RNG to be generated with seed=-1 and updated env_checker to fix bug if environment doesn't use np_random in reset * Revert "fixed `gym.vector.make` where the checker was being applied in the opposite case than was intended to (#2871)" This reverts commit 519dfd9. * Remove bad pushed commits * Fixed spelling in core.py * Pins pytest to the last py 3.6 version * Allow Box automatic scalar shape * Add test box and change default from () to (1,) * update Box shape inference with more strict checking * Update the box shape and add check on the custom Box shape * Removed incorrect shape type and assert shape code * Update the Box and associated tests * Move dependency error to inside the atari environment * Update the gym version to v0.25.0 * Bump car racing and remove car racing discrete

* Fix reset bounds for mountain car This was a typo bug that was introduced in ca39816 * Fix reset bounds for mountain_car This was a typo bug that was introduced in ca39816 * Fixing formatting of files with pre-commit

…2978) * init * adapt PixelObservationWrapper to new API * reformat Co-authored-by: younik <[email protected]>

(returning uncropped width)

Fix the type-o of rotors

* fix typo * add pygame render cliffwalking * refactor frozen lake, new images for cliffwalking * backto old images * improve graphics * use old images * refactor frozen lake * reformat

* fix render popping when render is called internally * move _render workaround from Wrapper to PixelObservation

* Added Sequence space, updated flatten functions to work with Sequence, Graph. WIP. * Small fixes, added Sequence space to tests * Replace Optional[Any] by Any * Added tests for flattening of non-numpy-flattenable spaces * Return all seeds

Using __init_subclass__ instead of metaclass, suggested by PEP 487(introduced in python3.6). As a result, downstream package can safely inherit from gym.Env and abc.ABC/Protocol/...(classes with metaclass != type), or set their own metaclass without making a intermediate metaclass inherited from custom metaclass and type(gym.Env).

* Reduce memory consumption and hanging. Signed-off-by: Olaf Lipinski <[email protected]> * Use len(subseeds) instead of x. Clearer error message Signed-off-by: Olaf Lipinski <[email protected]> * Allow for non-unique seeds in subspaces Signed-off-by: Olaf Lipinski <[email protected]> * Update docstrings Signed-off-by: Olaf Lipinski <[email protected]> * Update doc for Tuple Signed-off-by: Olaf Lipinski <[email protected]> Signed-off-by: Olaf Lipinski <[email protected]>

* Investigated the pyright attributes and removed mujoco from ignored * Fixed pyright CI

* Try to fix car racing unpickling * Fix EzPickle for BipedalWalker and LunarLander * Shamelessly steal the pickle-unpickle test from Mark, with slight modifications * CarRacing EzPickle fix * Mujoco ezpickle fix

* Initial commit * Fixed tests and forced TimeLimit.truncated to always exist when truncated or terminated * Fix CI issues * pre-commit * Revert back to old language * Revert changes to step api wrapper

* Fix typo in pre-commit * Fix markdown syntax for gogle docstring style hyperlink

* init * add .gitignore * fix .gitignore * remove internal backend use * fix VideoRecorder test * fix .gitignore * fix order enforcing tests * adapt play.py * reformat * fix .gitignore * add type to DummyPlayEnv

* Do stuff with pygame init only in human mode * Fix CliffWalking * Pre-commit

…) function (reset now always returns info) (#2962) * removed return_info, made info dict mandatory in reset * tenatively removed deprecated seed api for environments * added more info type checks to wrapper tests * formatting/style compliance * addressed some comments * polish to address review * fixed tests after merge, and added a test of the return_info deprecation assertion if found in reset signature * some organization of env_checker tests, reverted a probably merge error * added deprecation check for seed function in env * updated docstring * removed debug prints, tweaked test_check_seed_deprecation * changed return_info deprecation check from assertion to warning * fixes to vector envs, now should be correctly structured * added some explanation and typehints for mockup depcreated return info reset function * re-removed seed function from vector envs * added explanation to _reset_return_info_type and changed the return statement

@pseudo-rnd-thoughts

* init * add save_video util * simplify API @pseudo-rnd-thoughts * fix video_length and remove folder warning * remove RecordVideo deprecation warnings * add test record video * avoid test failing cascade

…3019)

* Initial commit * Remove unnecessary `warnings.simplefilters` * Fix tests for new step API * Fix testing Co-authored-by: Markus28 <[email protected]>

…_array" (#3040) * initial commit * Fix CI * Fixed CI * third time the charm * Fix mujoco environment render modes order * Remove unnecessary changes * pre-commit * Fix tests * Comment out test render modes * Fix code review and readd mujoco * pre-commit * Fix testing envs * Fix all GenericTestEnvs * Do not run mujoco-py render environments

…d hints (#3041) * Initial commit * Add missing __init__ for EnvSpec * third time a charm * Replace entry_point=None with entry_point="no-entry-point" * Readd make overloads, updated with all gym envs * pre-commit * Add apply_step_compatibility to make and add testing * Code review by Arjun

* cliffwalking: remove annoying warning * fix pre-commit

* initial commit * Fix the multi-binary sample and upgrade multi-discrete sample * Fix MultiBinary sample tests and pre-commit * Adds coverage tests and updates test_utils.py to use the utils.py spaces. Fix bug in text.py * pre-commit

* Update composite space and tests * Pre-commit * pyright * Fix pyright * retrigger actions * Code review by Arjun * Code review by Arjun * Code review by Omar

The `warnings.simplefilter(...)` call mistakenly voids and nullifies all the previous warning filters for DeprecationWarning, registered by other packages or user programs via `warnings.filterwarnings` call which has an explicit intention of suppress DeprecationWarning. Control of DeprecationWarning's made in the gym library should have effects only within the gym package.

* Improved documentation to specify decode state space * Improve taxi documentation * Fixed LunarLanderv2 reward doc

* restore auto human rendering * add assert for minimal modes

* Added a new compatibility wrapper along with tests * Fix for 3.6 typing * Fix for 3.6 typing again * Add make integration * Unrelated change that for some reason is necessary to fix pyright * Ignore weird (and very non-critical) type check bug * Adjust old tests * Rename the compatibility argument in make * Rename the compatibility argument in register and envspec * Documentation updates * Remove test envs from the registry * Some rogue renames * Add nicer str and repr to the compatibility layer * Reorder the compatibility layer application * Add metadata to test envs * Add proper handling of automatic human rendering * Add auto human rendering to reset * Enable setting render_mode in gym.make * Documentation update * Fix an unrelated stochastic test

…e is not specified (#3076) * init * amend

Only import `mujoco_rendering` when `mujoco` installed. Otherwise the `try import` code in `gym.envs.mujoco.mujoco_env` is useless.

Additionally, the running application can be stopped not just by closing the window, but also by pressing the Escape key. Fixed #3082.

* Fix reset info * Added test for checking vector info

* add render warn for None * restore _render (car racing) * improve warn message * reformat

* Bump version to v26.2 * Fix pre-commit

Commits on Mar 15, 2022

fix credits

jkterry1 committed Mar 15, 2022

Configuration menu

View commit details

Copy full SHA for f00933a

Browse repository at this point

Copy the full SHA

f00933a View commit details

Browse the repository at this point in the history

Commits on Apr 2, 2022

add pygame GUI render for taxi env (#2713 )

younik authored Apr 2, 2022

Configuration menu

View commit details

Copy full SHA for e11231d

Browse repository at this point

Copy the full SHA

e11231d View commit details

Browse the repository at this point in the history

Commits on Apr 7, 2022

Update README.md

jkterry1 authored Apr 7, 2022

Configuration menu

View commit details

Copy full SHA for 3fd204d

Browse repository at this point

Copy the full SHA

3fd204d View commit details

Browse the repository at this point in the history

Commits on Apr 11, 2022

fix: type ignore from #2739 (#2744 )

kir0ul authored Apr 11, 2022

Configuration menu

View commit details

Copy full SHA for 06072ed

Browse repository at this point

Copy the full SHA

06072ed View commit details

Browse the repository at this point in the history

Commits on Apr 13, 2022

Update README.md

jkterry1 authored Apr 13, 2022

Configuration menu

View commit details

Copy full SHA for 33970e2

Browse repository at this point

Copy the full SHA

33970e2 View commit details

Browse the repository at this point in the history

Commits on May 5, 2022

Fixes to the new registration (#2771 )

RedTachyon authored May 5, 2022

Configuration menu

View commit details

Copy full SHA for 971aea8

Browse repository at this point

Copy the full SHA

971aea8 View commit details

Browse the repository at this point in the history

Commits on May 9, 2022

Add pyright to precommit (#2796 )

pseudo-rnd-thoughts authored May 9, 2022

Configuration menu

View commit details

Copy full SHA for 31e6f23

Browse repository at this point

Copy the full SHA

31e6f23 View commit details

Browse the repository at this point in the history

Commits on May 31, 2022

Update LICENSE.md

jkterry1 authored May 31, 2022

Configuration menu

View commit details

Copy full SHA for 34fba52

Browse repository at this point

Copy the full SHA

34fba52 View commit details

Browse the repository at this point in the history

Commits on Jun 21, 2022

Roll back mujoco docstrings (#2913 )

Markus28 authored Jun 21, 2022

Configuration menu

View commit details

Copy full SHA for 4d57b86

Browse repository at this point

Copy the full SHA

4d57b86 View commit details

Browse the repository at this point in the history

Commits on Jul 21, 2022

Fix typo (#2980 )

Ice1187 authored Jul 21, 2022

Configuration menu

View commit details

Copy full SHA for 8461425

Browse repository at this point

Copy the full SHA

8461425 View commit details

Browse the repository at this point in the history

Commits on Aug 3, 2022

Add swig as a Box2D dependency (#3009 )

kir0ul authored Aug 3, 2022

Configuration menu

View commit details

Copy full SHA for 607602b

Browse repository at this point

Copy the full SHA

607602b View commit details

Browse the repository at this point in the history

Commits on Aug 24, 2022

Fix#3043 (#3044 )

YouJiacheng authored Aug 24, 2022

Configuration menu

View commit details

Copy full SHA for 44e9475

Browse repository at this point

Copy the full SHA

44e9475 View commit details

Browse the repository at this point in the history

Commits on Sep 14, 2022

Update pendulum.py (#3086 )

ikamensh authored Sep 14, 2022

Configuration menu

View commit details

Copy full SHA for 94aaff9

Browse repository at this point

Copy the full SHA

94aaff9 View commit details

Browse the repository at this point in the history

Commits on Sep 16, 2022

Bump version to v26.1 (#3090 )

pseudo-rnd-thoughts authored Sep 16, 2022

Configuration menu

View commit details

Copy full SHA for 53d784e

Browse repository at this point

Copy the full SHA

53d784e View commit details

Browse the repository at this point in the history

Commits on Oct 3, 2022

Update README.md

jkterry1 authored Oct 3, 2022

Configuration menu

View commit details

Copy full SHA for 4544bb9

Browse repository at this point

Copy the full SHA

4544bb9 View commit details

Browse the repository at this point in the history

Commits on Oct 25, 2022

Update README.md

jkterry1 authored Oct 25, 2022

Configuration menu

View commit details

Copy full SHA for 6a04d49

Browse repository at this point

Copy the full SHA

6a04d49 View commit details

Browse the repository at this point in the history

Commits on Jan 23, 2023

Update README.md

jkterry1 authored Jan 23, 2023

Configuration menu

View commit details

Copy full SHA for 9942f3d

Browse repository at this point

Copy the full SHA

9942f3d View commit details

Browse the repository at this point in the history

Commits on Jan 30, 2023

Update README.md

jkterry1 authored Jan 30, 2023

Configuration menu

View commit details

Copy full SHA for dcd1858

Browse repository at this point

Copy the full SHA

dcd1858 View commit details

Browse the repository at this point in the history

Update openai-gym fork #1

Are you sure you want to change the base?

Update openai-gym fork #1

Commits on Feb 17, 2022

Commits on Feb 18, 2022

Commits on Feb 20, 2022

Commits on Feb 23, 2022

Commits on Feb 26, 2022

Commits on Feb 28, 2022

Commits on Mar 2, 2022

Commits on Mar 4, 2022

Commits on Mar 10, 2022

Commits on Mar 11, 2022

Commits on Mar 13, 2022

Commits on Mar 14, 2022

Commits on Mar 15, 2022

Commits on Mar 16, 2022

Commits on Mar 20, 2022

Commits on Mar 24, 2022

Commits on Mar 25, 2022

Commits on Mar 31, 2022

Commits on Apr 1, 2022

Commits on Apr 2, 2022

Commits on Apr 5, 2022

Commits on Apr 6, 2022

Commits on Apr 7, 2022

Commits on Apr 8, 2022

Commits on Apr 10, 2022

Commits on Apr 11, 2022

Commits on Apr 13, 2022

Commits on Apr 14, 2022

Commits on Apr 15, 2022

Commits on Apr 17, 2022

Commits on Apr 18, 2022

Commits on Apr 21, 2022

Commits on Apr 24, 2022

Commits on Apr 25, 2022

Commits on Apr 26, 2022

Commits on Apr 29, 2022

Commits on May 2, 2022

Commits on May 5, 2022

Commits on May 6, 2022

Commits on May 9, 2022

Commits on May 10, 2022

Commits on May 12, 2022

Commits on May 13, 2022

Commits on May 14, 2022

Commits on May 15, 2022

Commits on May 16, 2022

Commits on May 18, 2022

Commits on May 20, 2022

Commits on May 23, 2022

Commits on May 24, 2022

Commits on May 25, 2022

Commits on May 27, 2022

Commits on May 30, 2022

Commits on May 31, 2022

Commits on Jun 1, 2022

Commits on Jun 2, 2022

Commits on Jun 4, 2022

Commits on Jun 6, 2022

Commits on Jun 7, 2022

Commits on Jun 8, 2022

Commits on Jun 9, 2022

Commits on Jun 10, 2022

Commits on Jun 12, 2022

Commits on Jun 13, 2022

Commits on Jun 15, 2022

Commits on Jun 16, 2022

Commits on Jun 19, 2022

Commits on Jun 21, 2022

Commits on Jun 23, 2022

Commits on Jun 24, 2022

Commits on Jun 25, 2022

Commits on Jun 26, 2022

Commits on Jun 28, 2022

Commits on Jun 29, 2022

Commits on Jun 30, 2022

Commits on Jul 1, 2022

Commits on Jul 4, 2022