[Feature] ParallelEnv always creates and EnvCreator for compatibility with collectors

[vmoens]

Description

When setting a ParallelEnv in a remote data collector and not embedding the env maker in an EnvCreator, an error is raised.
This PR solves this issue.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/445

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 8 New Failures, 29 Unrelated Failures

As of commit b0fdbce with merge base 67f659c ():

NEW FAILURES - The following jobs have failed:

• Wheels / test-wheel (linux, ubuntu-20.04, 3.10) (gh)
• Wheels / test-wheel (linux, ubuntu-20.04, 3.11) (gh)
• Wheels / test-wheel (linux, ubuntu-20.04, 3.8) (gh)
  ##[error]The operation was canceled.
• Wheels / test-wheel (mac, macos-11, 3.10) (gh)
  ##[error]The operation was canceled.
• Wheels / test-wheel (mac, macos-11, 3.11) (gh)
  ##[error]The operation was canceled.
• Wheels / test-wheel (mac, macos-11, 3.8) (gh)
  ##[error]The operation was canceled.
• Wheels / test-wheel (mac, macos-11, 3.9) (gh)
  ##[error]The operation was canceled.
• Wheels / test-wheel-windows (3.11) (gh)

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  Process completed with exit code 4.
• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  Process completed with exit code 4.
• Examples Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 615212202cabe474e8606c4d31f85bda45d024617a6be0792d51957f6a1cc572 /exec failed with exit code 1
• Generate documentation / build-docs (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 688de790efaac8b84cf770bc62ac86f5151c415ebad7f258013f46bd97fe92c8 /exec failed with exit code 1
• Habitat Tests on Linux / tests (3.9, 11.6) / linux-job (gh)
  RuntimeError: Command docker exec -t dbc4ef4394568e0006e9029a24ef8ac9584f990804113d609c063115bd7fe8f1 /exec failed with exit code 1
• Libs Tests on Linux / unittests-brax (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 7c94e0afed0f5733cbc2d367407f8908ac35cde3c8b24b12fe752a0c8fb36b3d /exec failed with exit code 1
• Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 5fa4a79751fc3b953474c236b7a4210d0621b940c8b455b1bff0061fd1b89a40 /exec failed with exit code 1
• Libs Tests on Linux / unittests-jumanji (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t fbf3593e6e92e23b6cc8e5daff3185aa6d04940cfba06374894776f9283ec5d3 /exec failed with exit code 1
• Libs Tests on Linux / unittests-pettingzoo / linux-job (gh)
  RuntimeError: Command docker exec -t e5106c2b60ac2329463c2be638a82aa721f3f2c02125a0a51df766bea13dff8f /exec failed with exit code 1
• Libs Tests on Linux / unittests-robohive (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 329cadd6ed101cccec32f198c6a9e5217befe3138210475f6406a14617ee2e19 /exec failed with exit code 1
• Libs Tests on Linux / unittests-sklearn (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t d569410fc8992e525f4d88d1e20bdc0937955b284e937c2a71e95e0435dc73c9 /exec failed with exit code 1
• Libs Tests on Linux / unittests-vmas (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 9e9b016213fcbd10f34f93bbc8865574a1c39eec8791482753d8e56c4a845da9 /exec failed with exit code 1
• RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 0e7468c673a005e6d4cb13cd033b2147e338bb314770e18f6a25315d508295b6 /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh)
  RuntimeError: Command docker exec -t 183054d476199208387a6d288e5b5377a7f59053aaceb2b42f4d62fed9e6a04b /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh)
  RuntimeError: Command docker exec -t 1eb2f209594c1bce5b70ee11f37f323bc995eddb57152aa02476615ac94d1bae /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.8) / linux-job (gh)
  RuntimeError: Command docker exec -t b91d2b5798d35466600327d59b594cf67cf479302ca8a476fab16b5526d3ae1b /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh)
  RuntimeError: Command docker exec -t af545149d2c03ac0d30f125918d775b9e8c47e7bc031775931d5bf3ad791305d /exec failed with exit code 1
• Unit-tests on Linux / tests-gpu (3.8, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 2addf5c414503a5e4117325232c5e45e8857bf27e6509d7d6ced4d9881c8a42d /exec failed with exit code 1
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh)
  RuntimeError: Command docker exec -t e3f9fdff6a4416f4ef454319245c88e2c845157d9fbb463c7f91c55a00fdf452 /exec failed with exit code 1
• Unit-tests on Linux / tests-optdeps (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t ddda4deba3598852582dc318e68ca6bd9e3bad4d91a61fc9ecf56ded5b666471 /exec failed with exit code 1
• Unit-tests on Linux / tests-stable-gpu (3.8, 11.8) / linux-job (gh)
  RuntimeError: Command docker exec -t cc5b07c431ad63fa4223350ea52613da5686fed53aa2d668773dce8d78cbee7e /exec failed with exit code 1
• Unit-tests on MacOS CPU / tests (3.11) / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• Unit-tests on MacOS CPU / tests (3.8) / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• Unit-tests on Windows / unittests-cpu / windows-job (gh)
  ImportError: cannot import name 'CloudpickleWrapper' from partially initialized module 'torchrl.envs.batched_envs' (most likely due to a circular import) (C:\actions-runner\_work\rl\rl\pytorch\rl\torchrl\envs\batched_envs.py)
• Unit-tests on Windows / unittests-gpu / windows-job (gh)
  Process completed with exit code 1.
• Wheels / test-wheel (linux, ubuntu-20.04, 3.9) (gh)
  ImportError: cannot import name 'CloudpickleWrapper' from partially initialized module 'torchrl.envs.batched_envs' (most likely due to a circular import) (/opt/hostedtoolcache/Python/3.9.18/x64/lib/python3.9/site-packages/torchrl/envs/batched_envs.py)
• Wheels / test-wheel-windows (3.10) (gh)
  ##[error]The operation was canceled.
• Wheels / test-wheel-windows (3.8) (gh)
  ImportError: cannot import name 'CloudpickleWrapper' from partially initialized module 'torchrl.envs.batched_envs' (most likely due to a circular import) (C:\hostedtoolcache\windows\Python\3.8.10\x64\lib\site-packages\torchrl\envs\batched_envs.py)
• Wheels / test-wheel-windows (3.9) (gh)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[vmoens]

Should revamp this from scratch