Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] TensorDictMap Query module #2305

Merged
merged 5 commits into from
Oct 14, 2024

Update

f51a567
Select commit
Loading
Failed to load commit list.
Merged

[Feature] TensorDictMap Query module #2305

Update
f51a567
Select commit
Loading
Failed to load commit list.
PyTorch Bot / Dr.CI completed Oct 14, 2024 in 0s

Dr.CI classification results

{"FAILED":[{"workflowId":11328969158,"workflowUniqueId":60501564,"id":31503443248,"runnerName":"i-0e25dff4acc055021","authorEmail":"[email protected]","name":"Habitat Tests on Linux / tests (3.9, 12.1) / linux-job","jobName":"tests (3.9, 12.1) / linux-job","conclusion":"failure","completed_at":"2024-10-14T14:04:19.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/11328969158/job/31503443248","head_branch":"gh/vmoens/2/head","pr_number":2305,"head_sha":"f51a5677e1bd5e30d515bd1bb515c2be131b97cd","head_sha_timestamp":"2024-10-14T13:51:22.000000000Z","failure_captures":["RuntimeError: Command docker exec -t 1eeee06f3fe9d0802ab60b0b80615587d538b813c3e729fe36e32d23d764408b /exec failed with exit code 134"],"failure_lines":["RuntimeError: Command docker exec -t 1eeee06f3fe9d0802ab60b0b80615587d538b813c3e729fe36e32d23d764408b /exec failed with exit code 134"],"failure_context":["+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/run_test.sh","+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/install.sh","+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/setup_env.sh","+ cp /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/10_nvidia.json /usr/share/glvnd/egl_vendor.d/10_nvidia.json","+ this_dir=/pytorch/rl/.github/unittest/linux_libs/scripts_habitat","++ pwd","++ cd .github/unittest/linux_libs/scripts_habitat","+++ dirname .github/unittest/linux_libs/scripts_habitat/run_all.sh","+ apt-get dist-upgrade -y","+ apt-get install -y g++ gcc","+ apt-get install -y libglvnd0 libgl1 libglx0 libegl1 libgles2","+ apt-get install -y libglfw3 libgl1-mesa-glx libosmesa6 libglew-dev"],"time":"2024-10-14T13:52:28.000000000Z"},{"workflowId":11328969212,"workflowUniqueId":106193614,"id":31510008237,"runnerName":"GitHub Actions 363","authorEmail":"[email protected]","name":"Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cpu","jobName":"pytorch/rl / upload / wheel-py3_9-cpu","conclusion":"failure","completed_at":"2024-10-14T15:53:06.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/11328969212/job/31510008237","head_branch":"gh/vmoens/2/head","pr_number":2305,"head_sha":"f51a5677e1bd5e30d515bd1bb515c2be131b97cd","head_sha_timestamp":"2024-10-14T13:51:22.000000000Z","failure_captures":["ERROR: failed to solve: python:3.12-slim: failed to resolve source metadata for docker.io/library/python:3.12-slim: failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/python/manifests/sha256:af4e85f1cac90dd3771e47292ea7c8a9830abfabbe4faa5c53f158854c2e819d: 429 Too Many Requests - Server message: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"],"failure_lines":["ERROR: failed to solve: python:3.12-slim: failed to resolve source metadata for docker.io/library/python:3.12-slim: failed to copy: httpReadSeeker: failed open: unexpected status code https://registry-1.docker.io/v2/library/python/manifests/sha256:af4e85f1cac90dd3771e47292ea7c8a9830abfabbe4faa5c53f158854c2e819d: 429 Too Many Requests - Server message: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"],"failure_context":[],"time":"2024-10-14T15:52:36.000000000Z"}],"FLAKY":[],"BROKEN_TRUNK":[{"workflowId":11328969212,"workflowUniqueId":106193614,"id":31510008663,"runnerName":"GitHub Actions 455","authorEmail":"[email protected]","name":"Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda11_8","jobName":"pytorch/rl / upload / wheel-py3_9-cuda11_8","conclusion":"failure","completed_at":"2024-10-14T15:53:21.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/11328969212/job/31510008663","head_branch":"gh/vmoens/2/head","pr_number":2305,"head_sha":"f51a5677e1bd5e30d515bd1bb515c2be131b97cd","head_sha_timestamp":"2024-10-14T13:51:22.000000000Z","failure_captures":["##[error]Unable to find any artifacts for the associated workflow"],"failure_lines":["##[error]Unable to find any artifacts for the associated workflow"],"failure_context":[],"time":"2024-10-14T15:52:36.000000000Z"},{"workflowId":11328969212,"workflowUniqueId":106193614,"id":31510008964,"runnerName":"GitHub Actions 487","authorEmail":"[email protected]","name":"Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_1","jobName":"pytorch/rl / upload / wheel-py3_9-cuda12_1","conclusion":"failure","completed_at":"2024-10-14T15:53:22.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/11328969212/job/31510008964","head_branch":"gh/vmoens/2/head","pr_number":2305,"head_sha":"f51a5677e1bd5e30d515bd1bb515c2be131b97cd","head_sha_timestamp":"2024-10-14T13:51:22.000000000Z","failure_captures":["##[error]Unable to find any artifacts for the associated workflow"],"failure_lines":["##[error]Unable to find any artifacts for the associated workflow"],"failure_context":[],"time":"2024-10-14T15:52:36.000000000Z"},{"workflowId":11328969212,"workflowUniqueId":106193614,"id":31510009259,"runnerName":"GitHub Actions 398","authorEmail":"[email protected]","name":"Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_4","jobName":"pytorch/rl / upload / wheel-py3_9-cuda12_4","conclusion":"failure","completed_at":"2024-10-14T15:53:27.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/11328969212/job/31510009259","head_branch":"gh/vmoens/2/head","pr_number":2305,"head_sha":"f51a5677e1bd5e30d515bd1bb515c2be131b97cd","head_sha_timestamp":"2024-10-14T13:51:22.000000000Z","failure_captures":["##[error]Unable to find any artifacts for the associated workflow"],"failure_lines":["##[error]Unable to find any artifacts for the associated workflow"],"failure_context":[],"time":"2024-10-14T15:52:37.000000000Z"},{"workflowId":11328969179,"workflowUniqueId":82165822,"id":31503464699,"runnerName":"i-035186eca29a48246","authorEmail":"[email protected]","name":"Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job","jobName":"tests-olddeps (3.8, 11.6) / linux-job","conclusion":"failure","completed_at":"2024-10-14T14:32:10.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/11328969179/job/31503464699","head_branch":"gh/vmoens/2/head","pr_number":2305,"head_sha":"f51a5677e1bd5e30d515bd1bb515c2be131b97cd","head_sha_timestamp":"2024-10-14T13:51:22.000000000Z","failure_captures":["test/test_modules.py::TestMultiAgent::test_multiagent_mlp_tdparams[True-batch0-6-True-True-3]"],"failure_lines":["FAILED test/test_modules.py::TestMultiAgent::test_multiagent_mlp_tdparams[True-batch0-6-True-True-3] - TypeError: _apply() got an unexpected keyword argument 'recurse'"],"failure_context":["+ bash .github/unittest/linux_olddeps/scripts_gym_0_13/batch_scripts.sh","+ bash .github/unittest/linux_olddeps/scripts_gym_0_13/setup_env.sh","+ TD_GET_DEFAULTS_TO_NONE=1","+ export TD_GET_DEFAULTS_TO_NONE=1","+ TF_CPP_MIN_LOG_LEVEL=0","+ export TF_CPP_MIN_LOG_LEVEL=0","+ TORCH_VERSION=nightly","+ export TORCH_VERSION=nightly","+ RELEASE=0","+ export RELEASE=0","+ [[ refs/pull/2305/merge =~ release/* ]]","+ TAR_OPTIONS=--no-same-owner"],"time":"2024-10-14T13:52:53.000000000Z"},{"workflowId":11328969147,"workflowUniqueId":79519303,"id":31503428684,"runnerName":"i-07d3a88954f0ca28b","authorEmail":"[email protected]","name":"Unit-tests on Windows / unittests-cpu / windows-job","jobName":"unittests-cpu / windows-job","conclusion":"failure","completed_at":"2024-10-14T14:31:01.000000000Z","html_url":"https://github.com/pytorch/rl/actions/runs/11328969147/job/31503428684","head_branch":"gh/vmoens/2/head","pr_number":2305,"head_sha":"f51a5677e1bd5e30d515bd1bb515c2be131b97cd","head_sha_timestamp":"2024-10-14T13:51:22.000000000Z","failure_captures":["test/test_collector.py::TestCompile::test_compiled_policy[device0-compile_policy2-MultiSyncDataCollector]"],"failure_lines":["FAILED test/test_collector.py::TestCompile::test_compiled_policy[device0-compile_policy2-MultiSyncDataCollector] - EOFError"],"failure_context":["+ pytest --junitxml=test-results/junit.xml -v --durations 200 --ignore test/test_distributed.py --ignore test/test_rlhf.py","+ python -m torch.utils.collect_env","+ LAZY_LEGACY_OP=False","+ export LAZY_LEGACY_OP=False","+ BATCHED_PIPE_TIMEOUT=60","+ export BATCHED_PIPE_TIMEOUT=60","+ MAX_IDLE_COUNT=60","+ export MAX_IDLE_COUNT=60","+ CKPT_BACKEND=torch","+ export CKPT_BACKEND=torch","++ [[ cpu != \c\p\u ]]","++ [[ 3 -eq 5 ]]"],"time":"2024-10-14T13:52:13.000000000Z"}],"UNSTABLE":[]}