Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] use_vmap=False for SAC #2392

Open
wants to merge 2 commits into
base: gh/vmoens/18/base
Choose a base branch
from

Update

3cc6253
Select commit
Loading
Failed to load commit list.
Open

[Feature] use_vmap=False for SAC #2392

Update
3cc6253
Select commit
Loading
Failed to load commit list.
PyTorch Bot / Dr.CI completed Aug 14, 2024 in 0s

Dr.CI classification results

{"FAILED":[{"workflowId":10376593085,"workflowUniqueId":82165822,"id":28728912335,"runnerName":"i-0b80e6d838bc2e03f","authorEmail":"[email protected]","name":"Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job","jobName":"tests-stable-gpu (3.10, 11.8) / linux-job","conclusion":"failure","completed_at":"2024-08-13T21:04:06Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593085/job/28728912335","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["test/test_cost.py::TestSAC::test_sac_vmap_equiv[device0-2]"],"failure_lines":["FAILED test/test_cost.py::TestSAC::test_sac_vmap_equiv[device0-2] - AssertionError: key entropy does not match, got mse = 0.3567,\tkey alpha matches"],"failure_context":["+ python .github/unittest/helpers/coverage_run_parallel.py -m pytest test --instafail --durations 200 -vv --capture no --ignore test/test_rlhf.py --timeout=120 --mp_fork_if_no_cuda","+ '[' cu118 '!=' cpu ']'","+ pytest test/smoke_test_deps.py -v --durations 200 -k 'test_gym or test_dm_control_pixels or test_dm_control or test_tb'","+ pytest test/smoke_test.py -v --durations 200","+ BATCHED_PIPE_TIMEOUT=60","+ export BATCHED_PIPE_TIMEOUT=60","+ MAX_IDLE_COUNT=100","+ export MAX_IDLE_COUNT=100","+ CKPT_BACKEND=torch","+ export CKPT_BACKEND=torch","+ MKL_THREADING_LAYER=GNU","+ export MKL_THREADING_LAYER=GNU"],"time":"2024-08-13T21:04:10.333801Z"},{"workflowId":10376593085,"workflowUniqueId":82165822,"id":28728910717,"runnerName":"i-02fb3e3052ceccb0a","authorEmail":"[email protected]","name":"Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job","jobName":"tests-gpu (3.11, 12.1) / linux-job","conclusion":"failure","completed_at":"2024-08-13T21:03:45Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593085/job/28728910717","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["test/test_cost.py::TestSAC::test_sac_vmap_equiv[device0-2]"],"failure_lines":["FAILED test/test_cost.py::TestSAC::test_sac_vmap_equiv[device0-2] - AssertionError: key entropy does not match, got mse = 0.3567,\tkey alpha matches"],"failure_context":["+ python .github/unittest/helpers/coverage_run_parallel.py -m pytest test --instafail --durations 200 -vv --capture no --ignore test/test_rlhf.py --timeout=120 --mp_fork_if_no_cuda","+ '[' cu121 '!=' cpu ']'","+ pytest test/smoke_test_deps.py -v --durations 200 -k 'test_gym or test_dm_control_pixels or test_dm_control or test_tb'","+ pytest test/smoke_test.py -v --durations 200","+ BATCHED_PIPE_TIMEOUT=60","+ export BATCHED_PIPE_TIMEOUT=60","+ MAX_IDLE_COUNT=100","+ export MAX_IDLE_COUNT=100","+ CKPT_BACKEND=torch","+ export CKPT_BACKEND=torch","+ MKL_THREADING_LAYER=GNU","+ export MKL_THREADING_LAYER=GNU"],"time":"2024-08-13T21:03:50.123278Z"},{"workflowId":10376593085,"workflowUniqueId":82165822,"id":28728911517,"runnerName":"i-0a1c48940f1a05b72","authorEmail":"[email protected]","name":"Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job","jobName":"tests-olddeps (3.8, 11.6) / linux-job","conclusion":"failure","completed_at":"2024-08-13T20:51:43Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593085/job/28728911517","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["test/test_cost.py::TestSAC::test_sac_vmap_equiv[device0-2]"],"failure_lines":["FAILED test/test_cost.py::TestSAC::test_sac_vmap_equiv[device0-2] - AssertionError: key entropy does not match, got mse = 0.3567,\tkey alpha matches"],"failure_context":["+ bash .github/unittest/linux_olddeps/scripts_gym_0_13/batch_scripts.sh","+ bash .github/unittest/linux_olddeps/scripts_gym_0_13/setup_env.sh","+ TD_GET_DEFAULTS_TO_NONE=1","+ export TD_GET_DEFAULTS_TO_NONE=1","+ TF_CPP_MIN_LOG_LEVEL=0","+ export TF_CPP_MIN_LOG_LEVEL=0","+ TORCH_VERSION=nightly","+ export TORCH_VERSION=nightly","+ RELEASE=0","+ export RELEASE=0","+ [[ refs/pull/2392/merge =~ release/* ]]","+ TAR_OPTIONS=--no-same-owner"],"time":"2024-08-13T20:51:47.121752Z"},{"workflowId":10376593085,"workflowUniqueId":82165822,"id":28728911929,"runnerName":"i-0570c2f9136759262","authorEmail":"[email protected]","name":"Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job","jobName":"tests-optdeps (3.10, 12.1) / linux-job","conclusion":"failure","completed_at":"2024-08-13T20:47:42Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593085/job/28728911929","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["test/test_cost.py::TestSAC::test_sac_vmap_equiv[device0-2]"],"failure_lines":["FAILED test/test_cost.py::TestSAC::test_sac_vmap_equiv[device0-2] - AssertionError: key entropy does not match, got mse = 0.3567,\tkey alpha matches"],"failure_context":["+ bash /pytorch/rl/.github/unittest/linux_optdeps/scripts/run_test.sh","+ bash /pytorch/rl/.github/unittest/linux_optdeps/scripts/install.sh","+ bash /pytorch/rl/.github/unittest/linux_optdeps/scripts/setup_env.sh","+ cp /pytorch/rl/.github/unittest/linux_optdeps/scripts/10_nvidia.json /usr/share/glvnd/egl_vendor.d/10_nvidia.json","+ [[ linux-gnu != \d\a\r\w\i\n* ]]","+ this_dir=/pytorch/rl/.github/unittest/linux_optdeps/scripts","++ pwd","++ cd .github/unittest/linux_optdeps/scripts","+++ dirname .github/unittest/linux_optdeps/scripts/run_all.sh","+ apt-get install -y g++ gcc","+ '[' cu121 == cpu ']'","+ apt-get install -y libglvnd0 libgl1 libglx0 libegl1 libgles2"],"time":"2024-08-13T20:47:47.059014Z"},{"workflowId":10376593095,"workflowUniqueId":60501564,"id":28728902610,"runnerName":"i-0243ff786c832475c","authorEmail":"[email protected]","name":"Habitat Tests on Linux / tests (3.9, 12.1) / linux-job","jobName":"tests (3.9, 12.1) / linux-job","conclusion":"failure","completed_at":"2024-08-13T20:26:35Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593095/job/28728902610","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["RuntimeError: Command docker exec -t cd6f374bb05f33398129e92b0c92dacaa5b72d69b0e5c8fe54522e4ba9f3a47a /exec failed with exit code 139"],"failure_lines":["RuntimeError: Command docker exec -t cd6f374bb05f33398129e92b0c92dacaa5b72d69b0e5c8fe54522e4ba9f3a47a /exec failed with exit code 139"],"failure_context":["+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/run_test.sh","+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/install.sh","+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/setup_env.sh","+ cp /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/10_nvidia.json /usr/share/glvnd/egl_vendor.d/10_nvidia.json","+ this_dir=/pytorch/rl/.github/unittest/linux_libs/scripts_habitat","++ pwd","++ cd .github/unittest/linux_libs/scripts_habitat","+++ dirname .github/unittest/linux_libs/scripts_habitat/run_all.sh","+ apt-get dist-upgrade -y","+ apt-get install -y g++ gcc","+ apt-get install -y libglvnd0 libgl1 libglx0 libegl1 libgles2","+ apt-get install -y libglfw3 libgl1-mesa-glx libosmesa6 libglew-dev"],"time":"2024-08-13T20:26:38.676496Z"}],"FLAKY":[{"workflowId":10376593123,"workflowUniqueId":106193614,"id":28739025366,"runnerName":"GitHub Actions 418","authorEmail":"[email protected]","name":"Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_4","jobName":"pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_4","conclusion":"failure","completed_at":"2024-08-14T01:42:02Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593123/job/28739025366","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["Unable to find any artifacts for the associated workflow"],"failure_lines":["##[error]Unable to find any artifacts for the associated workflow"],"failure_context":["+ echo BUILD_ENV_FILE=/home/runner/work/_temp/build_env_10376593123","+ cat /home/runner/work/_temp/build_env_10376593123","+ python -m pytorch_pkg_helpers","+ BUILD_ENV_FILE=/home/runner/work/temp/build_env_10376593123","+ python -m pip install /home/runner/work/rl/rl/test-infra/tools/pkg-helpers","+ echo ARTIFACT_NAME=pytorch_rl__3.9_cu124","+ echo CHANNEL=nightly"],"time":"2024-08-14T01:42:05.767377Z"}],"BROKEN_TRUNK":[{"workflowId":10376593123,"workflowUniqueId":106193614,"id":28739024908,"runnerName":"GitHub Actions 353","authorEmail":"[email protected]","name":"Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cpu","jobName":"pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cpu","conclusion":"failure","completed_at":"2024-08-14T01:42:02Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593123/job/28739024908","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["Unable to find any artifacts for the associated workflow"],"failure_lines":["##[error]Unable to find any artifacts for the associated workflow"],"failure_context":["+ echo BUILD_ENV_FILE=/home/runner/work/_temp/build_env_10376593123","+ cat /home/runner/work/_temp/build_env_10376593123","+ python -m pytorch_pkg_helpers","+ BUILD_ENV_FILE=/home/runner/work/temp/build_env_10376593123","+ python -m pip install /home/runner/work/rl/rl/test-infra/tools/pkg-helpers","+ echo ARTIFACT_NAME=pytorch_rl__3.9_cpu","+ echo CHANNEL=nightly"],"time":"2024-08-14T01:42:06.259532Z"},{"workflowId":10376593123,"workflowUniqueId":106193614,"id":28739025070,"runnerName":"GitHub Actions 404","authorEmail":"[email protected]","name":"Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda11_8","jobName":"pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda11_8","conclusion":"failure","completed_at":"2024-08-14T01:42:04Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593123/job/28739025070","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["Unable to find any artifacts for the associated workflow"],"failure_lines":["##[error]Unable to find any artifacts for the associated workflow"],"failure_context":["+ echo BUILD_ENV_FILE=/home/runner/work/_temp/build_env_10376593123","+ cat /home/runner/work/_temp/build_env_10376593123","+ python -m pytorch_pkg_helpers","+ BUILD_ENV_FILE=/home/runner/work/temp/build_env_10376593123","+ python -m pip install /home/runner/work/rl/rl/test-infra/tools/pkg-helpers","+ echo ARTIFACT_NAME=pytorch_rl__3.9_cu118","+ echo CHANNEL=nightly"],"time":"2024-08-14T01:42:07.864462Z"},{"workflowId":10376593123,"workflowUniqueId":106193614,"id":28739025233,"runnerName":"GitHub Actions 328","authorEmail":"[email protected]","name":"Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_1","jobName":"pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_1","conclusion":"failure","completed_at":"2024-08-14T01:42:05Z","html_url":"https://github.com/pytorch/rl/actions/runs/10376593123/job/28739025233","head_branch":"gh/vmoens/18/head","pr_number":2392,"head_sha":"3cc62535796a3175cd5c96ea084378f2010ebcfa","head_sha_timestamp":"2024-08-13T13:16:55-07:00","failure_captures":["Unable to find any artifacts for the associated workflow"],"failure_lines":["##[error]Unable to find any artifacts for the associated workflow"],"failure_context":["+ echo BUILD_ENV_FILE=/home/runner/work/_temp/build_env_10376593123","+ cat /home/runner/work/_temp/build_env_10376593123","+ python -m pytorch_pkg_helpers","+ BUILD_ENV_FILE=/home/runner/work/temp/build_env_10376593123","+ python -m pip install /home/runner/work/rl/rl/test-infra/tools/pkg-helpers","+ echo ARTIFACT_NAME=pytorch_rl__3.9_cu121","+ echo CHANNEL=nightly"],"time":"2024-08-14T01:42:07.864465Z"}],"UNSTABLE":[]}