-
Notifications
You must be signed in to change notification settings - Fork 540
Address likely package mismatch issues #1634
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
This pull request was exported from Phabricator. Differential Revision: D80120024 |
0747396
to
b60b5ce
Compare
Summary: Previous CI runs were encountering issues: 1. https://github.com/.../runs/16867033035/job/47776474001 ``` E torch.AcceleratorError: CUDA error: no kernel image is available for execution on the device E CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. E For debugging consider passing CUDA_LAUNCH_BLOCKING=1 E Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. ``` 2. https://github.com/pytorch/captum/actions/runs/16867033037/job/47775775171 `tests/attr/test_llm_attr_hf_compatibility.py:76: error: Argument 1 to "__call__" of "_Wrapped" has incompatible type "str"; expected "PreTrainedModel" [arg-type]` This is likely due to (1) mismatched pytorch versions vs the cuda version 12.1 specified in test-pip-gpu.yml, triggered by [new PyTorch release](https://github.com/pytorch/pytorch/releases) and (2) lack of full typing causing error thrown by `mypy`, triggered by loosely defined `mypy>=0.760` probably pulling [new MyPy release](https://pypi.org/project/mypy/#history) Differential Revision: D80120024
This pull request was exported from Phabricator. Differential Revision: D80120024 |
Summary: Previous CI runs were encountering issues: 1. https://github.com/.../runs/16867033035/job/47776474001 ``` E torch.AcceleratorError: CUDA error: no kernel image is available for execution on the device E CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. E For debugging consider passing CUDA_LAUNCH_BLOCKING=1 E Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. ``` 2. https://github.com/pytorch/captum/actions/runs/16867033037/job/47775775171 `tests/attr/test_llm_attr_hf_compatibility.py:76: error: Argument 1 to "__call__" of "_Wrapped" has incompatible type "str"; expected "PreTrainedModel" [arg-type]` This is likely due to (1) mismatched pytorch versions vs the cuda version 12.1 specified in test-pip-gpu.yml, triggered by [new PyTorch release](https://github.com/pytorch/pytorch/releases) and (2) lack of full typing causing error thrown by `mypy`, triggered by loosely defined `mypy>=0.760` probably pulling [new MyPy release](https://pypi.org/project/mypy/#history) Differential Revision: D80120024
b60b5ce
to
e8e82b9
Compare
This pull request was exported from Phabricator. Differential Revision: D80120024 |
Summary: Previous CI runs were encountering issues: 1. https://github.com/.../runs/16867033035/job/47776474001 ``` E torch.AcceleratorError: CUDA error: no kernel image is available for execution on the device E CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. E For debugging consider passing CUDA_LAUNCH_BLOCKING=1 E Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. ``` 2. https://github.com/pytorch/captum/actions/runs/16867033037/job/47775775171 `tests/attr/test_llm_attr_hf_compatibility.py:76: error: Argument 1 to "__call__" of "_Wrapped" has incompatible type "str"; expected "PreTrainedModel" [arg-type]` This is likely due to (1) mismatched pytorch versions vs the cuda version 12.1 specified in test-pip-gpu.yml, triggered by [new PyTorch release](https://github.com/pytorch/pytorch/releases) and (2) lack of full typing causing error thrown by `mypy`, triggered by loosely defined `mypy>=0.760` probably pulling [new MyPy release](https://pypi.org/project/mypy/#history) Differential Revision: D80120024
e8e82b9
to
f6c5849
Compare
This pull request was exported from Phabricator. Differential Revision: D80120024 |
Summary: Previous CI runs were encountering issues: 1. https://github.com/.../runs/16867033035/job/47776474001 ``` E torch.AcceleratorError: CUDA error: no kernel image is available for execution on the device E CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. E For debugging consider passing CUDA_LAUNCH_BLOCKING=1 E Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. ``` - likely because cuda 12.1 was no longer supported by newest versions of pytorch installed - note, 12.9 also failed with `nvidia-container-cli: requirement error: unsatisfied condition: cuda>=12.9, please update your driver to a newer version, or use an earlier cuda container: unknown.` 2. https://github.com/pytorch/captum/actions/runs/16867033037/job/47775775171 `tests/attr/test_llm_attr_hf_compatibility.py:76: error: Argument 1 to "__call__" of "_Wrapped" has incompatible type "str"; expected "PreTrainedModel" [arg-type]` This is likely due to (1) mismatched pytorch versions vs the cuda version 12.1 specified in test-pip-gpu.yml, triggered by [new PyTorch release](https://github.com/pytorch/pytorch/releases) and (2) lack of full typing causing error thrown by `mypy`, triggered by loosely defined `mypy>=0.760` probably pulling [new MyPy release](https://pypi.org/project/mypy/#history) Differential Revision: D80120024
f6c5849
to
1e49c9f
Compare
This pull request was exported from Phabricator. Differential Revision: D80120024 |
Summary: Previous CI runs were encountering issues: 1. https://github.com/.../runs/16867033035/job/47776474001 ``` E torch.AcceleratorError: CUDA error: no kernel image is available for execution on the device E CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. E For debugging consider passing CUDA_LAUNCH_BLOCKING=1 E Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. ``` - likely because cuda 12.1 was no longer supported by newest versions of pytorch installed - note, 12.9 also failed with `nvidia-container-cli: requirement error: unsatisfied condition: cuda>=12.9, please update your driver to a newer version, or use an earlier cuda container: unknown.` 2. https://github.com/pytorch/captum/actions/runs/16867033037/job/47775775171 `tests/attr/test_llm_attr_hf_compatibility.py:76: error: Argument 1 to "__call__" of "_Wrapped" has incompatible type "str"; expected "PreTrainedModel" [arg-type]` This is likely due to (1) mismatched pytorch versions vs the cuda version 12.1 specified in test-pip-gpu.yml, triggered by [new PyTorch release](https://github.com/pytorch/pytorch/releases) and (2) lack of full typing causing error thrown by `mypy`, triggered by loosely defined `mypy>=0.760` probably pulling [new MyPy release](https://pypi.org/project/mypy/#history) Differential Revision: D80120024
1e49c9f
to
1d4f3b0
Compare
This pull request was exported from Phabricator. Differential Revision: D80120024 |
Summary: Previous CI runs were encountering issues: 1. https://github.com/.../runs/16867033035/job/47776474001 ``` E torch.AcceleratorError: CUDA error: no kernel image is available for execution on the device E CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. E For debugging consider passing CUDA_LAUNCH_BLOCKING=1 E Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. ``` - likely because cuda 12.1 was no longer supported by newest versions of pytorch installed - note, 12.9 also failed with `nvidia-container-cli: requirement error: unsatisfied condition: cuda>=12.9, please update your driver to a newer version, or use an earlier cuda container: unknown.` 2. https://github.com/pytorch/captum/actions/runs/16867033037/job/47775775171 `tests/attr/test_llm_attr_hf_compatibility.py:76: error: Argument 1 to "__call__" of "_Wrapped" has incompatible type "str"; expected "PreTrainedModel" [arg-type]` This is likely due to (1) mismatched pytorch versions vs the cuda version 12.1 specified in test-pip-gpu.yml, triggered by [new PyTorch release](https://github.com/pytorch/pytorch/releases) and (2) lack of full typing causing error thrown by `mypy`, triggered by loosely defined `mypy>=0.760` probably pulling [new MyPy release](https://pypi.org/project/mypy/#history) Differential Revision: D80120024
1d4f3b0
to
5967369
Compare
This pull request was exported from Phabricator. Differential Revision: D80120024 |
This pull request has been merged in 9b67aed. |
Summary:
Previous CI runs were encountering issues:
tests/attr/test_llm_attr_hf_compatibility.py:76: error: Argument 1 to "__call__" of "_Wrapped" has incompatible type "str"; expected "PreTrainedModel" [arg-type]
This is likely due to (1) mismatched pytorch versions vs the cuda version 12.1 specified in test-pip-gpu.yml, triggered by new PyTorch release and (2) lack of full typing causing error thrown by
mypy
, triggered by loosely definedmypy>=0.760
probably pulling new MyPy releaseDifferential Revision: D80120024