-2

does anyone can help me solve this problem?

File "/opt/conda/envs/vgen/lib/python3.8/site-packages/fairscale/nn/checkpoint/checkpoint_activations.py", line 170, in _checkpointed_forward
    return original_forward(module, *args, **kwargs)
File "/workspace/tools/modules/unet/util.py", line 1261, in forward
    x = block(x)
File "/opt/conda/envs/vgen/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
File "/workspace/tools/modules/unet/util.py", line 701, in forward
    x = self.attn1(self.norm1(x), context=context if self.disable_self_attn else None) + x
File "/opt/conda/envs/vgen/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
File "/workspace/tools/modules/unet/util.py", line 254, in forward
    out = xformers.ops.memory_efficient_attention(
File "/opt/conda/envs/vgen/lib/python3.8/site-packages/xformers/ops.py", line 574, in memory_efficient_attention
    return op.forward_no_grad(
  File "/opt/conda/envs/vgen/lib/python3.8/site-packages/xformers/ops.py", line 189, in forward_no_grad
    return cls.FORWARD_OPERATOR(
File "/opt/conda/envs/vgen/lib/python3.8/site-packages/torch/_ops.py", line 143, in __call__
    return self._op(*args, **kwargs or {})
RuntimeError: CUDA error: no kernel image is available for execution on the device

I use pytorch docker: enter image description here

and related pip list: enter image description here

and the xformers is: enter image description here

The github repository is: VGen

and it's commands:

conda create -n vgen python=3.8
conda activate vgen
pip install torch==1.12.0+cu113 torchvision==0.13.0+cu113 torchaudio==0.12.0 --extra-index-url https://download.pytorch.org/whl/cu113
pip install -r requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple

I follow this suggestion:RuntimeError: CUDA error: no kernel image is available for execution on the device (rastervision)

But it doesn't work.

2
  • some aspect of your toolchain is compiled without support for the GPU you are running on. You haven't indicated what GPU you are running on, unlike in the post you link. cuda 11.3, for example, had no specific support for RTX 40 series GPUs, or other Ada or Hopper GPUs. Commented Jul 8 at 20:11
  • I use V100, and a cuda11.3 docker image.
    – he cui
    Commented Jul 9 at 14:04

0

Browse other questions tagged or ask your own question.