Skip to content

[Bug]: RuntimeError: Input type (float) and bias type (c10::Half) should be the same #603

Open
@webdev1404

Description

@webdev1404

Checklist

  • The issue exists after disabling all extensions
  • The issue exists on a clean installation of webui
  • The issue is caused by an extension, but I believe it is caused by a bug in the webui
  • The issue exists in the current version of the webui
  • The issue has not been reported before recently
  • The issue has been reported before but has not been fixed yet

What happened?

Hello,
I'm aware there are multiple reports for this bug, but nothing that was suggested in the other reports seem to work for me.

I'm using Linux Mint 21.3 and with a newly cloned repo. i get the "RuntimeError: Input type (float) and bias type (c10::Half) should be the same" error when i try to generate an image, using the './webui.sh --use-zluda --skip-torch-cuda-test --medvram' command. I get the error if i leave --medvram out.

I tried to run 'pip cache purge' and delete the 'venv' folder, nothing changed.

If i try to run it with './webui.sh --use-zluda --skip-torch-cuda-test --medvram --no-half', then it works, but the images are generated using the CPU, not the GPU.

Last, but not least, i have an older (2-3 months) installation of 'stable-diffusion-webui-amdgpu' which works just fine, so probably something changed recently that broke the image generation for me.

Thank you.

Steps to reproduce the problem

  1. git clone https://github.com/lshqqytiger/stable-diffusion-webui-amdgpu
  2. ./webui.sh --use-zluda --skip-torch-cuda-test --medvram

What should have happened?

generate the image

What browsers do you use to access the UI ?

Mozilla Firefox

Sysinfo

sysinfo-2025-04-28-23-45.json

Console logs

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
glibc version is 2.35
Check TCMalloc: libtcmalloc_minimal.so.4
libtcmalloc_minimal.so.4 is linked with libc.so,execute LD_PRELOAD=/lib/x86_64-linux-gnu/libtcmalloc_minimal.so.4
WARNING: ZLUDA works best with SD.Next. Please consider migrating to SD.Next.
Python 3.10.12 (main, Feb  4 2025, 14:57:36) [GCC 11.4.0]
Version: v1.10.1-amd-36-g679c645e
Commit hash: 679c645ec84e40dd14d527dbeb03fab259087187
WARNING: you should not skip torch test unless you want CPU to work.
ROCm: agents=['gfx1030']
ROCm: version=6.2, using agent gfx1030
/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/onnxscript/converter.py:816: FutureWarning: 'onnxscript.values.Op.param_schemas' is deprecated in version 0.1 and will be removed in the future. Please use '.op_signature' instead.
  param_schemas = callee.param_schemas()
/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/onnxscript/converter.py:816: FutureWarning: 'onnxscript.values.OnnxFunction.param_schemas' is deprecated in version 0.1 and will be removed in the future. Please use '.op_signature' instead.
  param_schemas = callee.param_schemas()
/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
  warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/pytorch_lightning/utilities/distributed.py:258: LightningDeprecationWarning: `pytorch_lightning.utilities.distributed.rank_zero_only` has been deprecated in v1.8.1 and will be removed in v2.0.0. You can import it from `pytorch_lightning.utilities` instead.
  rank_zero_deprecation(
Launching Web UI with arguments: --use-zluda --skip-torch-cuda-test --medvram
Warning: caught exception 'Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx', memory monitor disabled
ONNX: version=1.21.1 provider=CPUExecutionProvider, available=['AzureExecutionProvider', 'CPUExecutionProvider']
Loading weights [6ce0161689] from /var/www/ai/stable-diffusion-webui-amdgpu/models/Stable-diffusion/v1-5-pruned-emaonly.safetensors
Creating model from config: /var/www/ai/stable-diffusion-webui-amdgpu/configs/v1-inference.yaml
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 5.9s (prepare environment: 8.4s, initialize shared: 0.3s, load scripts: 0.3s, create ui: 0.4s, gradio launch: 0.4s).
creating model quickly: OSError
Traceback (most recent call last):
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 409, in hf_raise_for_status
    response.raise_for_status()
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/None/resolve/main/config.json

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/transformers/utils/hub.py", line 342, in cached_file
    resolved_file = hf_hub_download(
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 961, in hf_hub_download
    return _hf_hub_download_to_cache_dir(
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1068, in _hf_hub_download_to_cache_dir
    _raise_on_head_call_error(head_call_error, force_download, local_files_only)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1596, in _raise_on_head_call_error
    raise head_call_error
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1484, in _get_metadata_or_catch_error
    metadata = get_hf_file_metadata(
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1401, in get_hf_file_metadata
    r = _request_wrapper(
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 285, in _request_wrapper
    response = _request_wrapper(
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 309, in _request_wrapper
    hf_raise_for_status(response)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 459, in hf_raise_for_status
    raise _format(RepositoryNotFoundError, message, response) from e
huggingface_hub.errors.RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-68101330-0bbdfdd33aaf6a5f6dc465dd;df2f03c8-c41a-47ee-a48d-9d3f1862dc98)

Repository Not Found for url: https://huggingface.co/None/resolve/main/config.json.
Please make sure you specified the correct `repo_id` and `repo_type`.
If you are trying to access a private or gated repo, make sure you are authenticated. For more details, see https://huggingface.co/docs/huggingface_hub/authentication
Invalid username or password.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 973, in _bootstrap
    self._bootstrap_inner()
  File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/initialize.py", line 149, in load_model
    shared.sd_model  # noqa: B018
  File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/shared_items.py", line 190, in sd_model
    return modules.sd_models.model_data.get_sd_model()
  File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_models.py", line 693, in get_sd_model
    load_model()
  File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_models.py", line 831, in load_model
    sd_model = instantiate_from_config(sd_config.model, state_dict)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_models.py", line 775, in instantiate_from_config
    return constructor(**params)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/stable-diffusion-stability-ai/ldm/models/diffusion/ddpm.py", line 563, in __init__
    self.instantiate_cond_stage(cond_stage_config)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/stable-diffusion-stability-ai/ldm/models/diffusion/ddpm.py", line 630, in instantiate_cond_stage
    model = instantiate_from_config(config)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/stable-diffusion-stability-ai/ldm/util.py", line 89, in instantiate_from_config
    return get_obj_from_str(config["target"])(**config.get("params", dict()))
  File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/stable-diffusion-stability-ai/ldm/modules/encoders/modules.py", line 104, in __init__
    self.transformer = CLIPTextModel.from_pretrained(version)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_disable_initialization.py", line 68, in CLIPTextModel_from_pretrained
    res = self.CLIPTextModel_from_pretrained(None, *model_args, config=pretrained_model_name_or_path, state_dict={}, **kwargs)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/transformers/modeling_utils.py", line 262, in _wrapper
    return func(*args, **kwargs)
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3540, in from_pretrained
    resolved_config_file = cached_file(
  File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/transformers/utils/hub.py", line 365, in cached_file
    raise EnvironmentError(
OSError: None is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models'
If this is a private repository, make sure to pass a token having permission to this repo either by logging in with `huggingface-cli login` or by passing `token=<your_token>`

Failed to create model quickly; will retry using slow method.
Applying attention optimization: InvokeAI... done.
Model loaded in 7.8s (load weights from disk: 0.5s, create model: 1.9s, apply weights to model: 1.1s, apply half(): 0.4s, calculate empty prompt: 3.8s).
  0%|                                                                                                                                                                                                                  | 0/20 [00:00<?, ?it/s]
*** Error completing request
*** Arguments: ('task(6252xhavgr0bjg6)', <gradio.routes.Request object at 0x7fc5dbeef220>, '30 years old woman', '', [], 1, 1, 7, 512, 512, False, 0.7, 2, 'Latent', 0, 0, 0, 'Use same checkpoint', 'Use same sampler', 'Use same scheduler', '', '', [], 0, 20, 'DPM++ 2M', 'Automatic', False, '', 0.8, -1, False, -1, 0, 0, 0, False, False, 'positive', 'comma', 0, False, False, 'start', '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, False, False, False, 0, False) {}
    Traceback (most recent call last):
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/call_queue.py", line 74, in f
        res = list(func(*args, **kwargs))
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/call_queue.py", line 53, in f
        res = func(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/call_queue.py", line 37, in f
        res = func(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/txt2img.py", line 109, in txt2img
        processed = processing.process_images(p)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/processing.py", line 849, in process_images
        res = process_images_inner(p)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/processing.py", line 1083, in process_images_inner
        samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/processing.py", line 1441, in sample
        samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_samplers_kdiffusion.py", line 233, in sample
        samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_samplers_common.py", line 272, in launch_sampling
        return func()
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_samplers_kdiffusion.py", line 233, in <lambda>
        samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/k-diffusion/k_diffusion/sampling.py", line 594, in sample_dpmpp_2m
        denoised = model(x, sigmas[i] * s_in, **extra_args)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
        return forward_call(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_samplers_cfg_denoiser.py", line 249, in forward
        x_out = self.inner_model(x_in, sigma_in, cond=make_condition_dict(cond_in, image_cond_in))
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
        return forward_call(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/k-diffusion/k_diffusion/external.py", line 112, in forward
        eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/k-diffusion/k_diffusion/external.py", line 138, in get_eps
        return self.inner_model.apply_model(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_hijack_utils.py", line 22, in <lambda>
        setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_hijack_utils.py", line 34, in __call__
        return self.__sub_func(self.__orig_func, *args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_hijack_unet.py", line 50, in apply_model
        result = orig_func(self, x_noisy.to(devices.dtype_unet), t.to(devices.dtype_unet), cond, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_hijack_utils.py", line 22, in <lambda>
        setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_hijack_utils.py", line 36, in __call__
        return self.__orig_func(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/stable-diffusion-stability-ai/ldm/models/diffusion/ddpm.py", line 858, in apply_model
        x_recon = self.model(x_noisy, t, **cond)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1582, in _call_impl
        result = forward_call(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/stable-diffusion-stability-ai/ldm/models/diffusion/ddpm.py", line 1335, in forward
        out = self.diffusion_model(x, t, context=cc)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
        return forward_call(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/modules/sd_unet.py", line 91, in UNetModel_forward
        return original_forward(self, x, timesteps, context, *args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/stable-diffusion-stability-ai/ldm/modules/diffusionmodules/openaimodel.py", line 797, in forward
        h = module(h, emb, context)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
        return forward_call(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/repositories/stable-diffusion-stability-ai/ldm/modules/diffusionmodules/openaimodel.py", line 86, in forward
        x = layer(x)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1532, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1541, in _call_impl
        return forward_call(*args, **kwargs)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/extensions-builtin/Lora/networks.py", line 599, in network_Conv2d_forward
        return originals.Conv2d_forward(self, input)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 460, in forward
        return self._conv_forward(input, self.weight, self.bias)
      File "/var/www/ai/stable-diffusion-webui-amdgpu/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 456, in _conv_forward
        return F.conv2d(input, weight, bias, self.stride,
    RuntimeError: Input type (float) and bias type (c10::Half) should be the same

Additional information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions