You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
for DiffusionPipline, as I understand (hopefully correctly) from this part of the documentation, it should be possible to specify device_map="auto" when loading a pipeline with from_pretrained but this results in a value error saying that this is not supported.
However, the documentation on device placement currently states that only the "balanced" strategy is supported.
Is this possibly similar to #11432 and should be removed from the docstrings / documentation? Happy to help on this with a PR if it turns out to be a mistake in the documentation.
---------------------------------------------------------------------------
NotImplementedError Traceback (most recent call last)
Cell In[12], line 3
1 from diffusers import StableDiffusionPipeline
----> 3 pipe = StableDiffusionPipeline.from_pretrained("stable-diffusion-v1-5/stable-diffusion-v1-5", device_map="auto")
File ~/miniconda3/envs/pruna/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py:114, in validate_hf_hub_args.<locals>._inner_fn(*args, **kwargs)
111 if check_use_auth_token:
112 kwargs = smoothly_deprecate_use_auth_token(fn_name=fn.__name__, has_token=has_token, kwargs=kwargs)
--> 114 return fn(*args, **kwargs)
File ~/miniconda3/envs/pruna/lib/python3.10/site-packages/diffusers/pipelines/pipeline_utils.py:745, in DiffusionPipeline.from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
742 raise ValueError("`device_map` must be a string.")
744 if device_map is not None and device_map not in SUPPORTED_DEVICE_MAP:
--> 745 raise NotImplementedError(
746 f"{device_map} not supported. Supported strategies are: {', '.join(SUPPORTED_DEVICE_MAP)}"
747 )
749 if device_map is not None and device_map in SUPPORTED_DEVICE_MAP:
750 if is_accelerate_version("<", "0.28.0"):
NotImplementedError: auto not supported. Supported strategies are: balanced
Describe the bug
Hey dear diffusers team,
for
DiffusionPipline
, as I understand (hopefully correctly) from this part of the documentation, it should be possible to specifydevice_map="auto"
when loading a pipeline withfrom_pretrained
but this results in a value error saying that this is not supported.However, the documentation on device placement currently states that only the "balanced" strategy is supported.
Is this possibly similar to #11432 and should be removed from the docstrings / documentation? Happy to help on this with a PR if it turns out to be a mistake in the documentation.
Thanks a lot for your hard work!
Reproduction
or
Logs
System Info
NVIDIA H100 PCIe, 81559 MiB
Who can help?
No response
The text was updated successfully, but these errors were encountered: