-
Notifications
You must be signed in to change notification settings - Fork 201
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Apply Patch to include quantization measure step in Readme
- Loading branch information
1 parent
a9ab1ca
commit b9550b7
Showing
1 changed file
with
46 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,46 @@ | ||
From 04864c63cc4a88ea064c134250f345941824c9b2 Mon Sep 17 00:00:00 2001 | ||
From: Iman Gohari <[email protected]> | ||
Date: Thu, 14 Nov 2024 17:41:15 +0000 | ||
Subject: [PATCH] fix(sd-readme): Added sd3 measure step | ||
|
||
--- | ||
examples/stable-diffusion/README.md | 21 +++++++++++++++++++-- | ||
1 file changed, 19 insertions(+), 2 deletions(-) | ||
|
||
diff --git a/examples/stable-diffusion/README.md b/examples/stable-diffusion/README.md | ||
index 6fe9aa9..a2799f7 100644 | ||
--- a/examples/stable-diffusion/README.md | ||
+++ b/examples/stable-diffusion/README.md | ||
@@ -295,10 +295,27 @@ python text_to_image_generation.py \ | ||
--bf16 | ||
``` | ||
|
||
-Here is how to generate SD3 images with a single prompt with FP8 precision: | ||
+Here is how to generate SD3 images with a single prompt with FP8 precision. First we run the measure command to generate stats for quantization: | ||
|
||
-Note : Run the below command in Measure mode to generate stats for quantization, which is done by setting --quant_mode to 'measure' and use 'measure_config.json' file instead of 'quantize_config.json' for QUANT_CONFIG. | ||
+``` | ||
+QUANT_CONFIG=quantization/stable-diffusion-3/measure_config.json \ | ||
+PT_HPU_WEIGHT_SHARING=0 \ | ||
+python text_to_image_generation.py \ | ||
+ --model_name_or_path stabilityai/stable-diffusion-3-medium-diffusers \ | ||
+ --prompts "Sailing ship painting by Van Gogh" \ | ||
+ --num_images_per_prompt 10 \ | ||
+ --batch_size 1 \ | ||
+ --num_inference_steps 28 \ | ||
+ --image_save_dir /tmp/stable_diffusion_3_images \ | ||
+ --scheduler default \ | ||
+ --use_habana \ | ||
+ --use_hpu_graphs \ | ||
+ --gaudi_config Habana/stable-diffusion \ | ||
+ --bf16 \ | ||
+ --quant_mode measure | ||
+``` | ||
|
||
+Second, we run quantization command: | ||
```bash | ||
QUANT_CONFIG=quantization/stable-diffusion-3/quantize_config.json \ | ||
PT_HPU_WEIGHT_SHARING=0 \ | ||
-- | ||
2.34.1 | ||
|