StableDiffusion Proxy Server

Note

The project is still under active development. The existing features still need to be improved and more features will be added in the future.

Setup

• Install dependencies

  • Add Python PPA

    # Ubuntu 20.04
    sudo add-apt-repository ppa:deadsnakes/ppa
    sudo apt update

  • Install Python 3.10 (Optional)

    If Python 3.10 is already installed, you can skip this step. Use python3 --version or python --version to check if Python 3.10 is installed.

    sudo apt install -y python3.10 python3.10-dev

  • Install Python 3.10 venv

    sudo apt install -y python3.10-venv

  • Install other dependencies

    sudo apt install -y wget git libgl1 libglib2.0-0 curl

• Install stable-diffusion-webui

  # Download script
  wget -q https://raw.githubusercontent.com/AUTOMATIC1111/stable-diffusion-webui/master/webui.sh
  
  # Make script executable
  chmod +x webui.sh
  
  # Run script
  bash webui.sh -f

  Note: The first time you run the script, it will take minutes to deploy stable-diffusion-webui.

• (Optional) Download models

  curl -L https://huggingface.co/second-state/waiANINSFWPONYXL_v90-GGUF/resolve/main/waiANINSFWPONYXL_v90-f16.safetensors -o ./stable-diffusion-webui/models/Stable-diffusion/waiANINSFWPONYXL_v90-f16.safetensors

• Add reference-only control extension to stable-diffusion-webui

  Follow the steps in this guide to install the reference-only control extension to stable-diffusion-webui. For convenience, you can get the url of the extension below:

  https://github.com/Mikubill/sd-webui-controlnet.git
  

• Install wasmedge

  curl -sSf https://raw.githubusercontent.com/WasmEdge/WasmEdge/master/utils/install_v2.sh | bash -s -- -v 0.14.1

• Download proxy server wasm app

  curl -LO https://github.com/LlamaEdge/sd-proxy-server/releases/latest/download/sd-proxy-server.wasm

Usage

• Start proxy server

  wasmedge --dir .:. sd-proxy-server.wasm

  sd-proxy-server will use 8080 port by default. You can change the port by adding --port <port>.

• Start downstream sd server

  ./webui.sh --api
  
  # or
  
  bash webui.sh -f --api

• Register downstream sd server

  Assume that the downstream sd server is running on http://localhost:7860. Then you can register it by the following command:

  curl --location 'http://localhost:8080/admin/register/image' \
  --header 'Content-Type: text/plain' \
  --data 'http://localhost:7860'

  If the command runs successfully, the following message will be displayed:

  {
    "message": "URL registered successfully",
    "url": "http://localhost:7860/"
  }

• Send a text-to-image request to the proxy server

  In the data directory, req.json shows an example of a text-to-image request. The image generation process uses reference-only control.

  # download req.json
  curl -LO https://raw.githubusercontent.com/LlamaEdge/sd-proxy-server/refs/heads/main/data/req.json
  
  # send request
  curl -o output.json -X POST -H "Content-Type: application/json" -d @req.json http://localhost:8080/v1/images/generations

  If the command runs successfully, the output will be saved in output.json, which contains the generated image and the prompt. It looks like the following:

  [
    {
        "b64_json": "iVBORw0KGgoAAAANSUhEUgAAAhgAAAP......",
        "prompt": "1girl,intricate,highly detailed,Mature,seductive gaze,teasing expression,sexy posture,solo,Moderate breasts,Charm,alluring,Hot,tsurime,lipstick,stylish_pose,long hair,long_eyelashes,black hair,bar,dress,"
     }
  ]