Skip to content
This repository was archived by the owner on May 10, 2024. It is now read-only.

Update hugging-face-embedding-server.md #232

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Update hugging-face-embedding-server.md #232

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/embeddings/hugging-face-embedding-server.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ docker compose -f examples/server_side_embeddings/huggingface/docker-compose.yml
or

```bash
docker run -p 8001:80 -d -rm --name huggingface-embedding-server ghcr.io/huggingface/text-embeddings-inference:cpu-0.3.0 --model-id BAAI/bge-small-en-v1.5 --revision -main
docker run -p 8001:80 -d --rm --name huggingface-embedding-server ghcr.io/huggingface/text-embeddings-inference:cpu-0.3.0 --model-id BAAI/bge-small-en-v1.5 --revision -main
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mohdwasim, thanks for this. Can we instead use the following (from the latest version of hf repo)

docker run --platform linux/amd64 -d --rm -p 8080:80 -v ./data:/data --pull always ghcr.io/huggingface/text-embeddings-inference:cpu-1.2 --model-id "BAAI/bge-large-en-v1.5" --revision "refs/pr/5"

The reason we add --platform is so that it works on MacOS. Also we add a mount to store the model so we don't have to redownload.

```

:::note
Expand Down