-
Notifications
You must be signed in to change notification settings - Fork 1
feat: Add docker compose for WSL, with dummy env var files. #20
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
@@ -0,0 +1,9 @@ | |||
PG_DATABASE_URL = "postgresql+psycopg2://************:**********@*************-postgresql.services.clever-cloud.com:7327/************" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's use an env var from vaultwarden to source this secret as we do for the rest of our secrets here.
@@ -0,0 +1,9 @@ | |||
PG_DATABASE_URL = "postgresql+psycopg2://************:**********@*************-postgresql.services.clever-cloud.com:7327/************" | |||
LLM_INFERENCE_URL = "http://172.17.0.1:11434/v1/" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should communicate between services in a single stack using Swarm's DNS : wsl-kotaemon_ollama:11434
instead of exposing the ollama server if possible ?
Not sure how Kotaemon connects to ollama (directly from client or from backend)
LLM_INFERENCE_URL = "http://172.17.0.1:11434/v1/" | ||
LLM_INFERENCE_MODEL = "llama3.2:3b" | ||
LLM_INFERENCE_API_KEY = "ollama" | ||
EMBEDDING_MODEL_URL = "http://172.17.0.1:11434/v1/" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same remark here, use either Docker DNS or a public .services.dataforgood.fr address here
VECTOR_STORE_DEPLOYMENT: docker | ||
# PDF_FOLDER: | ||
ports: | ||
- '7860:7860' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We avoid exposing ports directly. If the traffic is HTTP, add a simple HTTP router for Traefik (see the playbook for examples). If the traffic is not HTTP we also support TCP at the moment and can rework the Traefik role to support UDP connections.
fe2ddfa
to
add1dd6
Compare
add1dd6
to
c183e6b
Compare
89dd6be
to
e4b90c2
Compare
No description provided.