Provide an Open AI API-compatible API component :-)

[ChristianWeyer]

I love this sample here 👏🏼:
https://github.com/fermyon/ai-examples/tree/main/openapi-rs

Wouldn't it be even greater if we had an Open AI Chat completions API-compatible API component?
Then, we could use any tools out there that support Open AI.

.cc @jpflueger

[jpflueger]

Yes! This is something I'm actively working on in a different repository jpflueger/spin-llm-prompts. Right now I'm still adjusting the API to be compatible. Once I get the completions component in there to be closer to parity I'll update the sample here as well and hopefully publish it as a re-usable component like the static fileserver.

[average-bit]

Would also be great to expand this to the mistral gguf models from TheBloke on hugginface