Skip to content

v0.11.0
Compare
Choose a tag to compare
@github-actions github-actions released this 13 Jun 03:49
· 88 commits to main since this release
v0.11.0
8f80515
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Notable Changes

  • 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
  • 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
    --build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
    "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

docker run -d --rm -p 8080:8080 my-model

curl http://localhost:8080/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "llama3",
        "messages": [
            {
                "role": "user",
                "content": "Hello!"
            }
        ]
    }'
  • ⎈ Helm chart security hardening with restricted pod security admission

Features

Documentation

Continuous Integration

Chores

Assets 2
Loading