v0.9.0

Notable Changes

• 🕵️ Auto runtime detection: AIKit will now automatically check your CPU and GPU capabilities, and automatically choose the most optimized runtime. With this change, there is no differentiation for runtimes avx, avx2, and avx512. They can still be used to skip installing the cuda runtime libraries for slimmer images.
• 💿 Pre-made models will now include CUDA libraries by default, and CUDA specific images will not be updated anymore. Thanks to auto runtime detection if a compatible GPU is not found, it will fallback to the most optimized CPU runtime.
• ⎈ Helm chart for Kubernetes is now available!
• 🚀 New pre-made models are now available: Gemma 1.1 2B Instruct and Codestral 22B.
• ✨ Updated LocalAI to v2.16.0.
• 🦥 Updated Unsloth to May 2024 release.

Features

• add phi3 model (#210) #210 (Sertaç Özercan)
• helm chart (#240) #240 (Sertaç Özercan)
• add codestral (#253) #253 (Sertaç Özercan)

Bug Fixes

• allow list api.scorecard.dev (#229) #229 (Sertaç Özercan)
• gpu detect (#238) #238 (Sertaç Özercan)
• release pr workflow (#243) #243 (Sertaç Özercan)
• chart appversion (#245) #245 (Sertaç Özercan)

Documentation

• doc deprecated models (#212) #212 (Sertaç Özercan)
• fix new row in table (#215) #215 (Sertaç Özercan)
• add model name (#217) #217 (Sertaç Özercan)
• new logo (#218) #218 (Sertaç Özercan)
• update helm chart (#247) #247 (Sertaç Özercan)
• helm chart (#248) #248 (Sertaç Özercan)
• update llama.cpp (#252) #252 (Sertaç Özercan)

Continuous Integration

• allow helm.sh for release (#258) #258 (Sertaç Özercan)

Chores

• deps: Bump golang from b03f3ba to d0902ba (#221) #221 (dependabot[bot])
• deps: Bump github.com/containerd/containerd from 1.7.15 to 1.7.16 (#222) #222 (dependabot[bot])
• deps: Bump the actions-all group with 5 updates (#224) #224 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.13.1 to 0.13.2 (#223) #223 (dependabot[bot])
• deps: Bump the actions-all group with 4 updates (#226) #226 (dependabot[bot])
• deps: Bump the actions-all group with 4 updates (#228) #228 (dependabot[bot])
• deps: Bump golang from d0902ba to 6d71b7c (#227) #227 (dependabot[bot])
• deps: Bump golang from 6d71b7c to 5c56bd4 (#233) #233 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.63.2 to 1.64.0 (#231) #231 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#230) #230 (dependabot[bot])
• deps: Bump github.com/containerd/containerd from 1.7.16 to 1.7.17 (#232) #232 (dependabot[bot])
• update to localai v2.16.0 (#225) #225 (Sertaç Özercan)
• remove runtime (#237) #237 (Sertaç Özercan)
• update unsloth to may 2024 release (#239) #239 (Sertaç Özercan)
• add gemma 1.1 model (#149) #149 (Sertaç Özercan)
• deps: Bump the actions-all group with 4 updates (#251) #251 (dependabot[bot])
• Prepare v0.9.0 release (#254) #256,#254 (github-actions[bot])

Reverts

• runtime removal (#249) #249 (Sertaç Özercan)