v0.2.0-rc0

What's Changed

• feat: adds a new totals dashboard by @elmurci in #151
• feat: added nilai prod configs by @jcabrero in #150
• feat: nilDB prompt storage in nilAI by @jcabrero in #147
• feat: added hierarchical configuration options by @jcabrero in #152
• feat: added web search rate limits by @jcabrero in #153
• feat: Web Search V2 with context extraction + multi-model adjustment by @blefo in #154

Full Changelog: v0.2.0-alpha2...v0.2.0-rc0

v0.2.0-alpha2

What's Changed

• feat: multimodal endpoint (image + text) by @blefo in #148
• feat: added model settings by @jcabrero in #149

Full Changelog: v0.2.0-alpha1...v0.2.0-alpha2

v0.2.0-alpha1

What's Changed

• Update vLLM to 0.10.1 by @blefo in #142
• fix: CICD pipeline to use Runner to Upload images to ECR by @jcabrero in #143
• feat: integrate Brave Search API by @blefo in #140
• feat: nilcc scripts and minor fixes by @jcabrero in #138
• feat: Improved testnet environment infrastructure docker compose by @jcabrero in #141
• feat: Add GPT OSS 20B and 120B by @jcabrero in #145

Full Changelog: v0.2.0-alpha0...v0.2.0-alpha1

v0.2.0-alpha0

What's Changed

• docs: updates the docs url to the new endpoint by @elmurci in #116
• chore: advanced docker-compose config for new endpoints by @jcabrero in #117
• feat: web search by @blefo in #119
• fix: aws role for CI/CD by @jcabrero in #133
• fix: memory-leak-like issue in nv_trust attestation by @jcabrero in #132
• update web search implementation to use Brave API and add a query step to improve web search by @blefo in #134
• feat: implement web search rate limiting functionality by @blefo in #135
• feat: integrated nilCC <> nilAI @jcabrero in #137

New Contributors

• @elmurci made their first contribution in #116

Full Changelog: v0.1.0-rc2...v0.2.0-alpha0

v0.1.0-rc2

Docker Images

• nilai-api: public.ecr.aws/k5d9x2g2/nilai-api:v0.1.0-rc2
• nilai-vllm: public.ecr.aws/k5d9x2g2/nilai-vllm:v0.1.0-rc2
• nilai-attestation: public.ecr.aws/k5d9x2g2/nilai-attestation:v0.1.0-rc2

What's Changed

• fix: added specific mountpoint for api-specific config files by @jcabrero in #115

Full Changelog: v0.1.0-rc1...v0.1.0-rc2

v0.1.0-rc1

Docker Images

• nilai-api: public.ecr.aws/k5d9x2g2/nilai-api:v0.1.0-rc1
• nilai-vllm: public.ecr.aws/k5d9x2g2/nilai-vllm:v0.1.0-rc1
• nilai-attestation: public.ecr.aws/k5d9x2g2/nilai-attestation:v0.1.0-rc1

What's Changed

• fix: migration to set default limits based on environment variables by @jcabrero in #114

Full Changelog: v0.1.0-rc0...v0.1.0-rc1

v0.1.0-rc0

Docker Images

• nilai-api: public.ecr.aws/k5d9x2g2/nilai-api:v0.1.0-rc0
• nilai-vllm: public.ecr.aws/k5d9x2g2/nilai-vllm:v0.1.0-rc0
• nilai-attestation: public.ecr.aws/k5d9x2g2/nilai-attestation:v0.1.0-rc0

What's Changed

• feat: added docker integration with Dockerfile + Compose by @jcabrero in #7
• feat: Add support for API keys by @jcabrero in #9
• feat: Added HTTPS and fixed various performance issues for CPU by @jcabrero in #10
• docs: Added OpenAPI and FastAPI docs in API docs page by @jcabrero in #13
• feat: Add query number by @jcabrero in #14
• feat: AMD SEV-SNP Attestation by @jcabrero in #18
• feat: Updated to dynamic model addition by @jcabrero in #25
• feat: Added Llama 8B option by @jcabrero in #26
• feat: Add Secret Models by @jcabrero in #27
• fix: openai api corrections by @jcabrero in #28
• feat: Add staggered docker compose deploy by @jcabrero in #29
• Feat: CI Pipelines by @jcabrero in #30
• feat: Allow streamed model responses by @jcabrero in #33
• fix: Streaming LLM and API outputs by @jcabrero in #35
• feat: Added maximum supported context windows for each model by @jcabrero in #36
• fix: Models disconnecting from etcd3 by @jcabrero in #39
• chore: Add better instructions for manual execution to README.md by @jcabrero in #42
• feat: add nilrag feature to nilai by @manel1874 in #43
• fix: updated numpy and nilrag versions by @jcabrero in #45
• feat: Add Llama 1B and 8B vLLM models for GPU by @mathias-atla in #40
• feat: new vLLM backend by @jcabrero in #46
• feat: Add cloud remote database for instances by @jcabrero in #48
• feat: Support for Nvidia CC by @jcabrero in #47
• fix: verifier gunicorn rollout by @jcabrero in #49
• chore: Add postgres docker compose volume by @jcabrero in #63
• feat: added dolphin models and changed logging to warning by @jcabrero in #65
• chore: Open Source Changes by @jcabrero in #66
• chore: fix pyright in nilai_api by @lumasepa in #68
• More pyright fixes by @lumasepa in #70
• fix: nilRAG GPU Usage on nilAI by @jcabrero in #71
• e2e tests by @lumasepa in #67
• feat: Add Llama 70B by @jcabrero in #76
• feat: DB Grafana Dashboards by @jcabrero in #91
• feat: add async to nilrag and nildb call by @manel1874 in #92
• fix: .env file clarifications and grafana access by @jcabrero in #95
• refactor: update nilrag operation to use new nilrag api by @manel1874 in #94
• Update README with macOS Local Execution Troubleshooting Instructions by @blefo in #69
• feat: Improved attestation verification by @jcabrero in #96
• feat: NUC authentication by @jcabrero in #98
• feat: Dual Authentication Mechanism API + NUC by @jcabrero in #101
• feat: new improved grafana dashboard and dashboard for nucs by @jcabrero in #102
• feat: allow all CORS origins by @jcabrero in #103
• feat: added docs token auth bypass by @jcabrero in #104
• feat: Update NUCs to compatibility with public keys by @jcabrero in #110
• chore: Update to rc version of nuc-py by @jcabrero in #112
• chore: add CD pipeline for nilAI images by @jcabrero in #113

Full Changelog: https://github.com/NillionNetwork/nilAI/commits/v0.1.0-rc0