v1.0.4

What's Changed

• fix: Update cleanup script by @ratnopamc in #595
• fix: Update karpenter version for trainium-inferentia blueprint by @ratnopamc in #599
• docs: Add video link for Deploy accelerator-agnostic inference pipelines to Amazon EKS by @TalHibner in #600
• feat: Replaced NIM architecture diagram with self-made NIM on EKS arch diagram by @hustshawn in #612
• feat: RayServe with vLLM using AWS Neuron on Amazon EKS by @ratnopamc in #607
• feat: Mountpoint S3 for loading additional Spark Jars by @bainskb in #606
• feat: Support preloading container images into Bottlerocket data volumes with Karpenter by @lindarr915 in #587
• chore: Delete ai-ml/kubeflow directory by @askulkarni2 in #619
• feat: Updated mountpoint-s3 for spark readme by @bainskb in #618
• feat: Trainium blueprint upgrade and Llama3.1 405b Distributed inference example by @vara-bonthu in #622
• feat: Neuron scheduler update for trainium-inferentia blueprints by @ratnopamc in #624
• feat: Website Updates by @vara-bonthu in #626
• feat: Updates to the sidebar by @vara-bonthu in #627
• feat: Added deprecating notes; added Jark stack doc;added warnings for ML p… by @vara-bonthu in #628
• feat: NVIDIA NIM Updates by @vara-bonthu in #631
• feat: Udate NVIDIA NIM blueprint with grafana dashboard and docs by @ratnopamc in #633
• feat: Add OpenWebUI for vllm-rayserve-inf2 blueprint by @ratnopamc in #635
• feat: Updated EMR on EKS Blueprint by @vara-bonthu in #638
• chore: Update PULL_REQUEST_TEMPLATE.md by @askulkarni2 in #643
• chore: Add access entry for workshop by @askulkarni2 in #644
• fix: Use eks module for access_entries for trn-inf blueprint by @askulkarni2 in #646
• chore(deps): bump send and express in /website by @dependabot in #653
• chore(deps): bump serve-static and express in /website by @dependabot in #652
• feat: Updates to the llama3.1 405 model scripts by @vara-bonthu in #655
• feat: Add cloudwatch eks add on with enhanced monitoring for neuron by @ratnopamc in #651
• chore: Update cmd-shell image to python3.11 by @askulkarni2 in #656
• docs: Website documentation for vllm inferencing using rayserve on AWS Inferentia by @sindhupalakodety in #637
• feat: Adding support for AWS Batch by @delagoya in #620
• docs: Ray vLLM Inf2 website doc updates by @ratnopamc in #657
• feat: Observability for RayServe and vLLM GPU by @shivam-dubey-1 in #642
• feat: Add binpacking examples by @hitsub2 in #615
• feat: Spark K8s Operator on EKS IPv6 cluster by @ovaleanu in #499

New Contributors

• @TalHibner made their first contribution in #600
• @bainskb made their first contribution in #606
• @sindhupalakodety made their first contribution in #637
• @delagoya made their first contribution in #620
• @shivam-dubey-1 made their first contribution in #642

Full Changelog: v1.0.3...v1.0.4

v1.0.3

What's Changed

• 🚀 Initial commit for DoEKS by @vara-bonthu in #1
• removed package-lock.json file by @vara-bonthu in #2
• Adding package-lock.json file by @vara-bonthu in #3
• Fixing the git node package dependa alert by @vara-bonthu in #4
• Fix to github pages deployment by @vara-bonthu in #5
• Updated Test environment by @vara-bonthu in #6
• removed deployment branch as main for website by @vara-bonthu in #7
• changed publish dire to ./website by @vara-bonthu in #8
• baseurl for the site changed by @vara-bonthu in #9
• Searchbar added to website by @vara-bonthu in #32
• Karpenter Graviton Provisioner support for EMR on EKS by @vara-bonthu in #37
• Doc updates for Airflow and fixes to spark operator by @vara-bonthu in #38
• Trigger EMR on EKS jobs with Apache Airflow by @victorgu-github in #39
• Website updates by @vara-bonthu in #40
• 🦄 Apache YuniKorn batch scheduler with EMR on EKS by @vara-bonthu in #42
• Updates to github workflows by @vara-bonthu in #44
• EMR on EKS Gang scheduling example by @vara-bonthu in #49
• Added FluentBit config to write logs to S3 by @vara-bonthu in #50
• MWAA doc fix by @victorgu-github in #48
• Argo workflows on EKS example and doc by @victorgu-github in #43
• KubeCost addon for EMR on EKS Karpenter by @vara-bonthu in #52
• argo workflow enhancement by @victorgu-github in #53
• fix: Fixed the karpenter example hard-coded the provisioner region by @hustshawn in #55
• Bump loader-utils from 2.0.2 to 2.0.3 in /website by @dependabot in #57
• Bump minimatch, recursive-readdir and serve-handler in /website by @dependabot in #58
• Folder structure and major updates to docs by @vara-bonthu in #59
• Github workflow security updates by @vara-bonthu in #60
• daily tag gh flow added by @vara-bonthu in #61
• Bump loader-utils from 2.0.3 to 2.0.4 in /website by @dependabot in #62
• fix broken link after folder structure change by @victorgu-github in #63
• Feat: Apache Kafka using Strimzi on EKS by @AlyIbrahim in #47
• Fix link to Kafka docs. by @brianhammons in #64
• Better positioning EMR on EKS by @dalbhanj in #72
• add cdk blueprint for emr-eks by @lmouhib in #45
• Architecture diagram for home page by @vara-bonthu in #73
• Update import for emr on eks blueprint by @lmouhib in #74
• Add analytics reference architecture blog by @lmouhib in #75
• Fix the aws cli command by @lmouhib in #78
• VPC endpoints added;s3 state for e2e tests by @vara-bonthu in #77
• Add storage considerations and managed alternatives sections to Kafka… by @brianhammons in #79
• [feat] ACK EMR on EKS Controller pattern and example by @victorgu-github in #81
• [enhancement] Change argo workflow example to create spark app in a new ns by @victorgu-github in #84
• Feat: Observability on Spark on EKS by @victorgu-github in #85
• EMR on EKS Doc improvement by @dalbhanj in #83
• EMR on EKS Karpenter with YuniKorn updates by @vara-bonthu in #87
• fixing bug in CloudWatch Logs autocreate in helm bcoz terraform alrea… by @dalbhanj in #88
• Add Troubleshooting page by @dalbhanj in #90
• [enhancement] update argo workflows based on blog comments by @victorgu-github in #89
• Bump json5 from 2.2.1 to 2.2.3 in /website by @dependabot in #91
• Bump json5 from 2.2.1 to 2.2.3 in /analytics/cdk/emr-eks by @dependabot in #92
• Bump ua-parser-js from 0.7.31 to 0.7.33 in /website by @dependabot in #96
• Bump http-cache-semantics from 4.1.0 to 4.1.1 in /website by @dependabot in #100
• Bump @sideway/formula from 3.0.0 to 3.0.1 in /website by @dependabot in #103
• Website update to [email protected] by @vara-bonthu in #106
• Bump node-fetch and docusaurus in /website by @dependabot in #108
• Data on EKS Logo added with footer icons by @vara-bonthu in #109
• Removing the Robot font by @vara-bonthu in #110
• Added EMR cluster Name to output.tf so instructions work by @rbarcia in #113
• Spark Live UI added by @vara-bonthu in #114
• remove deprecated format and increaes volume timeout to 60 seconds by @nabuskey in #119
• EMR on EKS with Karpenter example with V5 EKS Blueprints by @vara-bonthu in #121
• feat: EMR on EKS Fargate pattern with new approach by @vara-bonthu in #102
• Update Adopters and Add policy of SSM to karpenter role by @srikaanthpenugonda in #123
• Readme update by @vara-bonthu in #124
• Data on EKS workshop module by @vara-bonthu in #125
• Apache NiFi on EKS by @codesometech in #99
• Cleanup scripts added by @vara-bonthu in #126
• add workshop util by @lmouhib in #129
• modifying job submission by changing to input variables rather than hardcoding by @dalbhanj in #130
• Workshop content update by @vara-bonthu in #133
• fix for karpenter provisioner by @vara-bonthu in #134
• Bump webpack from 5.74.0 to 5.76.1 in /website by @dependabot in #135
• adding ebs volume example by @dalbhanj in #132
• Updated all the addons to use v4.25.0 by @vara-bonthu in #136
• minor bug in compute provisioner script by @dalbhanj in #137
• Correct URL in README.md by @mfjackson in #141
• Fsx for lustre added as module to Karpenter example by @vara-bonthu in #139
• Removing link from Adopters page by @dalbhanj in #142
• added preserve field to true to avoid destroy issues by @vara-bonthu in #144
• simplifying deployment experience by @dalbhanj in #143
• chore: Remove accidental commits by @askulkarni2 in #145
• feat: Updates to the Ray blueprint by @askulkarni2 in #111
• doc: Add Kubeflow on AWS page by @askulkarni2 in #147
• Improve guide by @dalbhanj in #148
• EMR EKS Workshop module updates by @vara-bonthu in #146
• RAID-0 config for NVMe based SSD EC2 instances with Karpenter Provisioners by @vara-bonthu in #156
• Add CloudNativePG operator. by @jihed in #127
• CloudNativePG by @jihed in #159
• initialize terraform in install scripts by @nabuskey in #161
• update secrets name by @jihed in #160
• Fix documentation error in ray pytorch example by @elyall in #165
• Spark operator refactor by @vara-bonthu in #170
• fix pre-commit run by @jihed in https://github.com/awslabs/...

v1.0.2

What's Changed

• remove deprecated format and increaes volume timeout to 60 seconds by @nabuskey in #119
• EMR on EKS with Karpenter example with V5 EKS Blueprints by @vara-bonthu in #121
• feat: EMR on EKS Fargate pattern with new approach by @vara-bonthu in #102
• Update Adopters and Add policy of SSM to karpenter role by @srikaanthpenugonda in #123
• Readme update by @vara-bonthu in #124
• Data on EKS workshop module by @vara-bonthu in #125
• Apache NiFi on EKS by @codesometech in #99
• Cleanup scripts added by @vara-bonthu in #126
• add workshop util by @lmouhib in #129
• modifying job submission by changing to input variables rather than hardcoding by @dalbhanj in #130
• Workshop content update by @vara-bonthu in #133
• fix for karpenter provisioner by @vara-bonthu in #134
• Bump webpack from 5.74.0 to 5.76.1 in /website by @dependabot in #135
• adding ebs volume example by @dalbhanj in #132
• Updated all the addons to use v4.25.0 by @vara-bonthu in #136
• minor bug in compute provisioner script by @dalbhanj in #137
• Correct URL in README.md by @mfjackson in #141
• Fsx for lustre added as module to Karpenter example by @vara-bonthu in #139
• Removing link from Adopters page by @dalbhanj in #142
• added preserve field to true to avoid destroy issues by @vara-bonthu in #144
• simplifying deployment experience by @dalbhanj in #143
• chore: Remove accidental commits by @askulkarni2 in #145
• feat: Updates to the Ray blueprint by @askulkarni2 in #111
• doc: Add Kubeflow on AWS page by @askulkarni2 in #147
• Improve guide by @dalbhanj in #148
• EMR EKS Workshop module updates by @vara-bonthu in #146
• RAID-0 config for NVMe based SSD EC2 instances with Karpenter Provisioners by @vara-bonthu in #156
• Add CloudNativePG operator. by @jihed in #127
• CloudNativePG by @jihed in #159
• initialize terraform in install scripts by @nabuskey in #161
• update secrets name by @jihed in #160
• Fix documentation error in ray pytorch example by @elyall in #165
• Spark operator refactor by @vara-bonthu in #170
• fix pre-commit run by @jihed in #173
• EMR EKS Blueprints leveraging the sub terraform modules by @vara-bonthu in #174
• Updated broken links on Readme by @vara-bonthu in #177
• Removed the cluster name variable by @vara-bonthu in #178
• Bump node-fetch and docusaurus in /website by @dependabot in #168
• Flink Operator on EKS by @vara-bonthu in #180
• Security critical fixes for docusaurus by @vara-bonthu in #181
• Bump xml2js and @aws-quickstart/eks-blueprints in /analytics/cdk/emr-eks by @dependabot in #183
• add output for amp by @lmouhib in #184
• delta lake example by @rajarshighosal in #182
• updated website doc for delta lake example by @rajarshighosal in #188
• Bump yaml from 2.1.3 to 2.2.2 in /analytics/cdk/emr-eks by @dependabot in #195
• Dependabot security fix for GOT and TRIM packages by @vara-bonthu in #196
• Monitoring ML Workflows using Kubeflow on Amazon EKS by @elamaran11 in #202
• Fix region mismatch in XGBoost example by @raykrueger in #204
• Spark Operator blueprint upgrade to EKS 1.26 by @vara-bonthu in #205
• Fix region mismatch in pytorch example by @raykrueger in #207
• Fix ray example docs by @raykrueger in #208
• EMR on EKS with Karpenter updated to Kubernetes 1.26 by @mihneaspirescu in #210
• Fixed intallation scripts and removed default region from variables.tf by @lusoal in #211
• fixed broken link in spark observability module by @lusoal in #214
• remove acl using bucket policy by @hitsub2 in #218
• Website restructure and Dynamic EBS volumes for karpenter userdata by @vara-bonthu in #221
• Fixed links for EMR EKS Inro page by @vara-bonthu in #222
• EMR NVIDIA Spark Rapids Blueprint added by @vara-bonthu in #224
• Modify Python script and execution shell script to customize Docker i… by @tanmatth in #225
• Feat/emr eks spark operator by @lmouhib in #220
• DataHub on EKS by @bbgu1 in #213
• Kafka on EKS - EKS Bluprints V5 Mitigation by @AlyIbrahim in #169
• pre-commit updates and vpc module version uplifted by @vara-bonthu in #227
• EMR spark rapids website and XGBoost example update by @vara-bonthu in #229
• Bump aws-cdk-lib from 2.51.1 to 2.80.0 in /analytics/cdk/emr-eks by @dependabot in #226
• Reduce the number of times we run apply by @raykrueger in #233
• Upgrade Airflow to 2.5.3 and EKS to 1.26 by @jagpk in #230
• Jupyterhub on EKS by @rajarshighosal in #228
• Updated readme with correct links by @vara-bonthu in #234
• feat: Refactor/update kafka v5 by @ovaleanu in #231
• feat: Docs update for Jupyterhub and Spark rapids by @vara-bonthu in #236
• fix: Bump cdk and remove package-lock.json by @lmouhib in #238
• Bump stylelint from 14.16.1 to 15.10.1 in /website by @dependabot in #239
• chore: Fix linting errors to pass CI checks by @bryantbiggs in #242
• chore: Change Prometheus with for kube-prometheus-stack by @ovaleanu in #241
• chore: Update module versions to standardize and remove deprecation errors/warnings by @bryantbiggs in #243
• Bump semver from 5.7.1 to 5.7.2 in /website by @dependabot in #245
• chore: Remove VPC CNI IRSA role; utilize permissions provided on EC2 node IAM role by @bryantbiggs in #244
• chore: Change Prometheus to kube-prometheus-stack by @ovaleanu in #246
• chore: Update Spark operator example to use new bootstrap flag for instance store volume RAID0 configuration by @bryantbiggs in #237
• chore: Update Karpenter provisioner codeblock for self-managed Airflow by @bryantbiggs in #247
• fix: Update Spark install script to remove target apply on addons modules by @bryantbiggs in #250
• chore: Replace local EMR on EKS module with virtual cluster sub-module from terraform-aws-emr by @bryantbiggs in #249
• chore: Emr-eks-karpenter blueprint updates by @vara-bonthu in #252
• feat: Trainium blueprint Part1 by @vara-bonthu in #251
• fix: Added a fix for Grafana to use sigv4 authentication by @vara-bonthu in #253
• chore: README Update with logo by @vara-bonthu in #254
• chore: Add remote AMP for Grafana by @ovaleanu in #256
• Bump word-wrap from 1.2.3 to 1.2.4 in /website by @dependabot in #258
• chore: EMR ...

v1.0.1 Final release for Version1

NOTE: This is the final release for Data on EKS Version1 blueprints(Final Tag v1.0.1). We will be updating the DoEKS blueprints with major changes and it will be published under Version2 onwards

What's Changed

• Bump loader-utils from 2.0.3 to 2.0.4 in /website by @dependabot in #62
• fix broken link after folder structure change by @season1946 in #63
• Feat: Apache Kafka using Strimzi on EKS by @AlyIbrahim in #47
• Fix link to Kafka docs. by @brianhammons in #64
• Better positioning EMR on EKS by @dalbhanj in #72
• add cdk blueprint for emr-eks by @lmouhib in #45
• Architecture diagram for home page by @vara-bonthu in #73
• Update import for emr on eks blueprint by @lmouhib in #74
• Add analytics reference architecture blog by @lmouhib in #75
• Fix the aws cli command by @lmouhib in #78
• VPC endpoints added;s3 state for e2e tests by @vara-bonthu in #77
• Add storage considerations and managed alternatives sections to Kafka… by @brianhammons in #79
• [feat] ACK EMR on EKS Controller pattern and example by @season1946 in #81
• [enhancement] Change argo workflow example to create spark app in a new ns by @season1946 in #84
• Feat: Observability on Spark on EKS by @season1946 in #85
• EMR on EKS Doc improvement by @dalbhanj in #83
• EMR on EKS Karpenter with YuniKorn updates by @vara-bonthu in #87
• fixing bug in CloudWatch Logs autocreate in helm bcoz terraform alrea… by @dalbhanj in #88
• Add Troubleshooting page by @dalbhanj in #90
• [enhancement] update argo workflows based on blog comments by @season1946 in #89
• Bump json5 from 2.2.1 to 2.2.3 in /website by @dependabot in #91
• Bump json5 from 2.2.1 to 2.2.3 in /analytics/cdk/emr-eks by @dependabot in #92
• Bump ua-parser-js from 0.7.31 to 0.7.33 in /website by @dependabot in #96
• Bump http-cache-semantics from 4.1.0 to 4.1.1 in /website by @dependabot in #100
• Bump @sideway/formula from 3.0.0 to 3.0.1 in /website by @dependabot in #103
• Website update to [email protected] by @vara-bonthu in #106
• Bump node-fetch and docusaurus in /website by @dependabot in #108
• Data on EKS Logo added with footer icons by @vara-bonthu in #109
• Removing the Robot font by @vara-bonthu in #110
• Added EMR cluster Name to output.tf so instructions work by @rbarcia in #113
• Spark Live UI added by @vara-bonthu in #114

New Contributors

• @AlyIbrahim made their first contribution in #47
• @brianhammons made their first contribution in #64
• @dalbhanj made their first contribution in #72
• @lmouhib made their first contribution in #45
• @rbarcia made their first contribution in #113

Full Changelog: v1.0.0...v1.0.1

v0.1 DoEKS initial release

What's Changed

• 🚀 Initial commit for DoEKS by @vara-bonthu in #1
• removed package-lock.json file by @vara-bonthu in #2
• Adding package-lock.json file by @vara-bonthu in #3
• Fixing the git node package dependa alert by @vara-bonthu in #4
• Fix to github pages deployment by @vara-bonthu in #5
• Updated Test environment by @vara-bonthu in #6
• removed deployment branch as main for website by @vara-bonthu in #7
• changed publish dire to ./website by @vara-bonthu in #8
• baseurl for the site changed by @vara-bonthu in #9
• Searchbar added to website by @vara-bonthu in #32
• Karpenter Graviton Provisioner support for EMR on EKS by @vara-bonthu in #37
• Doc updates for Airflow and fixes to spark operator by @vara-bonthu in #38
• Trigger EMR on EKS jobs with Apache Airflow by @season1946 in #39
• Website updates by @vara-bonthu in #40
• 🦄 Apache YuniKorn batch scheduler with EMR on EKS by @vara-bonthu in #42
• Updates to github workflows by @vara-bonthu in #44
• EMR on EKS Gang scheduling example by @vara-bonthu in #49
• Added FluentBit config to write logs to S3 by @vara-bonthu in #50
• MWAA doc fix by @season1946 in #48
• Argo workflows on EKS example and doc by @season1946 in #43
• KubeCost addon for EMR on EKS Karpenter by @vara-bonthu in #52
• argo workflow enhancement by @season1946 in #53
• fix: Fixed the karpenter example hard-coded the provisioner region by @hustshawn in #55
• Bump loader-utils from 2.0.2 to 2.0.3 in /website by @dependabot in #57
• Bump minimatch, recursive-readdir and serve-handler in /website by @dependabot in #58
• Folder structure and major updates to docs by @vara-bonthu in #59
• Github workflow security updates by @vara-bonthu in #60
• daily tag gh flow added by @vara-bonthu in #61

New Contributors

• @vara-bonthu made their first contribution in #1
• @season1946 made their first contribution in #39
• @hustshawn made their first contribution in #55
• @dependabot made their first contribution in #57

Full Changelog: https://github.com/awslabs/data-on-eks/commits/v0.1