1.4.109.0 September Release
We are excited to release the September Update of AKS Edge Essentials.
New Features
- Kubernetes 1.26 support. We are now supporting two Kubernetes versions, 1.25 and 1.26.
- Log Partition Size Customizability. Now the log partition size can be set between 1-10GB
Version Numbers
- AKS-EE Version: 1.4.109.0
- Mariner Version: 2.0.20230904
- K8s (upstream Kubernetes) distribution - 1.26.3, 1.25.7
- K3s distribution – 1.26.6+k3s, 1.25.8+k3s
- Json version schema - 1.9
Experimental or Preview Features
- Run Windows containerized workloads
- Create multi-node deployments either on a single machine or across multiple machines.
- Create a cluster with multiple machines
For more information feature set and benefits, see AKS Edge Essentials Overview.
Known issues
Update
- OS upgrade (Windows 10 to Windows 11) will result in AKS Edge Essentials failing to work properly
- "Unable to Start HCS VM" exception caught when running command "Start-AksEdgeControlPlaneUpdate -firstControlPlane True" If this error is encountered, the following commands can be used to recover the cluster
import-module "C:\Program Files\WindowsPowerShell\Modules\1.3.186.0" -Force $nodeConfig = Get-NodeConfig -NodeType ([NodeType]::Linux) $ServiceIpRange = ParseServiceIpRange -ServiceIpRange $nodeConfig.ServiceIpRange $scriptArgs = @{ firstControlPlane = $firstControlPlane networkPlugin = $(Get-ClusterNetworkPlugin) controlPlane = $(Get-LinuxNodeHasControlPlane) controlPlaneEndpointIp = $(Get-ClusterControlPlaneEndpoint).ControlPlaneEndpointIp serviceIPRangeStart = $($ServiceIpRange.Start) serviceIPRangeEnd = $($ServiceIpRange.End) } Update-PostScriptLinuxVM @scriptArgs
Deployment
- Deploying a K8s Linux node on a 4GB RAM host machine fails
- New deployment fails when the execution policy is set to AllSigned (
Set-ExecutionPolicy –ExecutionPolicy AllSigned
) - Uninstalling and reinstalling k8s/k3s causes a “deployment already exists” error when creating a new deployment, so a restart is necessary
- Event logging fails when uninstalling and reinstalling an MSI without a reboot in between
- When a deployment fails due to lack of memory/disk space, it creates an incomplete VHDX file that causes errors in later deployments
- Deployment with External virtual switch fails when using Windows RS5
Linux nodes
- When you use the Remove-AksEdgeNode to remove a node, it might still show up in the
kubectl get nodes
as the cluster tries to reconcile the state of the present nodes. Please note that the command Remove-AksEdgeNode is a asynchronous call and will return before the cluster state is updated to reflect the new state.
Windows nodes
- On a K3s Windows node, load balancer klipper-lb pulls images from the internet when connected
- Adding a Windows node takes around ~10 minutes to complete
- K3s Windows node with Calico as the CNI is not yet supported
- No storage provisioner is available for the Windows node
- NFS subdir external provisioner pod fails on Windows nodes
- Multi-Node update Fails to recreate Windows nodes
Arc Connection
- Connecting a cluster that has Windows nodes to Arc may fail due to "logcollector*" pod getting stuck in Imageloopbackoff state.