All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
0.8.11 - 2022-03-21
- Krew repo index auto update issue fixed.
- Added support for removing Archived PVs.
- Fixed Prometheus metrics exporter path.
- Fixed metrics hang issue, when one or more Pods are offline/unreachable.
0.8.10 - 2022-02-03
- Krew repo auto update issue fixed.
- Install helper script added. Run single command to install the kubectl kadalu extension.
- Fixed External Volume mount issues.
- Updated the troubleshooting guide.
- Test infra improvements to reduce the test time.
0.8.9 - 2021-12-30
- Kadalu Kubectl extension is submitted to Krew! https://krew.sigs.k8s.io/plugins/
- Added documentation to use Kadalu with Krew
- Added support for Kubectl context via
--kubectl-context
option - Added Upgrade documentation https://github.com/kadalu/kadalu/blob/devel/doc/upgrade.adoc
- Fixed metrics exporter issues
- Added alternative syntax for Storage add. Storage add syntax to help GlusterFS users.
- Fix Gluster mount options issues of external Volumes.
- Added framework to support Storage options(Gluster Volume options) via Storage classes.
- Fixed Mount reload notification on
kadalu-info
configMap update. - Added a Validation to check existing Volume in
csi:ControllerExpandVolume
0.8.8 - 2021-11-12
- Fixed issues with
kubectl kadalu healinfo
sub-command. - Add additional information about the heal pending and other details to healinfo command.
- Fixed Kubernetes APIs comparison issue when minor version contains alpha numeric values.
- Fixed issue while handling memory and CPU metrics when not available in some setup(LXD/LXC).
- Updated documentation about External Volume cleanup before adding it to Kadalu.
- Added support for CSI Block volume.
0.8.7 - 2021-10-29
- Troubleshooting guide updated for GlusterFS directory quota(External).
- Documentation update to use Kadalu Storage(External) with Nomad.
- Documentation update with upgrade steps.
- Metrics APIs are redesigned. All the metrics related to Kadalu Pods are now accessible from Operator Pod.
- Fixed an issue related to reachable host check(External).
- Fixed an crash related to Connection error in Operator.
- Fixed excessive logging of SETFATTR errors.
- Added support for Kubernetes v1.22.
- Fixed EPERM issues in CSI Provisioner.
- Added support to print versions from all Pods of Kadalu namespace(
kubectl kadalu version
). - Added support for Setting Gluster options while adding External Storage pool.
- Documentation update for
xfsprogs
requirements.
0.8.6 - 2021-09-09
- Mounted Block Volume support - Create a Storage Class with
pv_type: Block
and all the PVs from this Storage Class will be created as Block Volumes. Refer documentation for the examples. - Fixed an issue related to setting Gluster Quota when external Volume is used.
- Fixed the Python packaging related issues with Arm build.
0.8.5 - 2021-08-23
- Added support for PV expansion provisioned from external Volumes.
- New Prometheus metrics added.
kadalu_storage_pv_capacity_bytes
,kadalu_storage_pv_capacity_used_bytes
andkadalu_storage_pv_capacity_free_bytes
- Prometheus annotations added to automatically configure scraping.
- Fixed issue with Python dependencies in Arm builds.
- To avoid applications loosing access to the storage after upgrade, CSI node plugins are not upgraded as part of Operator and server pods upgrade.
- Fixed issues while setting external Quota when multiple hosts provided.
0.8.4 - 2021-07-27
- Fixed accounting issues related to Quota feature.
- Fixed issues while mounting the devices after creating fs
- Removed default storage classes created for each Volume types.
- Added one storage class for each Kadalu Storage.
- Operator: Added retry for Protocol error while watching the CRD.
- Fixed issue while deleting a Kadalu Storage when no Pvs present.
0.8.3 - 2021-06-21
- Improvements to the External GlusterFS Volumes support.
- Added support for Disperse Storage Type.
- Added support for archiving the PVCs on delete.
- kubectl-kadalu CLI enhanced to handle kadalu format.
- kubectl-kadalu CLI enhanced to handle PVCs archive.
- Fixed Armv7 kubectl binary issue.
- Added support for Volume ID in Storage config to enable reusing/migrating the Storage backend.
- Fixed issue with listing Storages and deleting external volumes
- Added support for decommisioning Storage units.
- Added support for Distributed Volumes for external. Volumes by enhancing quota integration over ssh.
- Enabled migration support from Replica1 to Replica2/3.
0.8.2 - 2021-05-02
- Enhanced provisioner to check free space before provisioning from External Storage.
- I/O tests added as part of CI.
- CSI Sanity tests added as part of CI.
- CSI "ValidateVolumeCapability" API is implemented.
- CSI "ListVolumes" API is implemented.
- Fixed an issue while creating a PV with same name but different size.
- Documentation format is changed to Asciidoc.
0.8.1 - 2021-03-12
- volfile: add 'read-fail-log' option to brick volfile.
- Fix issues related to container name changes in 0.8.0 release.
- Fix sqlite3 dependency issues in server container image.
- Mount all available volume before starting the CSI provisioner.
- Quotad is removed from the server image with the introduction of Simple Quota in 0.8.0 release.
- Enabled a few self-heal related options by default.
0.8.0 - 2021-03-02
- Introduced service monitor utility to manage multiple processes within the container.
- Prometheus exporter added to CSI driver.
- Documentation added for where to look for logs.
- New sub-command to
kubectl-kadalu
to fetch logs from all containers of Kadalu namespace. - Use kadalu-storage (glusterfs fork of kadalu, which adds features like simple-quota etc).
- Changes in templates to accomodate distribute volumes
- Remove usage of -oprjquota on mount
- Use simple quota limit feature to set the quota
- Simplify the brick volfile generation, and make it uniform across
- Provide 'client-pid' to clients mounted in csi controller (for simple-quota)
- Fix the template files
- Include quota-crawler with provisioner
- Added support for self heal info into CLI - can be checked with
kubectl kadalu healinfo
- Container images size optimizations.
- Fix the traceback when no hosting volumes are available.
- Helm charts are now part of tests and Release.
- cli: storage_list fix the issue due to container changes in server pod
0.7.7 - 2021-02-04
- Fixed an issue while doing
mkfs
while starting server pods. - Fixed the crash when storage class name not specified with external Gluster volume.
- Fixed the device name parsing issues when device is specified using ID.
- GlusterFS version upgraded to
v8
.
0.7.6 - 2021-01-18
- Support added for Pods upgrade
- PV Resize support added.
- Kadalu Operator CRD version upgraded to
v1
- Backup volfile servers option added for External Gluster volume configuration.
- Default log level is changed to
INFO
- Arm64 and Armv7 support added to release scripts.
0.7.5 - 2020-12-23
- Fixed a few issues related automated build scripts.
0.7.4 - 2020-12-23
- Helm chart support added.
- Breaking change related to mount dir introduced in k8s, Fixed by creating mount directory before doing bind mount.
- Fixed crash while running
storage-list
sub-command. - Base image changed to Ubuntu(20.04)
0.7.3 - 2020-12-18
- Base image upgraded to Fedora 33
- Implemented Storage remove functionality via
kubectl-kadalu
- Fix kubelet path related issues in RKE deployment.
- Fixed issue while marking failure when external Gluster volume is not reachable.
0.7.2 - 2020-11-23
- Updated
kubectl-kadalu
usage instructions. - Removed Google analytics tracking.
- Added
--kubectl-cmd
argument tokubectl-kadalu
to support variants likek3s kubectl
. - Fixed mount issues in GKE.
- Documentation updated to install kadalu Operator without
using
kubectl-kadalu
(using yaml). - Fixed xfs project id assignment overflow with Gluster's 64bit inode numbers.
- Operator enhanced to check the external Gluster volume is reachable.
- Fixed an issue while handling JSON in Quotad.
- Replace Storage(Replace brick in GlusterFS) support added.
- Enhanced Quotad to fetch local brick paths of a Volume automatically.
- Included
kubectl-kadalu
in Operator container image. So that this command will be available viakubectl exec
. - Fixed a crash when hostvol_type is not specified while defining new Storage class.
0.7.1 - 2020-09-22
- Fixed issue while doing cleanup of backend directory after PV delete.
- Documentation updated for CentOS 7.x series.
- Intelligence added to download architecture specific
kubectl
- PV Size accounting rewrite to fix false accounting.
- Microk8s support added.
- Fixed Storage Class override issue on Operator restart.
- Rancher (RKE) support added.
- Version sub-command added to
kubectl-kadalu
- Single file deployment support added to
kubectl-kadalu
- Storage add prompt, Script mode and Dry run options
added to
kubectl-kadalu
storage-list
sub-command added tokubectl-kadalu
- CSI proto files and sidecar containers updated to v1.2.0
- Improvements to Arm support and build scripts.
- Latest k8s integrated with CI.
0.7.0 - 2020-05-11
- New documentation added for Storage Classes
- Kadalu can be used as Local storage with the introduction of new
Storage Class filter
node_affinity
. - Experimental Arm support added with separate tag
master.
- Python 2 support for Kadalu Kubectl extension
- Added support for Kubernetes 1.18
- Kadalu Server and CSI container images are upgraded to the latest stable release of Gluster(7.4).
- Fixed an issue of Server pods not starting due to long
names. Removed hostname identifier from the Server pod names so that
the Server pod name length will be well within limits. Use
kubectl get pods -n kadalu -o wide
to see the hostnames.
0.6.0 - 2020-03-01
- Replica 2 support added using the Thin arbiter feature of GlusterFS
- Fixed issue showing the wrong status of server Pod as "Running" instead of the actual error.
- Fixed Gluster remount failure, when connectivity with storage pods
goes down, and
df
command doesn't show the Gluster mount. - CSI provisioner is enhanced to choose available storages randomly to avoid retrying with the same storage pool if that is down. This method also helps to utilize all the available storage pool for PVs.
- Fixed permissions issue when app pods try to use mounted PVs with a non-root user.
- Kadalu base container image upgraded to Fedora 31 and Gluster version in server and CSI container images to 7.3.
- Fixed issue in kubectl kadalu plugin while parsing arguments related to external storage and Tiebreaker node.
0.5.0 - 2020-01-30
- Documentation updated for the new features introduced in 0.4.0(Kubectl plugin, External storage, and Storage configurations)
- Cleanup script enhanced to handle CSIDriver object, which was introduced in the latest version of Kubernetes.
- Troubleshooting documentation is added.
- Introduced Thread lock while updating the info file and while mounting the Storage pool to avoid race conditions when PV claim and pod create done in parallel.
- All Pylint tests are now passing.
- Upgraded Kadalu Server container images to Gluster latest release(7.x)
- Fixed Python compatibility issue in Kadalu Kubectl plugin.
- Introduced "install" subcommand in kubectl-kadalu
- Added support for external gluster storage in kubectl-kadalu
0.4.0 - 2019-12-31
- Enhancement to support Kadalu storage on top of existing PVC
- Support for using external Gluster Volumes with K8s using Kadalu
- Kadalu kubectl plugin(
pip3 install kubectl-kadalu
) is introduced. This plugin helps to define Kadalu storage without the hassle of YAML files. - Fixed hang issue while terminating the server pods.
- Added sidecar container to capture logs from the mount processes in CSI pods.
kadalu-quotad
is now available as pypi package to use with external Gluster Volumes.- Deploy attacher as a container in provisioner statefulset instead of deploying it as a pod
- Added tests to cover different Volume types(Replica1 and Replica3). Each PV claim size in tests made different so that it can be easily debugged.
0.3.0 - 2019-11-26
- Improved documentation. (Thanks to @papanito)
- Enhanced to handle invalid Pod names when k8s node name is used as part of pod name.
- Added more test cases to cover Replica 3 Volume use cases.
- Fixed a crash during Gluster volume mount in CSI pods.
- Operator is enhanced to start self heal daemon when Replica 3 volume is created.
0.2.0 - 2019-10-25
- Improvements to Volfile templates by removing distribute graph in case of no distribute Volume.
- Added Security Context Constraints to support Openshift deployment.
- Improved Tracking to understand the workload better.
- New
make
command for release management.
0.1.0 - 2019-07-30
- Kadalu Operator to install and manage CSI and Server pods.
- CSI driver supports provisioning ReadWriteOnce and ReadWriteMany volumes.
- Added xfs Quota support.
- Fedora 30 and Gluster 6.3 based container images.
- CSI drivers enhanced to generate client Volfiles using ConfigMap info.
- Server processes enhanced to generate brick Volfiles using ConfigMap info.
- Sample app to use ReadWriteMany or ReadWriteOnce PVs.
- Kadalu Operator is enhanced to accept raw device and format as required.
- Added Asciinema based demo link.
- Logging and Analytics support added.
- End-to-end testing using Minikube and Travis-ci.