Cleanup k8s DaskCluster resources by introducing a ttlSecondsAfterFinished
field respected by the controller?
#760
Labels
ttlSecondsAfterFinished
field respected by the controller?
#760
When a k8s
DaskCluster
resource enters a "Stopped" state, for example by beingidle_culled
by the k8s DaskGateway controller, the k8s DaskCluster resource is still retained.Should a stopped DaskCluster resources get cleaned up directly, or after some time?
This is similar to having k8s Job resource creating a Pod to do some work. Then the Pod and Job is left in a "Completed" state a while. There is a topic about that.
CronJob, that is a k8s resource to create Job resources, can cleanup the Job resources and it creates.
It appears that in k8s 1.23+ (now probably used by most k8s clusters), there is a controller reading the k8s Job resource's
ttlSecondsAfterFinished
. I think it can make sense for the k8s dask-gateway resource controller to respect such configuration as well for the DaskCluster resources.The text was updated successfully, but these errors were encountered: