[ISSUE] Configuration drift in `databricks_cluster` when `is_single_node` is set to `true`

[alexott]

The is_single_node represents a simpler way of configuring single node clusters, but it automatically adds necessary spark_conf and custom_tags values, leading to the configuration drift, like this:

  # databricks_cluster.single_node_new_1228_101700_uxdk2a63 will be updated in-place
  ~ resource "databricks_cluster" "single_node_new_1228_101700_uxdk2a63" {
      ~ custom_tags                  = {
          - "ResourceClass" = "SingleNode" -> null
        }
        id                           = "1228-102112-aco3jrk3"
      ~ spark_conf                   = {
          - "spark.databricks.cluster.profile" = "singleNode" -> null
          - "spark.master"                     = "local[*, 4]" -> null
        }
        # (19 unchanged attributes hidden)

        # (1 unchanged block hidden)
    }

for the following configuration:

resource "databricks_cluster" "single_node_new_1228_101700_uxdk2a63" {
  spark_version      = "15.4.x-scala2.12"
  single_user_name   = "user@domain.com"
  runtime_engine     = "STANDARD"
  node_type_id       = "Standard_D4ds_v5"
  kind               = "CLASSIC_PREVIEW"
  is_single_node     = true
  data_security_mode = "SINGLE_USER"
  cluster_name       = "Single Node new (TF)"
  autotermination_minutes = 10
}

[nkvuong]

@alexott I just tested locally, and the drift does not seem to be there anymore

resource "databricks_cluster" "demo" {
  cluster_name            = "vn-demo"
  spark_version           = data.databricks_spark_version.simple.id
  node_type_id            = data.databricks_node_type.simple.id
  autotermination_minutes = 120
  use_ml_runtime          = false
  is_single_node          = true
  kind                    = "CLASSIC_PREVIEW"
  data_security_mode      = "USER_ISOLATION"
}

and the plan is clean

[alexott]

Hmmm, I still see it:

  # databricks_cluster.single_node_new_1228_101700_uxdk2a63 will be updated in-place
  ~ resource "databricks_cluster" "single_node_new_1228_101700_uxdk2a63" {
      ~ custom_tags                    = {
          - "ResourceClass" = "SingleNode" -> null
        }
        id                             = "0627-131240-feq0dsya"
      ~ spark_conf                     = {
          - "spark.databricks.cluster.profile" = "singleNode" -> null
          - "spark.master"                     = "local[*, 4]" -> null
        }
        # (21 unchanged attributes hidden)

        # (1 unchanged block hidden)
    }