GCP VPC is not deleted frequently

[seokho-son]

What happened

GCP VPC is not deleted frequently.

According to the log, CB-Spider returns DELETE OK even though the resource is not deleted actually.
CB-TB cannot handle this situation. requires bug fix from CB-Spider.

cb-tumblebug | 8:56AM DBG src/core/resource/common.go:536 > Sending DELETE request to http://cb-spider:1024/spider/vpc/d2s030uobbcut0cr9k60
cb-tumblebug | 8:56AM DBG src/core/common/client/client.go:198 > Internal Call Start Method=DELETE URI=http://cb-spider:1024/spider/vpc/d2s030uobbcut0cr9k60 requestBody={"ConnectionName":"gcp-asia-northeast3"}
cb-tumblebug | 8:56AM DBG src/core/common/client/client.go:427 > Internal Call OK Method=DELETE URI=http://cb-spider:1024/spider/vpc/d2rvrbuobbcut0cr9jsg latency=2634.987436 responseBody={"Result":"true"} status=200
cb-tumblebug | 8:56AM DBG src/core/resource/common.go:553 > Deleting request finished from http://cb-spider:1024/spider/vpc/d2rvrbuobbcut0cr9jsg
cb-tumblebug | 8:56AM INF src/core/common/label/label.go:235 > Label object successfully deleted from kvstore labelKey=/label/vNet/d2rvrbuobbcut0cr9jt0
cb-tumblebug | 8:56AM INF src/core/common/label/label.go:235 > Label object successfully deleted from kvstore labelKey=/label/vNet/d2rvrbuobbcut0cr9jtg
cb-tumblebug | 8:56AM INF src/core/common/label/label.go:235 > Label object successfully deleted from kvstore labelKey=/label/vNet/d2rvrbuobbcut0cr9jsg
cb-tumblebug | 8:56AM DBG src/core/resource/common.go:293 > Resource deletion completed connectionName=default elapsed=3494.789675 resourceId=default-shared-aws-ap-northeast-2 status="[Done] "
cb-tumblebug | 8:56AM DBG src/core/common/client/client.go:427 > Internal Call OK Method=DELETE URI=http://cb-spider:1024/spider/vpc/d2s030uobbcut0cr9k60 latency=16537.022017 responseBody={"Result":"true"} status=200
cb-tumblebug | 8:56AM DBG src/core/resource/common.go:553 > Deleting request finished from http://cb-spider:1024/spider/vpc/d2s030uobbcut0cr9k60
cb-tumblebug | 8:56AM INF src/core/common/label/label.go:235 > Label object successfully deleted from kvstore labelKey=/label/vNet/d2s030uobbcut0cr9k6g
cb-tumblebug | 8:56AM INF src/core/common/label/label.go:235 > Label object successfully deleted from kvstore labelKey=/label/vNet/d2s030uobbcut0cr9k70
cb-tumblebug | 8:56AM INF src/core/common/label/label.go:235 > Label object successfully deleted from kvstore labelKey=/label/vNet/d2s030uobbcut0cr9k60
cb-tumblebug | 8:56AM DBG src/core/resource/common.go:293 > Resource deletion completed connectionName=default elapsed=17424.711007 resourceId=default-shared-gcp-asia-northeast3 status="[Done] "
cb-tumblebug | 8:56AM INF src/core/resource/common.go:302 > All 2 resource deletion tasks completed
cb-tumblebug | 8:56AM INF src/core/resource/common.go:316 > DelAllResources completed. Total results: 2
cb-tumblebug | 8:56AM DBG src/core/resource/common.go:318 > Result 0: [Done] vNet: default-shared-aws-ap-northeast-2
cb-tumblebug | 8:56AM DBG src/core/resource/common.go:318 > Result 1: [Done] vNet: default-shared-gcp-asia-northeast3

[seokho-son]

cc @powerkimhub @yunkon-kim @hanizang77

현재는 GCP 테스트시, VPC Network 리소스가 삭제되지 않고 쌓일 가능성이 높으며,

리소스 쿼터(100개)가 넘으면, 프로비저닝이 불가하니,
미리 오펀트 리소스를 삭제하고 프로비저닝 테스트를 진행해주세요.

그동안 CB-Spider에서 해당 이슈에 대한 버그 픽스가 진행될 예정이니 참고하시기 바랍니다.

[seokho-son]

• possibly related with vNet is not deleted properly cm-beetle#168

[seokho-son]

@powerkimhub 혹시 관련된 CB-Spider 쪽 Issue가 오픈되어 있는 상태인지요?

[powerkimhub]

• 현 Issue는 vNet is not deleted properly cm-beetle#168 함께 인지하고 있으며,
• Issue는 별도 Open 되지 않았으며,
• 관련하여 조만간 issue Open/재현/분석 예정입니다.

[seokho-son]

확인 감사합니다.

[seokho-son]

@powerkimhub

CB-TB 와 별개로,

CB-SP 상에서도 GCP의 VPC 삭제, Subnet 삭제 등이 정상 동작하지 않는 것으로 보입니다. (CB-SP 최신 프리릴리스, AdminWeb 으로 테스트해보았습니다.)

하기는 AdminWeb에서 Subnet 부분을 del 클릭해서 RemoveSubnet 을 시도했을때 발생하는 오류이며,
VPC 삭제 요청에 대해서는 error 리턴을 해주지 않고, CB-SP 내부 id 등을 DB에서만 삭제해버리는 것 같습니다. CSP 콘솔 상에서는 삭제되지 않았습니다.

기본 프로비저닝 관련 사항이라, 가급적 빠른 패치가 필요해보입니다. (아마 쿼터를 별도로 올리지 않으면, 일반 사용자의 경우 VM 프로비저닝 테스트 자체가 금방 막힐 것으로 판단됩니다.)

cb-spider | [CB-SPIDER].[ERROR]: 2025-09-22 14:08:15 VPCHandler.go:707, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/gcp/resources.(*GCPVPCHandler).RemoveSubnet() - googleapi: Error 404: The resource 'projects/seokho-etri/regions/asia-northeast3/subnetworks/d1h8a1187nlngtm9hvhg' was not found, notFound
cb-spider | [CB-SPIDER].[ERROR]: 2025-09-22 14:08:15 VPC-SubnetManager.go:1357, github.com/cloud-barista/cb-spider/api-runtime/common-runtime.RemoveSubnet() - googleapi: Error 404: The resource 'projects/seokho-etri/regions/asia-northeast3/subnetworks/d1h8a1187nlngtm9hvhg' was not found, notFound
cb-spider | [CB-SPIDER].[ERROR]: 2025-09-22 14:08:20 VPCHandler.go:707, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/gcp/resources.(*GCPVPCHandler).RemoveSubnet() - googleapi: Error 404: The resource 'projects/seokho-etri/regions/asia-northeast3/subnetworks/d1h8a1187nlngtm9hvh0' was not found, notFound
cb-spider | [CB-SPIDER].[ERROR]: 2025-09-22 14:08:20 VPC-SubnetManager.go:1357, github.com/cloud-barista/cb-spider/api-runtime/common-runtime.RemoveSubnet() - googleapi: Error 404: The resource 'projects/seokho-etri/regions/asia-northeast3/subnetworks/d1h8a1187nlngtm9hvh0' was not found, notFound
cb-spider | [CB-SPIDER].[ERROR]: 2025-09-22 14:08:23 VPCHandler.go:707, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/gcp/resources.(*GCPVPCHandler).RemoveSubnet() - googleapi: Error 404: The resource 'projects/seokho-etri/regions/asia-northeast3/subnetworks/d1hbt4187nlngtm9i0pg' was not found, notFound
cb-spider | [CB-SPIDER].[ERROR]: 2025-09-22 14:08:23 VPC-SubnetManager.go:1357, github.com/cloud-barista/cb-spider/api-runtime/common-runtime.RemoveSubnet() - googleapi: Error 404: The resource 'projects/seokho-etri/regions/asia-northeast3/subnetworks/d1hbt4187nlngtm9i0pg' was not found, notFound
cb-spider | [CB-SPIDER].[ERROR]: 2025-09-22 14:08:37 VPCHandler.go:707, github.com/cloud-barista/cb-spider/cloud-control-manager/cloud-driver/drivers/gcp/resources.(*GCPVPCHandler).RemoveSubnet() - googleapi: Error 404: The resource 'projects/seokho-etri/regions/asia-northeast3/subnetworks/d1hcdhh87nlngtjen4qg' was not found, notFound
cb-spider | [CB-SPIDER].[ERROR]: 2025-09-22 14:08:37 VPC-SubnetManager.go:1357, github.com/cloud-barista/cb-spider/api-runtime/common-runtime.RemoveSubnet() - googleapi: Error 404: The resource 'projects/seokho-etri/regions/asia-northeast3/subnetworks/d1hcdhh87nlngtjen4qg' was not found, notFound

[powerkimhub]

• 리포트 감사합니다.
• GCP VPC 및 Subnet의 경우 3/14일 이후부터 실제 GCP에서는 삭제가 되고 있지 않았네요.
• Resolved in [GCP] Fix VPC/Subnet deletion failure and improve AddSubnet error handling cb-spider#1581