Skip to content

Instantly share code, notes, and snippets.

@dhawal55
Created June 21, 2019 07:26
Show Gist options
  • Save dhawal55/8d8b6e4248cab6eb88e54e582cf09af5 to your computer and use it in GitHub Desktop.
Save dhawal55/8d8b6e4248cab6eb88e54e582cf09af5 to your computer and use it in GitHub Desktop.
Output of gke cluster destory
INFO: Running command line: bazel-bin/terraform destroy -force -var 'cluster_id=gke-6591' -var 'cluster_enabled=1' -var 'min_master_version=1.13' -var 'project=xyz' -var 'region=us-west1' -var 'general_pool_max_node_count=10' -var 'gke_cluster_update_timeout=20m' -force
INFO: Build completed successfully, 1 total action
random_pet.cluster: Refreshing state... (ID: trusting-quail)
data.external.lookup: Refreshing state...
google_service_account.node_service_account: Refreshing state... (ID: projects/xyz...bdbbzxkr3krxw3.iam.gserviceaccount.com)
google_dns_managed_zone.cluster-zone: Refreshing state... (ID: gke-6591-zone)
google_container_cluster.primary: Refreshing state... (ID: gke-6591)
google_dns_record_set.cluster-ns: Refreshing state... (ID: dev-gcp-platform-vip-nordstrom-com/gke-...dev.gcp.platform.vip.nordstrom.com./NS)
google_container_node_pool.pool: Refreshing state... (ID: us-west1/gke-6591/general-green)
google_project_iam_member.node_service_account_monitoring_viewer_policy: Refreshing state... (ID: xyz/roles/mo...bdbbzxkr3krxw3.iam.gserviceaccount.com)
google_project_iam_member.node_service_account_monitoring_metric_writer_policy: Refreshing state... (ID: xyz/roles/mo...bdbbzxkr3krxw3.iam.gserviceaccount.com)
google_project_iam_member.node_service_account_monitoring_log_writer_policy: Refreshing state... (ID: xyz/roles/lo...bdbbzxkr3krxw3.iam.gserviceaccount.com)
null_resource.taints: Refreshing state... (ID: 5342037279320555132)
null_resource.update-proxy-firewall: Refreshing state... (ID: 3812485439234133455)
module.cluster.google_dns_record_set.cluster-ns: Destroying... (ID: dev-gcp-platform-vip-nordstrom-com/gke-...dev.gcp.platform.vip.nordstrom.com./NS)
module.cluster.null_resource.update-proxy-firewall: Destroying... (ID: 3812485439234133455)
module.cluster.module.general-green.null_resource.taints: Destroying... (ID: 5342037279320555132)
module.cluster.module.general-green.null_resource.taints: Destruction complete after 0s
module.cluster.null_resource.update-proxy-firewall: Destruction complete after 0s
module.cluster.google_project_iam_member.node_service_account_monitoring_viewer_policy: Destroying... (ID: xyz/roles/mo...bdbbzxkr3krxw3.iam.gserviceaccount.com)
module.cluster.module.general-green.google_container_node_pool.pool: Destroying... (ID: us-west1/gke-6591/general-green)
module.cluster.google_project_iam_member.node_service_account_monitoring_log_writer_policy: Destroying... (ID: xyz/roles/lo...bdbbzxkr3krxw3.iam.gserviceaccount.com)
module.cluster.google_container_cluster.primary: Destroying... (ID: gke-6591)
module.cluster.google_project_iam_member.node_service_account_monitoring_metric_writer_policy: Destroying... (ID: xyz/roles/mo...bdbbzxkr3krxw3.iam.gserviceaccount.com)
module.cluster.google_dns_record_set.cluster-ns: Destruction complete after 3s
module.cluster.google_dns_managed_zone.cluster-zone: Destroying... (ID: gke-6591-zone)
module.cluster.google_dns_managed_zone.cluster-zone: Destruction complete after 0s
module.cluster.google_project_iam_member.node_service_account_monitoring_viewer_policy: Destruction complete after 5s
module.cluster.google_project_iam_member.node_service_account_monitoring_log_writer_policy: Still destroying... (ID: xyz/roles/lo...bdbbzxkr3krxw3.iam.gserviceaccount.com, 10s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 10s elapsed)
module.cluster.google_project_iam_member.node_service_account_monitoring_metric_writer_policy: Still destroying... (ID: xyz/roles/mo...bdbbzxkr3krxw3.iam.gserviceaccount.com, 10s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 10s elapsed)
module.cluster.google_project_iam_member.node_service_account_monitoring_log_writer_policy: Destruction complete after 15s
module.cluster.google_project_iam_member.node_service_account_monitoring_metric_writer_policy: Destruction complete after 15s
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 20s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 20s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 30s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 30s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 40s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 40s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 50s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 50s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 1m0s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 1m0s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 1m10s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 1m10s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 1m20s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 1m20s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 1m30s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 1m30s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 1m40s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 1m40s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 1m50s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 1m50s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 2m0s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 2m0s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 2m10s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 2m10s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 2m20s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 2m20s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 2m30s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 2m30s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 2m40s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 2m40s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 2m50s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 2m50s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 3m0s elapsed)
module.cluster.google_container_cluster.primary: Still destroying... (ID: gke-6591, 3m0s elapsed)
module.cluster.google_container_cluster.primary: Destruction complete after 3m5s
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 3m10s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 3m20s elapsed)
module.cluster.general-green.google_container_node_pool.pool: Still destroying... (ID: us-west1/gke-6591/general-green, 3m30s elapsed)
Error: Error applying plan:
1 error(s) occurred:
* module.cluster.module.general-green.google_container_node_pool.pool (destroy): 1 error(s) occurred:
* google_container_node_pool.pool: Error deleting NodePool: googleapi: Error 404: Not found: projects/xyz/locations/us-west1/clusters/gke-6591., notFound
Terraform does not automatically rollback in the face of errors.
Instead, your Terraform state file has been partially updated with
any resources that successfully completed. Please address the error
above and apply again to incrementally change your infrastructure.
@dhawal55
Copy link
Author

Looks like the primary cluster got deleted before the node_pool deletion completed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment