Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GCP Experiment Pipeline #311

Merged
merged 8 commits into from
Sep 25, 2021
Merged

GCP Experiment Pipeline #311

merged 8 commits into from
Sep 25, 2021

Conversation

neelanjan00
Copy link
Member

@neelanjan00 neelanjan00 commented Sep 23, 2021

Signed-off-by: neelanjan00 [email protected]

Why Do We Need This PR

This PR adds the GCP Experiment Pipeline for the E2E testing of the following GCP experiments:

1. GCP VM Instance Stop

  • BDD added for gcp-vm-instance-stop in parallel mode
  • BDD added for gcp-vm-instance-stop in serial mode

2. GCP VM Disk Loss

  • BDD added for gcp-vm-disk-loss in parallel mode
  • BDD added for gcp-vm-disk-loss in serial mode

Which Issue Does it Fix

Fixed #308

…k-loss experiments in serial and parallel mode execution

Signed-off-by: neelanjan00 <[email protected]>
.master-plan.yml Outdated Show resolved Hide resolved
neelanjan00 added 2 commits September 24, 2021 10:00
@uditgaurav
Copy link
Member

Great @neelanjan00! Do you also have any tested runs that you can share?

@neelanjan00
Copy link
Member Author

No, I am afraid I haven't been able to check it locally so far. @uditgaurav

Signed-off-by: neelanjan00 <[email protected]>
@neelanjan00
Copy link
Member Author

GCP VM Instance Stop experiment test logs for parallel and serial execution:

------------------------------------------
Running gcp-vm-instance-stop experiment
------------------------------------------
=== RUN   TestGoGCPVMInstanceStop
Running Suite: BDD test
=======================
Random Seed: 1632584604
Will run 2 of 2 specs

I0925 15:43:24.089613   10053 gcp-vm-instance-stop_test.go:39] [PreReq]: Getting the ENVs for the  test
time="2021-09-25T15:43:24Z" level=info msg="[Info]: The target VM instances are: ***-first-vm-16,***-second-vm-16"
time="2021-09-25T15:43:24Z" level=info msg="[Status]: Operator is in Running state"
time="2021-09-25T15:43:24Z" level=info msg="[Install]: Installing RBAC"
time="2021-09-25T15:43:24Z" level=info msg="[RBAC]: Installing RBAC..."
I0925 15:43:24.585984   10053 common.go:37] serviceaccount/gcp-vm-instance-stop-sa created
clusterrole.rbac.authorization.k8s.io/gcp-vm-instance-stop-sa created
clusterrolebinding.rbac.authorization.k8s.io/gcp-vm-instance-stop-sa created
time="2021-09-25T15:43:24Z" level=info msg="[RBAC]: Rbac installed successfully !!!"
time="2021-09-25T15:43:24Z" level=info msg="[Install]: Installing chaos experiment"
time="2021-09-25T15:43:24Z" level=info msg="[LIB Image]: Lib image is  !!!"
time="2021-09-25T15:43:24Z" level=info msg="[Experiment]: Installing Experiment..."
time="2021-09-25T15:43:24Z" level=info msg="[ChaosExperiment]: Experiment installed successfully !!!"
time="2021-09-25T15:43:24Z" level=info msg="[Experiment Image]: Chaos Experiment created successfully with image: litmuschaos/go-runner:ci !!!"
time="2021-09-25T15:43:24Z" level=info msg="[Install]: Installing chaos engine"
time="2021-09-25T15:43:24Z" level=info msg="[Engine]: Installing ChaosEngine..."
time="2021-09-25T15:43:24Z" level=info msg="[Engine]: ChaosEngine Installed Successfully !!!"
time="2021-09-25T15:43:26Z" level=info msg="[Info]: Runner pod Name gcp-vm-engine-par-runner"
time="2021-09-25T15:43:29Z" level=info msg="The Runner pod is in Running State "
time="2021-09-25T15:43:29Z" level=info msg="[Status]: Runner pod is in Running state"
time="2021-09-25T15:43:34Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:43:39Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:43:44Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:43:49Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:43:49Z" level=info msg="[Status]: Chaos pod initiated successfully"
time="2021-09-25T15:43:59Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:44:09Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:44:19Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:44:29Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:44:39Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:44:49Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:44:59Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:45:09Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:45:19Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:45:19Z" level=info msg="[Info]: chaos pod name is: gcp-vm-instance-stop-3s5yuz-54f95 "

gcp-vm-instance-stop-3s5yuz-54f95 logs : 

 W0925 15:43:37.112541       1 client_config.go:541] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2021-09-25T15:43:37Z" level=info msg="Experiment Name: gcp-vm-instance-stop"
time="2021-09-25T15:43:37Z" level=info msg="[PreReq]: Procured the ENV for the gcp-vm-instance-stop experiment"
time="2021-09-25T15:43:37Z" level=info msg="[PreReq]: Updating the chaos result of gcp-vm-instance-stop experiment (SOT)"
time="2021-09-25T15:43:39Z" level=info msg="The instance information is as follows" Chaos Duration=30 Chaos Namespace=default Ramp Time=0 Instance Names="***-first-vm-16,***-second-vm-16" Zones="us-central1-a,us-central1-a"
time="2021-09-25T15:43:39Z" level=info msg="[Status]: Verify that the AUT (Application Under Test) is running (pre-chaos)"
time="2021-09-25T15:43:39Z" level=info msg="[Status]: No appLabels provided, skipping the application status checks"
time="2021-09-25T15:43:39Z" level=info msg="[Info]: The instances under chaos(IUC) are: [***-first-vm-16 ***-second-vm-16]"
time="2021-09-25T15:43:39Z" level=info msg="[Status]: VM instance is in running state"
time="2021-09-25T15:43:39Z" level=info msg="[Info]: Target instanceID list, [***-first-vm-16 ***-second-vm-16]"
time="2021-09-25T15:43:39Z" level=info msg="[Chaos]: Stopping the desired VM instance"
time="2021-09-25T15:43:40Z" level=info msg="Stopping VM instance:" InstanceName=***-first-vm-16 InstanceZone=us-central1-a
time="2021-09-25T15:43:40Z" level=info msg="[Chaos]: Stopping the desired VM instance"
time="2021-09-25T15:43:41Z" level=info msg="Stopping VM instance:" InstanceName=***-second-vm-16 InstanceZone=us-central1-a
time="2021-09-25T15:43:41Z" level=info msg="[Wait]: Wait for VM instance '***-first-vm-16' to get in stopped state"
time="2021-09-25T15:43:41Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:43:41Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:43:43Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:43:46Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:43:48Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:43:50Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:43:52Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:43:55Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:43:57Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:43:59Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:44:02Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:44:04Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:44:06Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:44:08Z" level=info msg="The instance state is TERMINATED"
time="2021-09-25T15:44:10Z" level=info msg="[Wait]: Wait for VM instance '***-second-vm-16' to get in stopped state"
time="2021-09-25T15:44:10Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:44:11Z" level=info msg="The instance state is TERMINATED"
time="2021-09-25T15:44:13Z" level=info msg="[Wait]: Waiting for chaos interval of 30s"
time="2021-09-25T15:44:43Z" level=info msg="[Chaos]: Starting back the VM instance"
time="2021-09-25T15:44:44Z" level=info msg="Starting VM instance:" InstanceName=***-first-vm-16 InstanceZone=us-central1-a
time="2021-09-25T15:44:44Z" level=info msg="[Chaos]: Starting back the VM instance"
time="2021-09-25T15:44:44Z" level=info msg="Starting VM instance:" InstanceName=***-second-vm-16 InstanceZone=us-central1-a
time="2021-09-25T15:44:44Z" level=info msg="[Wait]: Wait for VM instance '***-first-vm-16' to get in running state"
time="2021-09-25T15:44:44Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:44:45Z" level=info msg="The instance state is PROVISIONING"
time="2021-09-25T15:44:47Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:44:49Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:44:51Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:44:54Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:44:56Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:44:58Z" level=info msg="The instance state is RUNNING"
time="2021-09-25T15:45:00Z" level=info msg="[Wait]: Wait for VM instance '***-second-vm-16' to get in running state"
time="2021-09-25T15:45:00Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:45:00Z" level=info msg="The instance state is RUNNING"
time="2021-09-25T15:45:02Z" level=info msg="[Confirmation]: gcp-vm-instance-stop chaos has been injected successfully"
time="2021-09-25T15:45:02Z" level=info msg="[Info]: The instances under chaos(IUC) are: [***-first-vm-16 ***-second-vm-16]"
time="2021-09-25T15:45:02Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:45:03Z" level=info msg="The instance state is RUNNING"
time="2021-09-25T15:45:05Z" level=info msg="[Status]: VM instance is in running state (post chaos)"
time="2021-09-25T15:45:05Z" level=info msg="[Status]: Verify that the AUT (Application Under Test) is running (post-chaos)"
time="2021-09-25T15:45:05Z" level=info msg="[Status]: No appLabels provided, skipping the application status checks"
time="2021-09-25T15:45:05Z" level=info msg="[The End]: Updating the chaos result of gcp-vm-instance-stop experiment (EOT)"

I0925 15:45:19.898498   10053 status.go:264] ChaosResult status is Completed
time="2021-09-25T15:45:24Z" level=info msg="Chaos Result Verdict is: Pass"
time="2021-09-25T15:45:24Z" level=info msg="Engine status is completed"
time="2021-09-25T15:45:29Z" level=info msg="Chaos Engine Verdict is: Pass"
• [SLOW TEST:125.837 seconds]
BDD of gcp-vm-instance-stop experiment
/home/runner/work/***/***/platform/gcp/gcp-vm-instance-stop_test.go:21
  Check for gcp-vm-instance-stop experiment
  /home/runner/work/***/***/platform/gcp/gcp-vm-instance-stop_test.go:24
    Should check for the gcp vm instance stop in parallel
    /home/runner/work/***/***/platform/gcp/gcp-vm-instance-stop_test.go:25
------------------------------
I0925 15:45:29.919071   10053 gcp-vm-instance-stop_test.go:103] [PreReq]: Getting the ENVs for the  test
time="2021-09-25T15:45:29Z" level=info msg="[Info]: The target VM instances are: ***-first-vm-16,***-second-vm-16"
time="2021-09-25T15:45:29Z" level=info msg="[Status]: Operator is in Running state"
time="2021-09-25T15:45:29Z" level=info msg="[Install]: Installing RBAC"
time="2021-09-25T15:45:30Z" level=info msg="[RBAC]: Installing RBAC..."
I0925 15:45:30.226986   10053 common.go:37] serviceaccount/gcp-vm-instance-stop-sa unchanged
clusterrole.rbac.authorization.k8s.io/gcp-vm-instance-stop-sa unchanged
clusterrolebinding.rbac.authorization.k8s.io/gcp-vm-instance-stop-sa unchanged
time="2021-09-25T15:45:30Z" level=info msg="[RBAC]: Rbac installed successfully !!!"
time="2021-09-25T15:45:30Z" level=info msg="[Install]: Installing chaos experiment"
time="2021-09-25T15:45:30Z" level=info msg="[LIB Image]: Lib image is  !!!"
time="2021-09-25T15:45:30Z" level=info msg="[Experiment]: Installing Experiment..."
time="2021-09-25T15:45:30Z" level=info msg="[LIB Image]: Lib image is  !!!"
time="2021-09-25T15:45:30Z" level=info msg="[ChaosExperiment]: Experiment installed successfully !!!"
time="2021-09-25T15:45:30Z" level=info msg="[Experiment Image]: Chaos Experiment created successfully with image: litmuschaos/go-runner:ci !!!"
time="2021-09-25T15:45:30Z" level=info msg="[Install]: Installing chaos engine"
time="2021-09-25T15:45:30Z" level=info msg="[Engine]: Installing ChaosEngine..."
time="2021-09-25T15:45:30Z" level=info msg="[Engine]: ChaosEngine Installed Successfully !!!"
time="2021-09-25T15:45:32Z" level=info msg="[Info]: Runner pod Name gcp-vm-engine-ser-runner"
time="2021-09-25T15:45:34Z" level=info msg="[Status]: Runner pod is in Running state"
time="2021-09-25T15:45:39Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:45:44Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:45:44Z" level=info msg="[Status]: Chaos pod initiated successfully"
time="2021-09-25T15:45:54Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:46:04Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:46:14Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:46:24Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:46:34Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:46:44Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:46:54Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:47:04Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:47:14Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:47:24Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:47:34Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:47:44Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:47:54Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:48:04Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:48:04Z" level=info msg="[Info]: chaos pod name is: gcp-vm-instance-stop-97x50y-gpmvq "

gcp-vm-instance-stop-97x50y-gpmvq logs : 

 W0925 15:45:33.632063       1 client_config.go:541] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2021-09-25T15:45:33Z" level=info msg="Experiment Name: gcp-vm-instance-stop"
time="2021-09-25T15:45:33Z" level=info msg="[PreReq]: Procured the ENV for the gcp-vm-instance-stop experiment"
time="2021-09-25T15:45:33Z" level=info msg="[PreReq]: Updating the chaos result of gcp-vm-instance-stop experiment (SOT)"
time="2021-09-25T15:45:35Z" level=info msg="The instance information is as follows" Instance Names="***-first-vm-16,***-second-vm-16" Zones="us-central1-a,us-central1-a" Chaos Duration=30 Chaos Namespace=default Ramp Time=0
time="2021-09-25T15:45:35Z" level=info msg="[Status]: Verify that the AUT (Application Under Test) is running (pre-chaos)"
time="2021-09-25T15:45:35Z" level=info msg="[Status]: No appLabels provided, skipping the application status checks"
time="2021-09-25T15:45:35Z" level=info msg="[Info]: The instances under chaos(IUC) are: [***-first-vm-16 ***-second-vm-16]"
time="2021-09-25T15:45:36Z" level=info msg="[Status]: VM instance is in running state"
time="2021-09-25T15:45:36Z" level=info msg="[Info]: Target instanceNames list, [***-first-vm-16 ***-second-vm-16]"
time="2021-09-25T15:45:36Z" level=info msg="[Chaos]: Stopping the desired VM instance"
time="2021-09-25T15:45:37Z" level=info msg="Stopping VM instance:" InstanceName=***-first-vm-16 InstanceZone=us-central1-a
time="2021-09-25T15:45:37Z" level=info msg="[Wait]: Wait for VM instance '***-first-vm-16' to get in stopped state"
time="2021-09-25T15:45:37Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:45:37Z" level=info msg="The instance state is RUNNING"
time="2021-09-25T15:45:39Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:45:41Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:45:44Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:45:46Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:45:48Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:45:50Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:45:53Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:45:55Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:45:57Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:46:00Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:46:02Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:46:04Z" level=info msg="The instance state is TERMINATED"
time="2021-09-25T15:46:06Z" level=info msg="[Wait]: Waiting for chaos interval of 30s"
time="2021-09-25T15:46:36Z" level=info msg="[Chaos]: Starting back the VM instance"
time="2021-09-25T15:46:37Z" level=info msg="Starting VM instance:" InstanceZone=us-central1-a InstanceName=***-first-vm-16
time="2021-09-25T15:46:37Z" level=info msg="[Wait]: Wait for VM instance '***-first-vm-16' to get in running state"
time="2021-09-25T15:46:37Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:46:37Z" level=info msg="The instance state is TERMINATED"
time="2021-09-25T15:46:40Z" level=info msg="The instance state is PROVISIONING"
time="2021-09-25T15:46:42Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:46:44Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:46:47Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:46:49Z" level=info msg="The instance state is RUNNING"
time="2021-09-25T15:46:51Z" level=info msg="[Chaos]: Stopping the desired VM instance"
time="2021-09-25T15:46:52Z" level=info msg="Stopping VM instance:" InstanceName=***-second-vm-16 InstanceZone=us-central1-a
time="2021-09-25T15:46:52Z" level=info msg="[Wait]: Wait for VM instance '***-second-vm-16' to get in stopped state"
time="2021-09-25T15:46:52Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:46:52Z" level=info msg="The instance state is RUNNING"
time="2021-09-25T15:46:54Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:46:56Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:46:59Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:47:01Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:47:03Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:47:06Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:47:08Z" level=info msg="The instance state is STOPPING"
time="2021-09-25T15:47:10Z" level=info msg="The instance state is TERMINATED"
time="2021-09-25T15:47:12Z" level=info msg="[Wait]: Waiting for chaos interval of 30s"
time="2021-09-25T15:47:42Z" level=info msg="[Chaos]: Starting back the VM instance"
time="2021-09-25T15:47:43Z" level=info msg="Starting VM instance:" InstanceName=***-second-vm-16 InstanceZone=us-central1-a
time="2021-09-25T15:47:43Z" level=info msg="[Wait]: Wait for VM instance '***-second-vm-16' to get in running state"
time="2021-09-25T15:47:43Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:47:43Z" level=info msg="The instance state is TERMINATED"
time="2021-09-25T15:47:45Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:47:48Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:47:50Z" level=info msg="The instance state is STAGING"
time="2021-09-25T15:47:52Z" level=info msg="The instance state is RUNNING"
time="2021-09-25T15:47:54Z" level=info msg="[Confirmation]: gcp-vm-instance-stop chaos has been injected successfully"
time="2021-09-25T15:47:54Z" level=info msg="[Info]: The instances under chaos(IUC) are: [***-first-vm-16 ***-second-vm-16]"
time="2021-09-25T15:47:54Z" level=info msg="[Status]: Checking VM instance status"
time="2021-09-25T15:47:55Z" level=info msg="The instance state is RUNNING"
time="2021-09-25T15:47:57Z" level=info msg="[Status]: VM instance is in running state (post chaos)"
time="2021-09-25T15:47:57Z" level=info msg="[Status]: Verify that the AUT (Application Under Test) is running (post-chaos)"
time="2021-09-25T15:47:57Z" level=info msg="[Status]: No appLabels provided, skipping the application status checks"
time="2021-09-25T15:47:57Z" level=info msg="[The End]: Updating the chaos result of gcp-vm-instance-stop experiment (EOT)"

I0925 15:48:04.520099   10053 status.go:264] ChaosResult status is Completed
time="2021-09-25T15:48:09Z" level=info msg="Chaos Result Verdict is: Pass"
time="2021-09-25T15:48:09Z" level=info msg="Engine status is initialized"
time="2021-09-25T15:48:14Z" level=info msg="Engine status is initialized"
time="2021-09-25T15:48:19Z" level=info msg="Engine status is completed"
time="2021-09-25T15:48:24Z" level=info msg="Chaos Engine Verdict is: Pass"
• [SLOW TEST:174.619 seconds]
BDD of gcp-vm-instance-stop experiment
/home/runner/work/***/***/platform/gcp/gcp-vm-instance-stop_test.go:21
  Check for gcp-vm-instance-stop experiment
  /home/runner/work/***/***/platform/gcp/gcp-vm-instance-stop_test.go:87
    Should check for the gcp vm instance stop in serial
    /home/runner/work/***/***/platform/gcp/gcp-vm-instance-stop_test.go:89
------------------------------

Ran 2 of 2 Specs in 300.458 seconds
SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestGoGCPVMInstanceStop (300.46s)
PASS
ok  	command-line-arguments	300.488s

@neelanjan00
Copy link
Member Author

GCP VM Disk Loss experiment test logs for parallel and serial execution:

------------------------------------------
Running gcp-vm-disk-loss experiment
------------------------------------------
=== RUN   TestGoGCPVMDiskLoss
Running Suite: BDD test
=======================
Random Seed: 1632585070
Will run 2 of 2 specs

I0925 15:51:10.558551    9782 gcp-vm-disk-loss_test.go:41] [PreReq]: Getting the ENVs for the  test
time="2021-09-25T15:51:10Z" level=info msg="[Info]: The target disk volumes are: ***-first-disk-16,***-second-disk-16"
time="2021-09-25T15:51:10Z" level=info msg="[Status]: Operator is in Running state"
time="2021-09-25T15:51:10Z" level=info msg="[Install]: Installing RBAC"
time="2021-09-25T15:51:11Z" level=info msg="[RBAC]: Installing RBAC..."
I0925 15:51:11.779073    9782 common.go:37] serviceaccount/gcp-vm-disk-loss-sa created
clusterrole.rbac.authorization.k8s.io/gcp-vm-disk-loss-sa created
clusterrolebinding.rbac.authorization.k8s.io/gcp-vm-disk-loss-sa created
time="2021-09-25T15:51:11Z" level=info msg="[RBAC]: Rbac installed successfully !!!"
time="2021-09-25T15:51:11Z" level=info msg="[Install]: Installing chaos experiment"
time="2021-09-25T15:51:11Z" level=info msg="[LIB Image]: Lib image is  !!!"
time="2021-09-25T15:51:11Z" level=info msg="[Experiment]: Installing Experiment..."
time="2021-09-25T15:51:11Z" level=info msg="[ChaosExperiment]: Experiment installed successfully !!!"
time="2021-09-25T15:51:11Z" level=info msg="[Experiment Image]: Chaos Experiment created successfully with image: litmuschaos/go-runner:ci !!!"
time="2021-09-25T15:51:11Z" level=info msg="[Install]: Installing chaos engine"
time="2021-09-25T15:51:11Z" level=info msg="[Engine]: Installing ChaosEngine..."
time="2021-09-25T15:51:12Z" level=info msg="[Engine]: ChaosEngine Installed Successfully !!!"
time="2021-09-25T15:51:14Z" level=info msg="[Info]: Runner pod Name gcp-disk-engine-par-runner"
time="2021-09-25T15:51:17Z" level=info msg="The Runner pod is in Pending State "
time="2021-09-25T15:51:18Z" level=info msg="The Runner pod is in Running State "
time="2021-09-25T15:51:18Z" level=info msg="[Status]: Runner pod is in Running state"
time="2021-09-25T15:51:23Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:51:28Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:51:33Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:51:38Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:51:38Z" level=info msg="[Status]: Chaos pod initiated successfully"
time="2021-09-25T15:51:48Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:51:58Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:52:08Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:52:18Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:52:28Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:52:38Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:52:38Z" level=info msg="[Info]: chaos pod name is: gcp-vm-disk-loss-nbekhl-j5hjg "

gcp-vm-disk-loss-nbekhl-j5hjg logs : 

 W0925 15:51:27.025455       1 client_config.go:541] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2021-09-25T15:51:27Z" level=info msg="Experiment Name: gcp-vm-disk-loss"
time="2021-09-25T15:51:27Z" level=info msg="[PreReq]: Getting the ENV for the gcp-vm-disk-loss experiment"
time="2021-09-25T15:51:27Z" level=info msg="[PreReq]: Updating the chaos result of gcp-vm-disk-loss experiment (SOT)"
time="2021-09-25T15:51:29Z" level=info msg="The application information is as follows" AppLabel= Ramp Time=0 App Namespace=default
time="2021-09-25T15:51:29Z" level=info msg="The volume information is as follows" Zones="us-central1-a,us-central1-a" Volume IDs="***-first-disk-16,***-second-disk-16"
time="2021-09-25T15:51:29Z" level=info msg="[Status]: Verify that the AUT (Application Under Test) is running (pre-chaos)"
time="2021-09-25T15:51:29Z" level=info msg="[Status]: No appLabels provided, skipping the application status checks"
time="2021-09-25T15:51:30Z" level=info msg="The selected disk volume is:" Status=READY InstanceName=***-vm-16 VolumeName=***-first-disk-16 VolumeType=pd-standard
time="2021-09-25T15:51:30Z" level=info msg="The selected disk volume is:" VolumeType=pd-standard Status=READY InstanceName=***-vm-16 VolumeName=***-second-disk-16
time="2021-09-25T15:51:31Z" level=info msg="[Chaos]: Detaching the disk volume from the instance"
time="2021-09-25T15:51:32Z" level=info msg="Detaching disk having:" Status=RUNNING Device=***-first-disk-16 InstanceName=***-vm-16
time="2021-09-25T15:51:32Z" level=info msg="[Chaos]: Detaching the disk volume from the instance"
time="2021-09-25T15:51:33Z" level=info msg="Detaching disk having:" Status=PENDING Device=***-second-disk-16 InstanceName=***-vm-16
time="2021-09-25T15:51:33Z" level=info msg="[Wait]: Wait for disk volume detachment for volume ***-first-disk-16"
time="2021-09-25T15:51:33Z" level=info msg="[Status]: Checking disk volume status for detachment"
time="2021-09-25T15:51:33Z" level=info msg="The selected disk volume is:" VolumeType=pd-standard Status=READY InstanceName=***-vm-16 VolumeName=***-first-disk-16
time="2021-09-25T15:51:33Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:51:36Z" level=info msg="[Info]: The volume state is detached"
time="2021-09-25T15:51:38Z" level=info msg="[Wait]: Wait for disk volume detachment for volume ***-second-disk-16"
time="2021-09-25T15:51:38Z" level=info msg="[Status]: Checking disk volume status for detachment"
time="2021-09-25T15:51:38Z" level=info msg="The selected disk volume is:" VolumeName=***-second-disk-16 VolumeType=pd-standard Status=READY InstanceName=***-vm-16
time="2021-09-25T15:51:38Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:51:41Z" level=info msg="[Info]: The volume state is detached"
time="2021-09-25T15:51:43Z" level=info msg="[Wait]: Waiting for the chaos interval of 30s"
time="2021-09-25T15:52:13Z" level=info msg="[Chaos]: Attaching the disk volume to the instance"
time="2021-09-25T15:52:14Z" level=info msg="Attaching disk having:" Device=***-first-disk-16 InstanceName=***-vm-16 Status=RUNNING
time="2021-09-25T15:52:14Z" level=info msg="[Wait]: Wait for disk volume attachment for volume ***-first-disk-16"
time="2021-09-25T15:52:14Z" level=info msg="[Status]: Checking disk volume status for attachment"
time="2021-09-25T15:52:15Z" level=info msg="[Info]: The volume state is detached"
time="2021-09-25T15:52:17Z" level=info msg="The selected disk volume is:" VolumeType=pd-standard Status=READY InstanceName=***-vm-16 VolumeName=***-first-disk-16
time="2021-09-25T15:52:17Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:52:20Z" level=info msg="[Chaos]: Attaching the disk volume to the instance"
time="2021-09-25T15:52:21Z" level=info msg="Attaching disk having:" Device=***-second-disk-16 InstanceName=***-vm-16 Status=RUNNING
time="2021-09-25T15:52:21Z" level=info msg="[Wait]: Wait for disk volume attachment for volume ***-second-disk-16"
time="2021-09-25T15:52:21Z" level=info msg="[Status]: Checking disk volume status for attachment"
time="2021-09-25T15:52:21Z" level=info msg="[Info]: The volume state is detached"
time="2021-09-25T15:52:24Z" level=info msg="The selected disk volume is:" VolumeName=***-second-disk-16 VolumeType=pd-standard Status=READY InstanceName=***-vm-16
time="2021-09-25T15:52:24Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:52:26Z" level=info msg="[Confirmation]: gcp-vm-disk-loss chaos has been injected successfully"
time="2021-09-25T15:52:26Z" level=info msg="[Status]: Verify that the AUT (Application Under Test) is running (post-chaos)"
time="2021-09-25T15:52:26Z" level=info msg="[Status]: No appLabels provided, skipping the application status checks"
time="2021-09-25T15:52:26Z" level=info msg="The selected disk volume is:" InstanceName=***-vm-16 VolumeName=***-first-disk-16 VolumeType=pd-standard Status=READY
time="2021-09-25T15:52:27Z" level=info msg="The selected disk volume is:" VolumeType=pd-standard Status=READY InstanceName=***-vm-16 VolumeName=***-second-disk-16
time="2021-09-25T15:52:27Z" level=info msg="[The End]: Updating the chaos result of gcp-vm-disk-loss experiment (EOT)"

I0925 15:52:38.198372    9782 status.go:264] ChaosResult status is Completed
time="2021-09-25T15:52:43Z" level=info msg="Chaos Result Verdict is: Pass"
time="2021-09-25T15:52:43Z" level=info msg="Engine status is initialized"
time="2021-09-25T15:52:48Z" level=info msg="Engine status is completed"
time="2021-09-25T15:52:53Z" level=info msg="Chaos Engine Verdict is: Pass"
• [SLOW TEST:102.664 seconds]
BDD of gcp-vm-disk-loss experiment
/home/runner/work/***/***/platform/gcp/gcp-vm-disk-loss_test.go:22
  Check for gcp-vm-disk-loss experiment
  /home/runner/work/***/***/platform/gcp/gcp-vm-disk-loss_test.go:25
    Should check for the gcp vm disk loss in parallel
    /home/runner/work/***/***/platform/gcp/gcp-vm-disk-loss_test.go:27
------------------------------
I0925 15:52:53.213917    9782 gcp-vm-disk-loss_test.go:106] [PreReq]: Getting the ENVs for the  test
time="2021-09-25T15:52:53Z" level=info msg="[Info]: The target disk volumes are: ***-first-disk-16,***-second-disk-16"
time="2021-09-25T15:52:53Z" level=info msg="[Status]: Operator is in Running state"
time="2021-09-25T15:52:53Z" level=info msg="[Install]: Installing RBAC"
time="2021-09-25T15:52:53Z" level=info msg="[RBAC]: Installing RBAC..."
I0925 15:52:53.649969    9782 common.go:37] serviceaccount/gcp-vm-disk-loss-sa unchanged
clusterrole.rbac.authorization.k8s.io/gcp-vm-disk-loss-sa unchanged
clusterrolebinding.rbac.authorization.k8s.io/gcp-vm-disk-loss-sa unchanged
time="2021-09-25T15:52:53Z" level=info msg="[RBAC]: Rbac installed successfully !!!"
time="2021-09-25T15:52:53Z" level=info msg="[Install]: Installing chaos experiment"
time="2021-09-25T15:52:53Z" level=info msg="[LIB Image]: Lib image is  !!!"
time="2021-09-25T15:52:53Z" level=info msg="[Experiment]: Installing Experiment..."
time="2021-09-25T15:52:53Z" level=info msg="[LIB Image]: Lib image is  !!!"
time="2021-09-25T15:52:53Z" level=info msg="[ChaosExperiment]: Experiment installed successfully !!!"
time="2021-09-25T15:52:53Z" level=info msg="[Experiment Image]: Chaos Experiment created successfully with image: litmuschaos/go-runner:ci !!!"
time="2021-09-25T15:52:53Z" level=info msg="[Install]: Installing chaos engine"
time="2021-09-25T15:52:53Z" level=info msg="[Engine]: Installing ChaosEngine..."
time="2021-09-25T15:52:53Z" level=info msg="[Engine]: ChaosEngine Installed Successfully !!!"
time="2021-09-25T15:52:55Z" level=info msg="[Info]: Runner pod Name gcp-disk-engine-ser-runner"
time="2021-09-25T15:52:57Z" level=info msg="[Status]: Runner pod is in Running state"
time="2021-09-25T15:53:02Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:53:07Z" level=info msg="[Status]: Currently, the Chaos Pod is in Waiting for Job Creation state, Please Wait..."
time="2021-09-25T15:53:07Z" level=info msg="[Status]: Chaos pod initiated successfully"
time="2021-09-25T15:53:17Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:53:27Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:53:37Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:53:47Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:53:57Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:54:07Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:54:17Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:54:27Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:54:37Z" level=info msg="[Status]: Currently, the Chaos Pod is in Running State, Please Wait for its completion"
time="2021-09-25T15:54:37Z" level=info msg="[Info]: chaos pod name is: gcp-vm-disk-loss-xismb1-fgxvj "

gcp-vm-disk-loss-xismb1-fgxvj logs : 

 W0925 15:52:57.657704       1 client_config.go:541] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2021-09-25T15:52:57Z" level=info msg="Experiment Name: gcp-vm-disk-loss"
time="2021-09-25T15:52:57Z" level=info msg="[PreReq]: Getting the ENV for the gcp-vm-disk-loss experiment"
time="2021-09-25T15:52:57Z" level=info msg="[PreReq]: Updating the chaos result of gcp-vm-disk-loss experiment (SOT)"
time="2021-09-25T15:52:59Z" level=info msg="The application information is as follows" App Namespace=default AppLabel= Ramp Time=0
time="2021-09-25T15:52:59Z" level=info msg="The volume information is as follows" Volume IDs="***-first-disk-16,***-second-disk-16" Zones="us-central1-a,us-central1-a"
time="2021-09-25T15:52:59Z" level=info msg="[Status]: Verify that the AUT (Application Under Test) is running (pre-chaos)"
time="2021-09-25T15:52:59Z" level=info msg="[Status]: No appLabels provided, skipping the application status checks"
time="2021-09-25T15:53:00Z" level=info msg="The selected disk volume is:" VolumeName=***-first-disk-16 VolumeType=pd-standard Status=READY InstanceName=***-vm-16
time="2021-09-25T15:53:01Z" level=info msg="The selected disk volume is:" VolumeName=***-second-disk-16 VolumeType=pd-standard Status=READY InstanceName=***-vm-16
time="2021-09-25T15:53:02Z" level=info msg="[Chaos]: Detaching the disk volume from the instance"
time="2021-09-25T15:53:03Z" level=info msg="Detaching disk having:" Status=RUNNING Device=***-first-disk-16 InstanceName=***-vm-16
time="2021-09-25T15:53:03Z" level=info msg="[Wait]: Wait for disk volume detachment for volume ***-first-disk-16"
time="2021-09-25T15:53:03Z" level=info msg="[Status]: Checking disk volume status for detachment"
time="2021-09-25T15:53:03Z" level=info msg="The selected disk volume is:" VolumeName=***-first-disk-16 VolumeType=pd-standard Status=READY InstanceName=***-vm-16
time="2021-09-25T15:53:03Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:53:05Z" level=info msg="The selected disk volume is:" VolumeType=pd-standard Status=READY InstanceName=***-vm-16 VolumeName=***-first-disk-16
time="2021-09-25T15:53:05Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:53:08Z" level=info msg="[Info]: The volume state is detached"
time="2021-09-25T15:53:10Z" level=info msg="[Wait]: Waiting for the chaos interval of 30s"
time="2021-09-25T15:53:40Z" level=info msg="[Chaos]: Attaching the disk volume back to the instance"
time="2021-09-25T15:53:41Z" level=info msg="Attaching disk having:" Status=RUNNING Device=***-first-disk-16 InstanceName=***-vm-16
time="2021-09-25T15:53:41Z" level=info msg="[Wait]: Wait for disk volume attachment for ***-first-disk-16 volume"
time="2021-09-25T15:53:41Z" level=info msg="[Status]: Checking disk volume status for attachment"
time="2021-09-25T15:53:42Z" level=info msg="[Info]: The volume state is detached"
time="2021-09-25T15:53:44Z" level=info msg="The selected disk volume is:" VolumeName=***-first-disk-16 VolumeType=pd-standard Status=READY InstanceName=***-vm-16
time="2021-09-25T15:53:44Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:53:46Z" level=info msg="[Chaos]: Detaching the disk volume from the instance"
time="2021-09-25T15:53:47Z" level=info msg="Detaching disk having:" Device=***-second-disk-16 InstanceName=***-vm-16 Status=RUNNING
time="2021-09-25T15:53:47Z" level=info msg="[Wait]: Wait for disk volume detachment for volume ***-second-disk-16"
time="2021-09-25T15:53:47Z" level=info msg="[Status]: Checking disk volume status for detachment"
time="2021-09-25T15:53:47Z" level=info msg="The selected disk volume is:" InstanceName=***-vm-16 VolumeName=***-second-disk-16 VolumeType=pd-standard Status=READY
time="2021-09-25T15:53:47Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:53:50Z" level=info msg="[Info]: The volume state is detached"
time="2021-09-25T15:53:52Z" level=info msg="[Wait]: Waiting for the chaos interval of 30s"
time="2021-09-25T15:54:22Z" level=info msg="[Chaos]: Attaching the disk volume back to the instance"
time="2021-09-25T15:54:23Z" level=info msg="Attaching disk having:" Status=RUNNING Device=***-second-disk-16 InstanceName=***-vm-16
time="2021-09-25T15:54:23Z" level=info msg="[Wait]: Wait for disk volume attachment for ***-second-disk-16 volume"
time="2021-09-25T15:54:23Z" level=info msg="[Status]: Checking disk volume status for attachment"
time="2021-09-25T15:54:24Z" level=info msg="[Info]: The volume state is detached"
time="2021-09-25T15:54:26Z" level=info msg="The selected disk volume is:" VolumeName=***-second-disk-16 VolumeType=pd-standard Status=READY InstanceName=***-vm-16
time="2021-09-25T15:54:26Z" level=info msg="[Info]: The volume state is attached"
time="2021-09-25T15:54:28Z" level=info msg="[Confirmation]: gcp-vm-disk-loss chaos has been injected successfully"
time="2021-09-25T15:54:28Z" level=info msg="[Status]: Verify that the AUT (Application Under Test) is running (post-chaos)"
time="2021-09-25T15:54:28Z" level=info msg="[Status]: No appLabels provided, skipping the application status checks"
time="2021-09-25T15:54:29Z" level=info msg="The selected disk volume is:" Status=READY InstanceName=***-vm-16 VolumeName=***-first-disk-16 VolumeType=pd-standard
time="2021-09-25T15:54:30Z" level=info msg="The selected disk volume is:" VolumeName=***-second-disk-16 VolumeType=pd-standard Status=READY InstanceName=***-vm-16
time="2021-09-25T15:54:30Z" level=info msg="[The End]: Updating the chaos result of gcp-vm-disk-loss experiment (EOT)"

I0925 15:54:37.969396    9782 status.go:264] ChaosResult status is Completed
time="2021-09-25T15:54:42Z" level=info msg="Chaos Result Verdict is: Pass"
time="2021-09-25T15:54:42Z" level=info msg="Engine status is initialized"
time="2021-09-25T15:54:47Z" level=info msg="Engine status is completed"
time="2021-09-25T15:54:52Z" level=info msg="Chaos Engine Verdict is: Pass"
• [SLOW TEST:119.771 seconds]
BDD of gcp-vm-disk-loss experiment
/home/runner/work/***/***/platform/gcp/gcp-vm-disk-loss_test.go:22
  Check for gcp-vm-disk-loss experiment
  /home/runner/work/***/***/platform/gcp/gcp-vm-disk-loss_test.go:90
    Should check for the gcp vm disk loss in serial
    /home/runner/work/***/***/platform/gcp/gcp-vm-disk-loss_test.go:92
------------------------------

Ran 2 of 2 Specs in 222.435 seconds
SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestGoGCPVMDiskLoss (222.44s)
PASS
ok  	command-line-arguments	222.462s

@uditgaurav
Copy link
Member

@uditgaurav uditgaurav merged commit 2829d8e into litmuschaos:master Sep 25, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add infra level experiments (GCP and Azure) into e2e pipeline
3 participants