Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(analysis): prevent promotion on inconclusive background run. Fixes: #3850 #3873

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

fix: e2e test for inconclusive analysisrun

3fee5f0
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

fix(analysis): prevent promotion on inconclusive background run. Fixes: #3850 #3873

fix: e2e test for inconclusive analysisrun
3fee5f0
Select commit
Loading
Failed to load commit list.
GitHub Actions / Published E2E Test Results succeeded Dec 13, 2024 in 0s

2 fail, 7 skipped, 105 pass in 3h 11m 24s

  4 files    4 suites   3h 11m 24s ⏱️
114 tests 105 ✅  7 💤 2 ❌
458 runs  428 ✅ 28 💤 2 ❌

Results for commit 3fee5f0.

Annotations

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestCanarySuite/TestCanaryScaleDownOnAbort (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.31)/junit-e2e-test.xml [took 3s]
Raw output
Failed
=== RUN   TestCanarySuite/TestCanaryScaleDownOnAbort
time="2024-12-13T22:48:52Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownOnAbort"
time="2024-12-13T22:48:52Z" level=info msg="service/canary-scaledowndelay-root created\n" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:52Z" level=info msg="service/canary-scaledowndelay-canary created\n" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:52Z" level=info msg="service/canary-scaledowndelay-stable created\n" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:52Z" level=info msg="Warning: annotation \"kubernetes.io/ingress.class\" is deprecated, please use 'spec.ingressClassName' instead\ningress.networking.k8s.io/canary-scaledowndelay-ingress created\n" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:52Z" level=info msg="rollout.argoproj.io/canary-scaledownd-on-abort created\n" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:52Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:54Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:54Z" level=info msg="Updated rollout pod spec: 2024-12-13T22:48:54.051343449Z" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:54Z" level=info msg="Waiting for condition: status=Paused" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:55Z" level=info msg="Condition 'status=Paused' met after 1s" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:55Z" level=info msg="Aborted rollout" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:55Z" level=info msg="Waiting for condition: status=Degraded" rollout=canary-scaledownd-on-abort
time="2024-12-13T22:48:55Z" level=info msg="Condition 'status=Degraded' met after 0s" rollout=canary-scaledownd-on-abort
    canary_test.go:572: Expected canary-scaledowndelay-canary selector: map[app:canary-scaledowndelay rollouts-pod-template-hash:66597877b7]. Actual: map[app:canary-scaledowndelay rollouts-pod-template-hash:f556f4595]
Name:            canary-scaledownd-on-abort
Namespace:       default
Status:          �[31m✖�[0m Degraded
Message:         RolloutAborted: Rollout aborted update to revision 2
Strategy:        Canary
  Step:          0/2
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
  Desired:       1
  Current:       2
  Updated:       1
  Ready:         2
  Available:     2

NAME                                                    KIND        STATUS      AGE  INFO
⟳ canary-scaledownd-on-abort                            Rollout     �[31m✖�[0m Degraded  3s   
├──# revision:2                                                                      
│  └──⧉ �[33mcanary-scaledownd-on-abort-f556f4595�[0m            ReplicaSet  �[32m✔�[0m Healthy   1s   �[33mcanary�[0m,delay:0s
│     └──□ canary-scaledownd-on-abort-f556f4595-7j5nh   Pod         �[32m✔�[0m Running   1s   ready:1/1
└──# revision:1                                                                      
   └──⧉ �[32mcanary-scaledownd-on-abort-66597877b7�[0m           ReplicaSet  �[32m✔�[0m Healthy   3s   �[32mstable�[0m
      └──□ canary-scaledownd-on-abort-66597877b7-fjnbz  Pod         �[32m✔�[0m Running   3s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-12-13T22:48:52Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryScaleDownOnAbort
  name: canary-scaledownd-on-abort
  namespace: default
  resourceVersion: "8026"
  uid: 91d3d599-ca9a-46d2-8368-86eecd2a0dff
spec:
  replicas: 1
  selector:
    matchLabels:
      app: canary-scaledowndelay
  strategy:
    canary:
      abortScaleDownDelaySeconds: 1
      canaryService: canary-scaledowndelay-canary
      scaleDownDelayRevisionLimit: 1
      stableService: canary-scaledowndelay-stable
      steps:
      - setCanaryScale:
          replicas: 1
      - pause: {}
      trafficRouting:
        alb:
          ingress: canary-scaledowndelay-ingress
          rootService: canary-scaledowndelay-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2024-12-13T22:48:54.051343449Z"
      creationTimestamp: null
      labels:
        app: canary-scaledowndelay
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: canary-scaledowndelay
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 2
  abort: true
  abortedAt: "2024-12-13T22:48:55Z"
  availableReplicas: 2
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: f556f4595
        serviceName: canary-scaledowndelay-canary
        weight: 0
      stable:
        podTemplateHash: 66597877b7
        serviceName: canary-scaledowndelay-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2024-12-13T22:48:54Z"
    lastUpdateTime: "2024-12-13T22:48:54Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-12-13T22:48:54Z"
    lastUpdateTime: "2024-12-13T22:48:54Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-12-13T22:48:54Z"
    lastUpdateTime: "2024-12-13T22:48:54Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2024-12-13T22:48:55Z"
    lastUpdateTime: "2024-12-13T22:48:55Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  - lastTransitionTime: "2024-12-13T22:48:55Z"
    lastUpdateTime: "2024-12-13T22:48:55Z"
    message: Rollout aborted update to revision 2
    reason: RolloutAborted
    status: "False"
    type: Progressing
  currentPodHash: f556f4595
  currentStepHash: 5db8f9b897
  currentStepIndex: 0
  message: 'RolloutAborted: Rollout aborted update to revision 2'
  observedGeneration: "3"
  phase: Degraded
  readyReplicas: 2
  replicas: 2
  selector: app=canary-scaledowndelay
  stableRS: 66597877b7
  updatedReplicas: 1

2024-12-13T22:48:52Z         Normal     RolloutAddedToInformer    Rollout resource added to informer: default/canary-scaledownd-on-abort
2024-12-13T22:48:52Z         Normal     RolloutUpdated            Rollout updated to revision 1
2024-12-13T22:48:52Z         Normal     NewReplicaSetCreated      Created ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1)
2024-12-13T22:48:52Z         Normal     RolloutNotCompleted       Rollout not completed, started update to revision 1 (66597877b7)
2024-12-13T22:48:52Z         Normal     PatchingALBIngress        Updating Ingress `canary-scaledowndelay-ingress` to desiredWeight '0'
2024-12-13T22:48:52Z         Normal     TrafficWeightUpdated      Traffic weight updated to 0
2024-12-13T22:48:52Z         Normal     ScalingReplicaSet         Scaled up ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1) from 0 to 1
2024-12-13T22:48:52Z         Normal     RolloutCompleted          Rollout completed update to revision 1 (66597877b7): Initial deploy
2024-12-13T22:48:54Z (x2)    Normal     TrafficWeightUpdated      Traffic weight updated 
2024-12-13T22:48:54Z         Normal     SwitchService             Switched selector for service 'canary-scaledowndelay-stable' from '' to '66597877b7'
2024-12-13T22:48:54Z         Normal     SwitchService             Switched selector for service 'canary-scaledowndelay-canary' from '' to '66597877b7'
2024-12-13T22:48:54Z         Normal     RolloutUpdated            Rollout updated to revision 2
2024-12-13T22:48:54Z         Normal     NewReplicaSetCreated      Created ReplicaSet canary-scaledownd-on-abort-f556f4595 (revision 2)
2024-12-13T22:48:54Z         Normal     RolloutNotCompleted       Rollout not completed, started update to revision 2 (f556f4595)
2024-12-13T22:48:54Z         Normal     ScalingReplicaSet         Scaled up ReplicaSet canary-scaledownd-on-abort-f556f4595 (revision 2) from 0 to 1
2024-12-13T22:48:55Z (x3)    Normal     SwitchService             Switched selector for service 'canary-scaledowndelay-canary' from '66597877b7' to 'f556f4595'
2024-12-13T22:48:55Z         Normal     RolloutStepCompleted      Rollout step 1/2 completed (setCanaryScale{replicas: 1})
2024-12-13T22:48:55Z         Normal     RolloutPaused             Rollout is paused (CanaryPauseStep)
2024-12-13T22:48:55Z (x3)    Normal     SwitchService             Switched selector for service 'canary-scaledowndelay-canary' from 'f556f4595' to '66597877b7'
2024-12-13T22:48:55Z         Warning    RolloutAborted            Rollout aborted update to revision 2

time="2024-12-13T22:48:55Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownOnAbort"
    --- FAIL: TestCanarySuite/TestCanaryScaleDownOnAbort (3.34s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.31)/junit-e2e-test.xml [took 4m 51s]
Raw output
Failed
=== RUN   TestCanarySuite
time="2024-12-13T22:46:02Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (291.83s)

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

7 skipped tests found

There are 7 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestStepPluginSuite

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

114 tests found

There are 114 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBMesh_PingPong_StableCanary_Update
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInconclusiveBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelayWithProgressDeadline
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryWithPausedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestNeverScaleDown
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownOnSuccess
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownProgressively
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestSpecAndReplicaChangeSameTime
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitInStableDownscaleAfterCanaryAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestStepPluginSuite