1) [Mobile Safari] › src/components/radio/test/a11y/radio.e2e.ts:63:9 › radio: keyboard navigation - ios/ltr › tabbing should switch between radio groups Error: Timed out 5000ms waiting for expect(locator).toBeFocused() Locator: locator('#first-group ion-radio').first() Expected: focused Received: inactive Call log: - expect.toBeFocused with timeout 5000ms - waiting for locator('#first-group ion-radio').first() - locator resolved to <ion-radio value="huey" role="radio" tabindex="-1" aria-che…>Huey</ion-radio> - unexpected value "not focused" - locator resolved to <ion-radio value="huey" role="radio" tabindex="-1" aria-che…>Huey</ion-radio> - unexpected value "not focused" - locator resolved to <ion-radio value="huey" role="radio" tabindex="0" aria-chec…>Huey</ion-radio> - unexpected value "not focused" - locator resolved to <ion-radio value="huey" role="radio" tabindex="0" aria-chec…>Huey</ion-radio> - unexpected value "not focused" - locator resolved to <ion-radio value="huey" role="radio" tabindex="0" aria-chec…>Huey</ion-radio> - unexpected value "not focused" - locator resolved to <ion-radio value="huey" role="radio" tabindex="0" aria-chec…>Huey</ion-radio> - unexpected value "not focused" - locator resolved to <ion-radio value="huey" role="radio" tabindex="0" aria-chec…>Huey</ion-radio> - unexpected value "not focused" - locator resolved to <ion-radio value="huey" role="radio" tabindex="0" aria-chec…>Huey</ion-radio> - unexpected value "not focused" - locator resolved to <ion-radio value="huey" role="radio" tabindex="0" aria-chec…>Huey</ion-radio> - unexpected value "not focused" 66 | 67 | await pageUtils.pressKeys('Tab'); > 68 | await expect(firstGroupRadios.nth(0)).toBeFocused(); | ^ 69 | 70 | await pageUtils.pressKeys('Tab'); 71 | await expect(secondGroupRadios.nth(0)).toBeFocused(); at /home/runner/work/ionic-framework/ionic-framework/core/src/components/radio/test/a11y/radio.e2e.ts:68:45

1) [Mobile Firefox] › src/components/datetime/test/locale/datetime.e2e.ts:75:11 › datetime: locale - ios/ltr › es-ES › month/year picker should not have visual regressions Error: Screenshot comparison failed: 645 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/ionic-framework/ionic-framework/core/src/components/datetime/test/locale/datetime.e2e.ts-snapshots/datetime-locale-es-ES-month-year-diff-ios-ltr-Mobile-Firefox-linux.png Received: /home/runner/work/ionic-framework/ionic-framework/core/test-results/src-components-datetime-test-locale-datetime.e-46e6e--year-picker-should-not-have-visual-regressions-Mobile-Firefox/datetime-locale-es-ES-month-year-diff-ios-ltr-actual.png Diff: /home/runner/work/ionic-framework/ionic-framework/core/test-results/src-components-datetime-test-locale-datetime.e-46e6e--year-picker-should-not-have-visual-regressions-Mobile-Firefox/datetime-locale-es-ES-month-year-diff-ios-ltr-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('ion-datetime') - locator resolved to <ion-datetime max="2022" locale="es-ES" show-default-title="tr…>…</ion-datetime> - taking element screenshot - disabled all CSS animations - waiting for element to be visible and stable - element is visible and stable - 645 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('ion-datetime') - locator resolved to <ion-datetime max="2022" locale="es-ES" show-default-title="tr…>…</ion-datetime> - taking element screenshot - disabled all CSS animations - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - 645 pixels (ratio 0.01 of all image pixels) are different. 165 | async expectLocalizedPicker(screenshot: ScreenshotFn, modifier?: string) { 166 | const modifierString = modifier === undefined ? '' : `-${modifier}`; > 167 | await expect(this.datetime).toHaveScreenshot(screenshot(`datetime-locale-${this.locale}${modifierString}-diff`)); | ^ 168 | } 169 | } 170 | at DatetimeLocaleFixture.expectLocalizedPicker (/home/runner/work/ionic-framework/ionic-framework/core/src/components/datetime/test/locale/datetime.e2e.ts:167:33) at DatetimeLocaleFixture.expectLocalizedMonthYearPicker (/home/runner/work/ionic-framework/ionic-framework/core/src/components/datetime/test/locale/datetime.e2e.ts:158:16) at /home/runner/work/ionic-framework/ionic-framework/core/src/components/datetime/test/locale/datetime.e2e.ts:77:31

1) [Mobile Safari] › src/components/menu/test/disable/menu.e2e.ts:40:9 › menu: disable - ios/ltr › should disable when menu is animating Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('ion-menu') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('ion-menu') - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" 59 | await menu.evaluate((el: HTMLIonMenuElement) => (el.disabled = false)); 60 | await menu.evaluate((el: HTMLIonMenuElement) => el.open()); > 61 | await expect(menu).toBeVisible(); | ^ 62 | 63 | expect(logs.length).toBe(0); 64 | }); at /home/runner/work/ionic-framework/ionic-framework/core/src/components/menu/test/disable/menu.e2e.ts:61:26

1) [Mobile Safari] › src/components/menu/test/disable/menu.e2e.ts:40:9 › menu: disable - ios/ltr › should disable when menu is animating Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('ion-menu') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('ion-menu') - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" 59 | await menu.evaluate((el: HTMLIonMenuElement) => (el.disabled = false)); 60 | await menu.evaluate((el: HTMLIonMenuElement) => el.open()); > 61 | await expect(menu).toBeVisible(); | ^ 62 | 63 | expect(logs.length).toBe(0); 64 | }); at /home/runner/work/ionic-framework/ionic-framework/core/src/components/menu/test/disable/menu.e2e.ts:61:26

1) [Mobile Safari] › src/components/menu/test/disable/menu.e2e.ts:40:9 › menu: disable - ios/ltr › should disable when menu is animating Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('ion-menu') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('ion-menu') - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" - locator resolved to <ion-menu side="start" id="start-menu" content-id="main" r…>…</ion-menu> - unexpected value "hidden" 59 | await menu.evaluate((el: HTMLIonMenuElement) => (el.disabled = false)); 60 | await menu.evaluate((el: HTMLIonMenuElement) => el.open()); > 61 | await expect(menu).toBeVisible(); | ^ 62 | 63 | expect(logs.length).toBe(0); 64 | }); at /home/runner/work/ionic-framework/ionic-framework/core/src/components/menu/test/disable/menu.e2e.ts:61:26

Process completed with exit code 1.

Process completed with exit code 1.

390 passed (2.4m)

14 skipped 325 passed (2.2m)

358 passed (2.8m)

2 skipped 440 passed (3.4m)

383 passed (2.7m)

13 skipped 378 passed (4.4m)

2 skipped 370 passed (4.4m)

11 skipped 375 passed (4.3m)

3 skipped 419 passed (3.0m)

15 skipped 385 passed (4.7m)

1 flaky [Mobile Safari] › src/components/radio/test/a11y/radio.e2e.ts:63:9 › radio: keyboard navigation - ios/ltr › tabbing should switch between radio groups 12 skipped 375 passed (5.1m)

1 flaky [Mobile Firefox] › src/components/datetime/test/locale/datetime.e2e.ts:75:11 › datetime: locale - ios/ltr › es-ES › month/year picker should not have visual regressions 3 skipped 386 passed (5.5m)

1 skipped 397 passed (5.5m)

12 skipped 361 passed (4.8m)

4 skipped 391 passed (5.0m)

5 skipped 395 passed (4.6m)

2 skipped 388 passed (5.0m)

10 skipped 407 passed (5.7m)

11 skipped 364 passed (4.1m)