Skip to content

[C++] Nightly Integration Testing Report #1710

@github-actions

Description

@github-actions

Note: This report excludes Firestore. Please also check the report for Firestore.


Testing History (last 7 days)

Date Build vs Source Repo Test vs Source Repo SDK Packaging Build vs SDK Package Test vs SDK Package Notes
2026‑03‑14 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Linux and Windows.
2026‑03‑15 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass
 A test error in Auth on Android emulator, and test flakes in Auth on Android, Installations on Android emulator, and Database on Android.
2026‑03‑16 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 Test flakes in Auth on Android emulator and App Check on iOS.
2026‑03‑17 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass
 A test error in Auth on iOS simulator, and test flakes in Auth on Android emulator and iOS.
2026‑03‑18 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Auth on Windows, and test flakes in Auth on Android emulator and Messaging on Android.
2026‑03‑19 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on MacOS and Windows.
2026‑03‑20 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Auth on Linux.
View extended history (last 30 days)

Testing History (last 30 days)

Date Build vs Source Repo Test vs Source Repo SDK Packaging Build vs SDK Package Test vs SDK Package Notes
2026‑02‑19 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Linux and Android, and a test flake in Auth on Android.
2026‑02‑20 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Auth on Android emulator.
2026‑02‑21 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on MacOS, Windows, and Linux.
2026‑02‑22 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Linux and Windows, and test flakes in Storage on Android emulator and Installations on Android emulator.
2026‑02‑23 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Auth on Android.
2026‑02‑24 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 Test errors in Auth on Linux and Windows.
2026‑02‑25 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Auth on Android.
2026‑02‑26 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Remote Config on Android emulator.
2026‑02‑27 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Auth on Windows, and test flakes in Auth on Android emulator and Storage on Android.
2026‑02‑28 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Windows and Linux, and a test flake in Messaging on Android.
2026‑03‑01 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in App Check on Android.
2026‑03‑02 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Analytics on Windows, and test flakes in Storage on Android emulator, Messaging on Android, and Auth on Android.
2026‑03‑03 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Auth on Windows and a test flake in Auth on Android.
2026‑03‑04 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass
 A test error in Auth on Android emulator and a test flake in Auth on Android emulator.
2026‑03‑05 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 Test errors in Auth on Linux and Windows and Analytics on Windows.
2026‑03‑06 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test flake in Auth on Android emulator.
2026‑03‑07 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test flake in Functions on Android emulator.
2026‑03‑08 ✅ Pass ❌ Failure ✅ Pass ❌ Failure ❌ Failure
 Test errors in Auth on Linux and Windows.
2026‑03‑09 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Auth on Android.
2026‑03‑10 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Auth on Windows, and test flakes in App Check on Android and Auth on Android emulator.
2026‑03‑11 ❌ Failure ✅ Pass ✅ Pass ✅ Pass ✅ Pass (flaky)
 Missing build logs on Linux.
2026‑03‑12 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 Test flakes in Remote Config on Android and Auth on Android.
2026‑03‑13 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Auth on Linux.
2026‑03‑14 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Linux and Windows.
2026‑03‑15 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass
 A test error in Auth on Android emulator, and test flakes in Auth on Android, Installations on Android emulator, and Database on Android.
2026‑03‑16 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 Test flakes in Auth on Android emulator and App Check on iOS.
2026‑03‑17 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass
 A test error in Auth on iOS simulator, and test flakes in Auth on Android emulator and iOS.
2026‑03‑18 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Auth on Windows, and test flakes in Auth on Android emulator and Messaging on Android.
2026‑03‑19 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on MacOS and Windows.
2026‑03‑20 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Auth on Linux.
Top 10 flakes/failures (last 30 days)
# Latest Product Platform Test Info
15 2 days ago Auth Android FirebaseAuthTest.TestSignInWithBadEmailFails (flaky)
   Logs: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
11 1 day ago Auth Windows FirebaseAuthTest.TestSignInWithBadEmailFails (failure)
   Logs: 1 2 3 4 5 6 7 8 9 10 11
10 Today Auth Linux FirebaseAuthTest.TestSignInWithBadEmailFails (failure)
   Logs: 1 2 3 4 5 6 7 8 9 10
3 18 days ago Storage Android Crash or timeout (flaky)
   Logs: 1 2 3
3 5 days ago Auth Android FirebaseAuthTest.TestSignInWithBadEmailFails (failure)
   Logs: 1 2 3
2 15 days ago Analytics Windows FirebaseAnalyticsTest.TestSetLogCallback (failure)
   Logs: 1 2
2 15 days ago Analytics Windows FirebaseAnalyticsTest.TestDesktopInitialization (failure)
   Logs: 1 2
2 2 days ago Messaging Android FirebaseMessagingTest.TestSendMessageToToken (flaky)
   Logs: 1 2
2 5 days ago Installations Android FirebaseInstallationsTest.TestCanGetToken (flaky)
   Logs: 1 2
2 1 day ago Auth MacOS FirebaseAuthTest.TestSignInWithBadEmailFails (failure)
   Logs: 1 2
📄
2026-03-14			Pass	Failure	Pass	Pass	Pass (flaky)	Test errors in Auth on Linux and Windows.
2026-03-15			Pass	Failure	Pass	Pass	Pass	A test error in Auth on Android emulator, and test flakes in Auth on Android, Installations on Android emulator, and Database on Android.
2026-03-16			Pass	Pass (flaky)	Pass	Pass	Failure	Test flakes in Auth on Android emulator and App Check on iOS.
2026-03-17			Pass	Failure	Pass	Pass	Pass	A test error in Auth on iOS simulator, and test flakes in Auth on Android emulator and iOS.
2026-03-18			Pass	Failure	Pass	Pass	Pass (flaky)	A test error in Auth on Windows, and test flakes in Auth on Android emulator and Messaging on Android.
2026-03-19			Pass	Failure	Pass	Pass	Pass (flaky)	Test errors in Auth on MacOS and Windows.
2026-03-20			Pass	Failure	Pass	Pass	Failure	A test error in Auth on Linux.


[build against repo] Integration test with FLAKINESS (succeeded after retry)

Requested by @DellaBitta on commit 5f348b8
Last updated: Fri Mar 20 03:45 PDT 2026
View integration test log & download artifacts

Failures Configs
app_check [TEST] [FLAKINESS] [iOS] [macos] [1/2 ios_device: ios_target]
(1 failed tests)  FirebaseAppCheckTest.TestSignIn

Add flaky tests to go/fpl-cpp-flake-tracker


[build against SDK] Integration test with FLAKINESS (succeeded after retry)

Requested by @firebase-workflow-trigger[bot] on commit 5f348b8
Last updated: Fri Mar 20 06:53 PDT 2026
View integration test log & download artifacts

Failures Configs
app_check [TEST] [FLAKINESS] [iOS] [macos] [1/2 ios_device: ios_target]
(1 failed tests)  FirebaseAppCheckTest.TestSignIn
auth [TEST] [FLAKINESS] [Android] [1/3 os: macos] [2/4 android_device: android_target emulator_ftl_latest]
(1 failed tests)  FirebaseAuthTest.TestSignInWithBadEmailFails
installations [TEST] [FLAKINESS] [Android] [1/3 os: windows] [1/4 android_device: emulator_ftl_target]
(1 failed tests)  FirebaseInstallationsTest.TestCanGetToken

Add flaky tests to go/fpl-cpp-flake-tracker

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions