Skip to content

Instantly share code, notes, and snippets.

@snickell
Created March 15, 2026 11:03
Show Gist options
  • Select an option

  • Save snickell/43d58339a732ba02ee8b703bc3e85054 to your computer and use it in GitHub Desktop.

Select an option

Save snickell/43d58339a732ba02ee8b703bc3e85054 to your computer and use it in GitHub Desktop.

Flaky Drone Failures

NOTE: local build.log links won't work in gist, but they work on disk

Flaky UI test failures:

  • Chrome_code_tools_pythonlab_pythonlab_run had 10 flaky failures link link link link link link link link link link
  • Chrome_star_labs_mix_move_ai had 6 flaky failures link link link link link link
  • Chrome_teacher_tools_rubrics_ai_evaluate_student_code had 5 flaky failures link link link link link
  • Chrome_teacher_tools_contextual_hints had 4 flaky failures link link link link
  • Chrome_acquisition_products_curriculum_catalog_assign_unassign had 3 flaky failures link link link
  • Chrome_star_labs_applab_clipping had 3 flaky failures link link link
  • Chrome_star_labs_gamelab_loading_animations had 3 flaky failures link link link
  • Chrome_teacher_tools_authored_hints had 3 flaky failures link link link
  • Chrome_teacher_tools_teacher_dashboard_teacher_homepage_v2 had 3 flaky failures link link link
  • Chrome_teacher_tools_version_history had 3 flaky failures link link link
  • Chrome_star_labs_applab_template_backed had 2 flaky failures link link
  • Chrome_star_labs_dance_dance_party had 2 flaky failures link link
  • Chrome_star_labs_manage_assets had 2 flaky failures link link
  • Chrome_star_labs_sharepage_logo had 2 flaky failures link link
  • Chrome_student_learning_hour_of_code_starwars had 2 flaky failures link link
  • Chrome_teacher_tools_ai_diff_ai_differentiation_chat had 2 flaky failures link link
  • Chrome_teacher_tools_level_types_bubble_choice had 2 flaky failures link link
  • Chrome_teacher_tools_level_types_free_response_contained_levels had 2 flaky failures link link
  • Chrome_acquisition_products_curriculum_catalog had 1 flaky failures link
  • Chrome_acquisition_products_pd_workshop_enrollment had 1 flaky failures link
  • Chrome_code_tools_blockly_modal_function_editor had 1 flaky failures link
  • Chrome_javalab_commit_code had 1 flaky failures link
  • Chrome_platform_policy_compliance_policy_compliance had 1 flaky failures link
  • Chrome_star_labs_aichat_chat had 1 flaky failures link
  • Chrome_star_labs_applab_scenarios had 1 flaky failures link
  • Chrome_star_labs_applab_scenarios2 had 1 flaky failures link
  • Chrome_star_labs_applab_versions had 1 flaky failures link
  • Chrome_star_labs_dance_save_for_share had 1 flaky failures link
  • Chrome_star_labs_gamelab_export_animations had 1 flaky failures link
  • Chrome_star_labs_gamelab_level_options had 1 flaky failures link
  • Chrome_star_labs_gamelab_libraries had 1 flaky failures link
  • Chrome_star_labs_weblab_too_young had 1 flaky failures link
  • Chrome_student_learning_hour_of_code_hour_of_code had 1 flaky failures link
  • Chrome_teacher_tools_assign_modular_course had 1 flaky failures link
  • Chrome_teacher_tools_challenge_level had 1 flaky failures link
  • Chrome_teacher_tools_level_types_level_group_activity_guide had 1 flaky failures link
  • Chrome_teacher_tools_level_types_level_group_multi_page had 1 flaky failures link
  • Chrome_teacher_tools_level_types_multiple_choice_contained_levels had 1 flaky failures link
  • Chrome_teacher_tools_pl_sections had 1 flaky failures link
  • Chrome_teacher_tools_projects_prevent_report_abuse_spam had 1 flaky failures link
  • Chrome_teacher_tools_projects_public_project_gallery_project_validator had 1 flaky failures link
  • Chrome_teacher_tools_report_abuse had 1 flaky failures link
  • Chrome_teacher_tools_rubrics_teacher_view_of_rubric had 1 flaky failures link
  • Chrome_teacher_tools_script_overview had 1 flaky failures link
  • Chrome_teacher_tools_teacher_dashboard_teacher_dashboard_assessments2 had 1 flaky failures link
  • Chrome_xteam_gdpr_dialog had 1 flaky failures link

UI Tests

UI TEST REPORT: ❌ FAILED

13x failed features: • FAILED: Chrome_teacher_tools_rubrics_ai_evaluate_student_code ☁ Log on S3 (0:13 minutes, 2 failed with 2 reruns) • FAILED: Chrome_teacher_tools_teacher_dashboard_teacher_homepage_v2 ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_aichat_chat ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_rubrics_teacher_view_of_rubric ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_mix_move_ai ☁ Log on S3 (0:11 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_level_types_bubble_choice ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_ai_diff_ai_differentiation_chat ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_manage_assets ☁ Log on S3 (0:11 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_applab_scenarios2 ☁ Log on S3 (0:12 minutes, 1 failed with 2 reruns) • FAILED: Chrome_acquisition_products_curriculum_catalog_assign_unassign ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_javalab_commit_code ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_contextual_hints ☁ Log on S3 (0:08 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50491/test_status_UI.html?versionId=FBikRXT8PurRz95pOD_SJ7GJIW2h3TzO

UI TEST REPORT: ❌ FAILED

1x failed features: • FAILED: Chrome_star_labs_gamelab_export_animations ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50477/test_status_UI.html?versionId=6BhTx86NaxjDcP4AX62tVg5r2CzlgUhZ

UI TEST REPORT: ❌ FAILED

1x failed features: • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (1:08 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50330/test_status_UI.html?versionId=1TkNdM.DshF1cke6eFoRWD611nfQxt4s

UI TEST REPORT: ❌ FAILED

11x failed features: • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (0:08 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_dance_dance_party ☁ Log on S3 (0:12 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_mix_move_ai ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_level_types_bubble_choice ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_student_learning_hour_of_code_starwars ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_weblab_too_young ☁ Log on S3 (0:13 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_contextual_hints ☁ Log on S3 (0:12 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_applab_template_backed ☁ Log on S3 (0:11 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_gamelab_loading_animations ☁ Log on S3 (0:13 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_applab_clipping ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_authored_hints ☁ Log on S3 (0:06 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50253/test_status_UI.html?versionId=BlkUzYAqXsRhvL6y4S3Sh0bIJelb2Goi

UI TEST REPORT: ❌ FAILED

1x failed features: • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (1:22 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50268/test_status_UI.html?versionId=yhw.soghJ8uGDz78HRKhb8Bj5xP64e5D

UI TEST REPORT: ❌ FAILED

15x failed features: • FAILED: Chrome_teacher_tools_projects_public_project_gallery_project_validator ☁ Log on S3 (2:49 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_pl_sections ☁ Log on S3 (3:42 minutes, 1 failed, 1 passed with 2 reruns) • FAILED: Chrome_acquisition_products_curriculum_catalog ☁ Log on S3 (4:45 minutes, 2 failed with 2 reruns) • FAILED: Chrome_teacher_tools_script_overview ☁ Log on S3 (4:18 minutes, 1 failed, 1 passed with 2 reruns) • FAILED: Chrome_teacher_tools_rubrics_ai_evaluate_student_code ☁ Log on S3 (6:29 minutes, 2 failed, 1 passed with 2 reruns) • FAILED: Chrome_platform_policy_compliance_policy_compliance ☁ Log on S3 (2:31 minutes, 1 failed with 2 reruns) • FAILED: Chrome_student_learning_hour_of_code_hour_of_code ☁ Log on S3 (2:20 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_teacher_dashboard_teacher_homepage_v2 ☁ Log on S3 (3:39 minutes, 1 failed, 1 passed with 2 reruns) • FAILED: Chrome_star_labs_applab_scenarios ☁ Log on S3 (2:28 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_projects_prevent_report_abuse_spam ☁ Log on S3 (2:41 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_applab_versions ☁ Log on S3 (5:03 minutes, 2 failed with 2 reruns) • FAILED: Chrome_acquisition_products_pd_workshop_enrollment ☁ Log on S3 (2:49 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_sharepage_logo ☁ Log on S3 (2:55 minutes, 1 failed, 1 passed with 2 reruns) • FAILED: Chrome_code_tools_blockly_modal_function_editor ☁ Log on S3 (3:18 minutes, 1 failed, 1 passed with 2 reruns) • FAILED: Chrome_teacher_tools_report_abuse ☁ Log on S3 (2:28 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50275/test_status_UI.html?versionId=FKm_isB3gK_O.Yrq9Mgr8Z_Wj.lxaP8M

UI TEST REPORT: ❌ FAILED

14x failed features: • FAILED: Chrome_teacher_tools_level_types_free_response_contained_levels ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_rubrics_ai_evaluate_student_code ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_teacher_dashboard_teacher_homepage_v2 ☁ Log on S3 (0:08 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_mix_move_ai ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_dance_save_for_share ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_version_history ☁ Log on S3 (0:06 minutes, 1 failed with 2 reruns) • FAILED: Chrome_acquisition_products_curriculum_catalog_assign_unassign ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_assign_modular_course ☁ Log on S3 (0:06 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_challenge_level ☁ Log on S3 (0:08 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_contextual_hints ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_gamelab_loading_animations ☁ Log on S3 (0:12 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_applab_clipping ☁ Log on S3 (0:09 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_authored_hints ☁ Log on S3 (0:06 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50258/test_status_UI.html?versionId=7BB8IkO7yjm5ZZZxqABAYtrReBHh5JFI

UI TEST REPORT: ✅ PASSED

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50245/test_status_UI.html?versionId=080zUvC5HdA75E2Ckx7NXKxIwm6scjQU

couldn't extract ui test report

couldn't extract ui test report

UI TEST REPORT: ✅ PASSED

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50164/test_status_UI.html?versionId=gLAJy6EnBEDg7jd9UzxR0yPWp7ax6gkk

UI TEST REPORT: ❌ FAILED

14x failed features: • FAILED: Chrome_teacher_tools_rubrics_ai_evaluate_student_code ☁ Log on S3 (5:51 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_teacher_dashboard_teacher_dashboard_assessments2 ☁ Log on S3 (3:15 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_ai_diff_ai_differentiation_chat ☁ Log on S3 (2:41 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_dance_dance_party ☁ Log on S3 (2:27 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_gamelab_level_options ☁ Log on S3 (2:28 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_mix_move_ai ☁ Log on S3 (2:38 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_level_types_level_group_activity_guide ☁ Log on S3 (2:36 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_version_history ☁ Log on S3 (2:43 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_sharepage_logo ☁ Log on S3 (2:31 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_contextual_hints ☁ Log on S3 (2:22 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_applab_template_backed ☁ Log on S3 (2:30 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_gamelab_loading_animations ☁ Log on S3 (2:35 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_applab_clipping ☁ Log on S3 (2:30 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_authored_hints ☁ Log on S3 (2:21 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/50004/test_status_UI.html?versionId=Qp7O7B8rw_uRnjcpjH97DtV7hcFqqWgt

couldn't extract ui test report

couldn't extract ui test report

couldn't extract ui test report

couldn't extract ui test report

UI TEST REPORT: ✅ PASSED

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49466/test_status_UI.html?versionId=ProEzbqPbzuqnan5Jmyq_PEJ8.2PxEi7

UI TEST REPORT: ✅ PASSED

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49442/test_status_UI.html?versionId=VRB0uQTNSdKOG5kyrmQlWXMlGrd4_Hu2

UI TEST REPORT: ❌ FAILED

1x failed features: • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (1:12 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49428/test_status_UI.html?versionId=u6YNATlcttGs5ZNYQ.9G8JN2gQXKpuuO

UI TEST REPORT: ❌ FAILED

1x failed features: • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (2:43 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49411/test_status_UI.html?versionId=EwR8DLOCh9oyT70g5O.cyHnDwATxUiJc

UI TEST REPORT: ❌ FAILED

1x failed features: • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (1:08 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49396/test_status_UI.html?versionId=l24C4jiVigvJwuI0EVQxP7oQv3.ApnpB

UI TEST REPORT: ❌ FAILED

1x failed features: • FAILED: Chrome_star_labs_mix_move_ai ☁ Log on S3 (4:34 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49378/test_status_UI.html?versionId=MGIV8IgIffDlHDBsKuOCqhBdzVdF3aS6

UI TEST REPORT: ✅ PASSED

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49339/test_status_UI.html?versionId=eyWT2d4nLSR5rUvFRWN8jA4CYmrI_MhV

UI TEST REPORT: ❌ FAILED

12x failed features: • FAILED: Chrome_teacher_tools_rubrics_ai_evaluate_student_code ☁ Log on S3 (0:13 minutes, 2 failed with 2 reruns) • FAILED: Chrome_teacher_tools_level_types_multiple_choice_contained_levels ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_level_types_free_response_contained_levels ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_level_types_level_group_multi_page ☁ Log on S3 (0:13 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_gamelab_libraries ☁ Log on S3 (0:11 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_mix_move_ai ☁ Log on S3 (0:11 minutes, 1 failed with 2 reruns) • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_student_learning_hour_of_code_starwars ☁ Log on S3 (0:11 minutes, 1 failed with 2 reruns) • FAILED: Chrome_xteam_gdpr_dialog ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_star_labs_manage_assets ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_teacher_tools_version_history ☁ Log on S3 (0:10 minutes, 1 failed with 2 reruns) • FAILED: Chrome_acquisition_products_curriculum_catalog_assign_unassign ☁ Log on S3 (0:06 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49225/test_status_UI.html?versionId=2SmH3QTvuZswSmDK6buuIrr05yq4q7Tp

couldn't extract ui test report

couldn't extract ui test report

couldn't extract ui test report

couldn't extract ui test report

couldn't extract ui test report

couldn't extract ui test report

couldn't extract ui test report

couldn't extract ui test report

UI TEST REPORT: ❌ FAILED

1x failed features: • FAILED: Chrome_code_tools_pythonlab_pythonlab_run ☁ Log on S3 (1:05 minutes, 1 failed with 2 reruns)

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/49023/test_status_UI.html?versionId=NHI.ik2c5S2SfaFuBHa_GXN9Se4XFNEa

UI TEST REPORT: ✅ PASSED

UI Test Status Page (permalink for this run): https://cucumber-logs.s3.amazonaws.com/circle/48951/test_status_UI.html?versionId=ogLtBL3NjxRkyB52QiN7HABokhqOIDbU

Unit Tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment