Flaky Tests - Mar 2020

flaky-tests-03-2020.md

🔺 src/cy/commands/actions/click#click.loglogs { multiple: true} options

https://dashboard.cypress.io/projects/ypt4pf/runs/9563/failures

Timed out retrying: coordsHistory must be at least 2 sets of coords

🔺src/cy/commands/waiting #wait alias argument errors throws when waiting for 2nd response to route:

https://circleci.com/gh/cypress-io/cypress/267655

AssertionError: expected 'Timed out retrying: cy.wait() timed out waiting 200ms for the 1st response to the route: \'response\'. No response ever occurred.' to include 'cy.wait() timed out waiting 200ms for the 2nd response to the route: \'response\'. No response ever occurred.' 

🔺src/cy/commands/navigation #reload errors logs once on failure:

https://circleci.com/gh/cypress-io/cypress/267844#tests/containers/2

Error: Timed out after '100ms'. The done() callback was never invoked! (and Mocha's done() called multiple times)
      at eval (cypress:///../driver/src/cypress/mocha.js:181:25)

🔺src/cy/commands/navigation #reload errors throws passing more than 2 args:

https://circleci.com/gh/cypress-io/cypress/267844#tests/containers/2

Error: Timed out after '100ms'. The done() callback was never invoked! (and Mocha's done() called multiple times)
      at eval (cypress:///../driver/src/cypress/mocha.js:181:25)

🔺server/test/integration/server_spec.coffee

Server resolving url both can go from https -> file -> https without a port - can go from https -> file -> https without a port

https://circleci.com/gh/cypress-io/cypress/268001#tests/containers/1

Error: timeout of 5000ms exceeded. Ensure the done() callback is being called in this test.
    at listOnTimeout (internal/timers.js:1:1)
    at processTimers (internal/timers.js:1:1)

🔺src/cy/commands/navigation #go .log "before each" hook for "logs go":

https://circleci.com/gh/cypress-io/cypress/269777#tests/containers/3

Error: Cypress command timeout of '4000ms' exceeded.
Because this error occurred during a 'before each' hook we are skipping the remaining tests in the current suite: '.log'
      at eval (cypress:///../driver/src/cypress/mocha.js:181:25)

🔺/root/cypress/packages/https-proxy/test/integration/proxy_spec.js

https://circleci.com/gh/cypress-io/cypress/272395

Error: Timeout of 10000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves.
    at listOnTimeout (internal/timers.js:531:17)
    at processTimers (internal/timers.js:475:7)

🔺/root/cypress/packages/server/test/e2e/5_screenshots_spec.coffee

https://circleci.com/gh/cypress-io/cypress/272391

AssertionError: expected 177227 not to be close to 181536 +/- 5000
    at test/e2e/5_screenshots_spec.coffee:99:38
    at callback (/root/cypress/node_modules/graceful-fs/polyfills.js:295:20)
    at FSReqCallback.oncomplete (fs.js:166:5)
From previous event:
    at test/e2e/5_screenshots_spec.coffee:94:10
    at copyDirItems (/root/cypress/node_modules/fs-extra/lib/copy/copy.js:151:21)
    at /root/cypress/node_modules/fs-extra/lib/copy/copy.js:163:14
    at /root/cypress/node_modules/graceful-fs/polyfills.js:243:20
    at FSReqCallback.oncomplete (fs.js:153:23)
From previous event:
    at Object.onRun (test/e2e/5_screenshots_spec.coffee:69:8)
    at Context.<anonymous> (test/support/helpers/e2e.js:336:22)
From previous event:
    at processImmediate (internal/timers.js:439:21)