Uploaded image for project: 'camunda BPM'
  1. camunda BPM
  2. CAM-9923

Spike: E2E testing frameworks

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Priority: L3 - Default
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 7.12.0, 7.12.0-alpha1
    • Component/s: webapp
    • Labels:
      None

      Description

      • Check out https://www.cypress.io/ and https://devexpress.github.io/testcafe/ (Cawemo uses the latter because it works with multiple browsers)
      • Choose one
      • Write an E2E test suite for Cockpit (should cover simple scenarions as well as scenarios that we can currently not test reliably - check with Michael)
      • Run a couple of times on Jenkins to assess build stability
      • Assess and compare with our current protractor-based solution; aspects: stability, ease of writing tests, test execution time, concept, supported browsers, ...

      Assesment
      General

      • supported Browsers
        Chrome, FF, IE11, Edge
        Does not require selenium, uses Proxy URL rewriting (similar to Selenium1, but handles edge cases better)
      • Automated testing on IE11 using Browserstack proved to be unreliable. This might be caused by Browserstack as well as TestCafe

      Selenium supports Chrome, FF, IE (but requires some configuration)

      • We only use Chrome tests: Writing cross-browser selectors proved to be a problem in the past, this can't be solved by TestCafe

      Pros

      • Little bootstraping, easy to run
      • Tests are easy to setup, offer all hooks currently used by our solution
      • Migration of tests was straight forward

      Cons

      • no nested Tests (Instead of nested describe, only offers fixture and test)
      • User Concept not compatible with our auth system
        Workaround: login for every test seperately
        makes simple tests (can be accessed, has tabs, ...) unneccessarily slow
        adds a potential point of failure
      • loading of Translate Strings can be an issue when starting every test without cache

        Attachments

          Activity

            People

            Assignee:
            martin.stamm Martin Stamm
            Reporter:
            thorben.lindhauer Thorben Lindhauer
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: