Ensure that optimize imports data correctly when the engine is actively producing new data under considerable load.
- the following scenario is tested:
- start the platform
- start Elasticsearch
- start the Optimize and with that automatically the import
- generate/start 100 000 process instances while the import is running
- compare the results with of the number of activity instances, process instance, process definitions, process definition xmls and variable instances are the same in the engine and in Optimize
- I can read documentation about how to start this test (e.g. in a readme)
- There is a jenkins job running nightly to execute this test.
- The qa/import-performance-tests already contain the code to check if the entitiy count in Optimize and the engine are the same. Maybe we can extract the code from there.
- the qa/data-generation module can be used to generate the 100 000 process instances with diagrams and variables.
- in the .ci/jobs you will find the jenkins jobs. Here you can use the performance-large-dataset job as a template since it is already running nightly.
This is the controller panel for Smart Panels app
|Improve import fetch to cope with concurrent engine updates
|Create QA test that verifies the import catches all entities while concurrently generating data from the engine
|Create jenkins pipeline to execute the concurrent data generation import test
|Fix duplicate variables persisted during import