Uploaded image for project: 'Camunda Optimize'
  1. Camunda Optimize
  2. OPT-3253

Reduce the number of bulk ES requests during import

    XMLWordPrintable

Details

    Description

      For the following import jobs, we make more than one bulk request to store the data across various indices:

      • CompletedActivityInstanceElasticsearchImportJob
      • RunningActivityInstanceElasticsearchImportJob
      • CompletedProcessInstanceElasticsearchImportJob
      • RunningProcessInstanceElasticsearchImportJob
      • VariableUpdateElasticsearchImportJob

      We should look at ways in which we can reduce the number of ES requests we make for each of these. One approach would be to make a more generic bulk request handler, with the jobs being responsible for getting these bulks out of the services they use. Context: https://github.com/camunda/camunda-optimize/pull/1591#discussion_r377191209.

      ATs:

      • Import jobs no longer make multiple bulk requests to ES

       

      mgm-controller-panel

        This is the controller panel for Smart Panels app

        Attachments

          Activity

            People

              Unassigned Unassigned
              joshua.windels Joshua Windels
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Salesforce