Uploaded image for project: 'Camunda Optimize'
  1. Camunda Optimize
  2. OPT-3253

Reduce the number of bulk ES requests during import

    XMLWordPrintable

    Details

      Description

      For the following import jobs, we make more than one bulk request to store the data across various indices:

      • CompletedActivityInstanceElasticsearchImportJob
      • RunningActivityInstanceElasticsearchImportJob
      • CompletedProcessInstanceElasticsearchImportJob
      • RunningProcessInstanceElasticsearchImportJob
      • VariableUpdateElasticsearchImportJob

      We should look at ways in which we can reduce the number of ES requests we make for each of these. One approach would be to make a more generic bulk request handler, with the jobs being responsible for getting these bulks out of the services they use. Context: https://github.com/camunda/camunda-optimize/pull/1591#discussion_r377191209.

      ATs:

      • Import jobs no longer make multiple bulk requests to ES

       

        mgm-controller-panel

        This is the controller panel for Smart Panels app

          Attachments

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              joshua.windels Joshua Windels
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Salesforce