Reduce the number of bulk ES requests during import

XMLWordPrintable

      For the following import jobs, we make more than one bulk request to store the data across various indices:

      • CompletedActivityInstanceElasticsearchImportJob
      • RunningActivityInstanceElasticsearchImportJob
      • CompletedProcessInstanceElasticsearchImportJob
      • RunningProcessInstanceElasticsearchImportJob
      • VariableUpdateElasticsearchImportJob

      We should look at ways in which we can reduce the number of ES requests we make for each of these. One approach would be to make a more generic bulk request handler, with the jobs being responsible for getting these bulks out of the services they use. Context: https://github.com/camunda/camunda-optimize/pull/1591#discussion_r377191209.

      ATs:

      • Import jobs no longer make multiple bulk requests to ES

       

            Assignee:
            Unassigned
            Reporter:
            Joshua Windels
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: