Uploaded image for project: 'Camunda Optimize'
  1. Camunda Optimize
  2. OPT-3253

Reduce the number of bulk ES requests during import

    XMLWordPrintable

    Details

      Description

      For the following import jobs, we make more than one bulk request to store the data across various indices:

      • CompletedActivityInstanceElasticsearchImportJob
      • RunningActivityInstanceElasticsearchImportJob
      • CompletedProcessInstanceElasticsearchImportJob
      • RunningProcessInstanceElasticsearchImportJob
      • VariableUpdateElasticsearchImportJob

      We should look at ways in which we can reduce the number of ES requests we make for each of these. One approach would be to make a more generic bulk request handler, with the jobs being responsible for getting these bulks out of the services they use. Context: https://github.com/camunda/camunda-optimize/pull/1591#discussion_r377191209.

      ATs:

      • Import jobs no longer make multiple bulk requests to ES

       

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            joshua.windels Joshua Windels
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: