Uploaded image for project: 'Camunda Optimize'
  1. Camunda Optimize
  2. OPT-3972

Upgrade index exists check fails for many instances being present

    XMLWordPrintable

    Details

    • Type: Bug Report
    • Status: Done
    • Priority: L3 - Default
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.0
    • Component/s: backend
    • Labels:
      None
    • Epic Link:
    • Effort:
      Not defined

      Description

      Context:
      While playing with bigger engine datasets and event data I encountered this error:

      17:52:11.806 [main] ERROR o.c.o.upgrade.main.UpgradeProcedure - Error while executing upgrade from 3.0.0 to 3.1.0
      org.elasticsearch.ElasticsearchStatusException: method [HEAD], host [http://localhost:9200], URI [/optimize-alert,optimize-business-key,optimize-collection,optimize-dashboard,optimize-dashboard-share,optimize-decision-definition,optimize-decision-instance,optimize-license,optimize-metadata,optimize-onboarding-state,optimize-process-definition,optimize-process-instance,optimize-report-share,optimize-tenant,optimize-terminated-user-session,optimize-variable-update-instance,optimize-event,optimize-event-process-definition,optimize-event-process-mapping,optimize-event-process-publish-state,optimize-import-index,optimize-timestamp-based-import-index,optimize-combined-report,optimize-single-decision-report,optimize-single-process-report,optimize-camunda-activity-event-multiparallelgateways,optimize-camunda-activity-event-groupelements,optimize-camunda-activity-event-export_insurance_booking,optimize-camunda-activity-event-transshipment_arrangement,optimize-camunda-activity-event-review_case,optimize-camunda-activity-event-multiinstancesubprocess,optimize-camunda-activity-event-embeddedsubprocess,optimize-camunda-activity-event-branch_analysis_process,optimize-camunda-activity-event-leadqualification,optimize-camunda-activity-event-process-request,optimize-camunda-activity-event-bookrequest,optimize-camunda-activity-event-pick_up_handling,optimize-camunda-activity-event-extended-order-process,optimize-camunda-activity-event-order_confirmation,optimize-camunda-activity-event-document_check_handling,optimize-camunda-activity-event-call_branch_analysis_process,optimize-camunda-activity-event-bookrequest-1-tenant,optimize-camunda-activity-event-analysistestingprocess,optimize-camunda-activity-event-bookrequest-suspended-instances,optimize-camunda-activity-event-authorization_arrangement,optimize-camunda-activity-event-invoice,optimize-camunda-activity-event-hiring-demo,optimize-camunda-activity-event-driprocesswithloadsofvariables,optimize-camunda-activity-event-invoice-2-tenants-and-shared,optimize-camunda-activity-event-kontaktdaten-aendern,optimize-camunda-activity-event-hiring-demo-5-tenants,optimize-event-sequence-count-bookrequest-1-tenant,optimize-event-sequence-count-embeddedsubprocess,optimize-event-sequence-count-branch_analysis_process,optimize-event-sequence-count-invoice-2-tenants-and-shared,optimize-event-sequence-count-bookrequest,optimize-event-sequence-count-groupelements,optimize-event-sequence-count-call_branch_analysis_process,optimize-event-sequence-count-driprocesswithloadsofvariables,optimize-event-sequence-count-bookrequest-suspended-instances,optimize-event-sequence-count-kontaktdaten-aendern,optimize-event-sequence-count-document_check_handling,optimize-event-sequence-count-external,optimize-event-sequence-count-authorization_arrangement,optimize-event-sequence-count-analysistestingprocess,optimize-event-sequence-count-hiring-demo,optimize-event-sequence-count-hiring-demo-5-tenants,optimize-event-sequence-count-invoice,optimize-event-sequence-count-leadqualification,optimize-event-sequence-count-export_insurance_booking,optimize-event-sequence-count-extended-order-process,optimize-event-trace-state-document_check_handling,optimize-event-trace-state-kontaktdaten-aendern,optimize-event-trace-state-bookrequest,optimize-event-trace-state-external,optimize-event-trace-state-invoice-2-tenants-and-shared,optimize-event-trace-state-call_branch_analysis_process,optimize-event-trace-state-invoice,optimize-event-trace-state-branch_analysis_process,optimize-event-trace-state-bookrequest-suspended-instances,optimize-event-trace-state-hiring-demo-5-tenants,optimize-event-trace-state-groupelements,optimize-event-trace-state-bookrequest-1-tenant,optimize-event-trace-state-driprocesswithloadsofvariables,optimize-event-trace-state-extended-order-process,optimize-event-trace-state-hiring-demo,optimize-event-trace-state-authorization_arrangement,optimize-event-trace-state-export_insurance_booking,optimize-event-trace-state-leadqualification,optimize-event-trace-state-analysistestingprocess,optimize-event-trace-state-embeddedsubprocess?ignore_unavailable=false&expand_wildcards=open%2Cclosed&allow_no_indices=false], status line [HTTP/1.0 400 Bad Request]
      	at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:1680)
      	at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1446)
      	at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1418)
      	at org.elasticsearch.client.IndicesClient.exists(IndicesClient.java:782)
      	at org.camunda.optimize.service.es.OptimizeElasticsearchClient.exists(OptimizeElasticsearchClient.java:134)
      	at org.camunda.optimize.service.es.schema.ElasticSearchSchemaManager.indicesExist(ElasticSearchSchemaManager.java:97)
      	at org.camunda.optimize.service.es.schema.ElasticSearchSchemaManager.schemaExists(ElasticSearchSchemaManager.java:83)
      	at org.camunda.optimize.service.es.schema.ElasticSearchSchemaManager.initializeSchema(ElasticSearchSchemaManager.java:64)
      	at org.camunda.optimize.upgrade.plan.UpgradeExecutionPlan.execute(UpgradeExecutionPlan.java:92)
      	at org.camunda.optimize.upgrade.main.UpgradeProcedure.performUpgrade(UpgradeProcedure.java:43)
      	at org.camunda.optimize.upgrade.main.UpgradeMain.main(UpgradeMain.java:62)
      

      This is a result of the many event indices and the request path becoming too long.

      AT:

      • index exist query is performed in batches of a reasonable amount of indices (e.g. 10)

      Hint:

      • this only became possible recently as the schemamanager also cares about updated dynamic indices

        mgm-controller-panel

        This is the controller panel for Smart Panels app

          Attachments

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              sebastian.bathke Sebastian Bathke
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Salesforce