Context:
While playing with bigger engine datasets and event data I encountered this error:
17:52:11.806 [main] ERROR o.c.o.upgrade.main.UpgradeProcedure - Error while executing upgrade from 3.0.0 to 3.1.0 org.elasticsearch.ElasticsearchStatusException: method [HEAD], host [http://localhost:9200], URI [/optimize-alert,optimize-business-key,optimize-collection,optimize-dashboard,optimize-dashboard-share,optimize-decision-definition,optimize-decision-instance,optimize-license,optimize-metadata,optimize-onboarding-state,optimize-process-definition,optimize-process-instance,optimize-report-share,optimize-tenant,optimize-terminated-user-session,optimize-variable-update-instance,optimize-event,optimize-event-process-definition,optimize-event-process-mapping,optimize-event-process-publish-state,optimize-import-index,optimize-timestamp-based-import-index,optimize-combined-report,optimize-single-decision-report,optimize-single-process-report,optimize-camunda-activity-event-multiparallelgateways,optimize-camunda-activity-event-groupelements,optimize-camunda-activity-event-export_insurance_booking,optimize-camunda-activity-event-transshipment_arrangement,optimize-camunda-activity-event-review_case,optimize-camunda-activity-event-multiinstancesubprocess,optimize-camunda-activity-event-embeddedsubprocess,optimize-camunda-activity-event-branch_analysis_process,optimize-camunda-activity-event-leadqualification,optimize-camunda-activity-event-process-request,optimize-camunda-activity-event-bookrequest,optimize-camunda-activity-event-pick_up_handling,optimize-camunda-activity-event-extended-order-process,optimize-camunda-activity-event-order_confirmation,optimize-camunda-activity-event-document_check_handling,optimize-camunda-activity-event-call_branch_analysis_process,optimize-camunda-activity-event-bookrequest-1-tenant,optimize-camunda-activity-event-analysistestingprocess,optimize-camunda-activity-event-bookrequest-suspended-instances,optimize-camunda-activity-event-authorization_arrangement,optimize-camunda-activity-event-invoice,optimize-camunda-activity-event-hiring-demo,optimize-camunda-activity-event-driprocesswithloadsofvariables,optimize-camunda-activity-event-invoice-2-tenants-and-shared,optimize-camunda-activity-event-kontaktdaten-aendern,optimize-camunda-activity-event-hiring-demo-5-tenants,optimize-event-sequence-count-bookrequest-1-tenant,optimize-event-sequence-count-embeddedsubprocess,optimize-event-sequence-count-branch_analysis_process,optimize-event-sequence-count-invoice-2-tenants-and-shared,optimize-event-sequence-count-bookrequest,optimize-event-sequence-count-groupelements,optimize-event-sequence-count-call_branch_analysis_process,optimize-event-sequence-count-driprocesswithloadsofvariables,optimize-event-sequence-count-bookrequest-suspended-instances,optimize-event-sequence-count-kontaktdaten-aendern,optimize-event-sequence-count-document_check_handling,optimize-event-sequence-count-external,optimize-event-sequence-count-authorization_arrangement,optimize-event-sequence-count-analysistestingprocess,optimize-event-sequence-count-hiring-demo,optimize-event-sequence-count-hiring-demo-5-tenants,optimize-event-sequence-count-invoice,optimize-event-sequence-count-leadqualification,optimize-event-sequence-count-export_insurance_booking,optimize-event-sequence-count-extended-order-process,optimize-event-trace-state-document_check_handling,optimize-event-trace-state-kontaktdaten-aendern,optimize-event-trace-state-bookrequest,optimize-event-trace-state-external,optimize-event-trace-state-invoice-2-tenants-and-shared,optimize-event-trace-state-call_branch_analysis_process,optimize-event-trace-state-invoice,optimize-event-trace-state-branch_analysis_process,optimize-event-trace-state-bookrequest-suspended-instances,optimize-event-trace-state-hiring-demo-5-tenants,optimize-event-trace-state-groupelements,optimize-event-trace-state-bookrequest-1-tenant,optimize-event-trace-state-driprocesswithloadsofvariables,optimize-event-trace-state-extended-order-process,optimize-event-trace-state-hiring-demo,optimize-event-trace-state-authorization_arrangement,optimize-event-trace-state-export_insurance_booking,optimize-event-trace-state-leadqualification,optimize-event-trace-state-analysistestingprocess,optimize-event-trace-state-embeddedsubprocess?ignore_unavailable=false&expand_wildcards=open%2Cclosed&allow_no_indices=false], status line [HTTP/1.0 400 Bad Request] at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:1680) at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1446) at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1418) at org.elasticsearch.client.IndicesClient.exists(IndicesClient.java:782) at org.camunda.optimize.service.es.OptimizeElasticsearchClient.exists(OptimizeElasticsearchClient.java:134) at org.camunda.optimize.service.es.schema.ElasticSearchSchemaManager.indicesExist(ElasticSearchSchemaManager.java:97) at org.camunda.optimize.service.es.schema.ElasticSearchSchemaManager.schemaExists(ElasticSearchSchemaManager.java:83) at org.camunda.optimize.service.es.schema.ElasticSearchSchemaManager.initializeSchema(ElasticSearchSchemaManager.java:64) at org.camunda.optimize.upgrade.plan.UpgradeExecutionPlan.execute(UpgradeExecutionPlan.java:92) at org.camunda.optimize.upgrade.main.UpgradeProcedure.performUpgrade(UpgradeProcedure.java:43) at org.camunda.optimize.upgrade.main.UpgradeMain.main(UpgradeMain.java:62)
This is a result of the many event indices and the request path becoming too long.
AT:
- index exist query is performed in batches of a reasonable amount of indices (e.g. 10)
Hint:
- this only became possible recently as the schemamanager also cares about updated dynamic indices