[OPT-7229] OpenSearch Schema is able to check and update indexes

Type: Task
Resolution: Fixed
Priority: L3 - Default
Fix Version/s: 3.12.0-alpha2
Affects Version/s: None
Component/s: None
Labels:
- current_release

Effort:
Not defined
Epic Link:
OpenSearch Support

When booting Optimize, the OpenSearch schema is able to check and update existing indexes, write/update the metadata by using the metadata service and is able to write/read the Optimize License

Testing Notes

Run

docker-compose -f docker-compose.yml --profile opensearch up -d

Start Optimize with
```
SPRING_PROFILES_ACTIVE=opensearch
```

The startup will fail and that's ok, BUT...
Check that all indexes were created in opensearch
1. For that check first the log messages during startup and see if there are logs of indexes being created and ultimately "Opensearch schema initialized successfully"
2. Check the Opensearch database with your favorite browser extension in localhost:9205 and see if the indexes are indeed there
3. Take some samples and check if mappings and aliases are created properly, e.g.
```
GET http://localhost:9205/INDEX_ALIAS_OR_NAME_HERE/_mappings
```
```
GET http://localhost:9205/INDEX_ALIAS_OR_NAME_HERE/_alias
```

Shutdown optimize
Restart optimize
Watch that no new errors show up in the logs
Do the same verifications as described in step 2 and make sure that everything is working the same

This is the controller panel for Smart Panels app

Giuliano Rodrigues Lima created issue - 01/Sep/23 11:53 AM

Giuliano Rodrigues Lima made changes - 01/Sep/23 1:45 PM

Description

Original: Based on src/main/java/org/camunda/optimize/service/es/schema

New: Based on src/main/java/org/camunda/optimize/service/es/schema
|./backend/src/test/java/org/camunda/optimize/service/schema/type/MyUpdatedEventIndex.java|

|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/DefaultIndexMappingCreator.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/ElasticSearchSchemaManager.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/ElasticsearchMetadataService.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/IndexMappingCreator.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/IndexSettingsBuilder.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/MappingMetadataUtil.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/PropertiesAppender.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/RequestOptionsProvider.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/AbstractDefinitionIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/AbstractInstanceIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/AlertIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/BusinessKeyIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/CollectionIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/DashboardIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/DashboardShareIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/DecisionDefinitionIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/DecisionInstanceIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ExternalProcessVariableIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/InstantPreviewDashboardMetadataIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/LicenseIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/MetadataIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/OnboardingStateIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ProcessDefinitionIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ProcessInstanceArchiveIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ProcessInstanceIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ProcessOverviewIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ReportShareIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/SettingsIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/TenantIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/TerminatedUserSessionIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/VariableLabelIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/VariableUpdateInstanceIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/CamundaActivityEventIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventProcessInstanceIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventProcessMappingIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventProcessPublishStateIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventSequenceCountIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventTraceStateIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/index/ImportIndexIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/index/PositionBasedImportIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/index/TimestampBasedImportIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/report/AbstractReportIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/report/CombinedReportIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/report/SingleDecisionReportIndex.java|
|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/report/SingleProcessReportIndex.java|

Giuliano Rodrigues Lima made changes - 21/Sep/23 4:38 PM

Status

Original: Triage [ 10612 ]

New: In Development [ 10312 ]

Giuliano Rodrigues Lima made changes - 21/Sep/23 4:38 PM

Assignee

New: Giuliano Rodrigues Lima [ giuliano.rodrigues-lima ]

Joshua Windels made changes - 10/Oct/23 1:56 PM

Labels

Original: current_release

Giuliano Rodrigues Lima made changes - 10/Oct/23 5:39 PM

Link

New: This issue is related to ~~OPT-7348~~ [ ~~OPT-7348~~ ]

Giuliano Rodrigues Lima made changes - 11/Oct/23 9:33 AM

Link

New: This issue is related to ~~OPT-7349~~ [ ~~OPT-7349~~ ]

Giuliano Rodrigues Lima made changes - 11/Oct/23 9:36 AM

Link

New: This issue depends on ~~OPT-7348~~ [ ~~OPT-7348~~ ]

Giuliano Rodrigues Lima made changes - 11/Oct/23 9:36 AM

Link

New: This issue depends on ~~OPT-7349~~ [ ~~OPT-7349~~ ]

Giuliano Rodrigues Lima made changes - 11/Oct/23 9:36 AM

Description	Original: Based on src/main/java/org/camunda/optimize/service/es/schema \|./backend/src/test/java/org/camunda/optimize/service/schema/type/MyUpdatedEventIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/DefaultIndexMappingCreator.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/ElasticSearchSchemaManager.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/ElasticsearchMetadataService.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/IndexMappingCreator.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/IndexSettingsBuilder.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/MappingMetadataUtil.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/PropertiesAppender.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/RequestOptionsProvider.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/AbstractDefinitionIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/AbstractInstanceIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/AlertIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/BusinessKeyIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/CollectionIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/DashboardIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/DashboardShareIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/DecisionDefinitionIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/DecisionInstanceIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ExternalProcessVariableIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/InstantPreviewDashboardMetadataIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/LicenseIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/MetadataIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/OnboardingStateIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ProcessDefinitionIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ProcessInstanceArchiveIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ProcessInstanceIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ProcessOverviewIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/ReportShareIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/SettingsIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/TenantIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/TerminatedUserSessionIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/VariableLabelIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/VariableUpdateInstanceIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/CamundaActivityEventIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventProcessInstanceIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventProcessMappingIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventProcessPublishStateIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventSequenceCountIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/events/EventTraceStateIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/index/ImportIndexIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/index/PositionBasedImportIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/index/TimestampBasedImportIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/report/AbstractReportIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/report/CombinedReportIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/report/SingleDecisionReportIndex.java\| \|./util/optimize-commons/src/main/java/org/camunda/optimize/service/es/schema/index/report/SingleProcessReportIndex.java\|	New: When booting Optimize, the OpenSearch schema is able to check and update existing indexes, write/update the metadata by using the metadata service and is able to write/read the Optimize License
Summary	Original: Create OpenSearch Schema	New: OpenSearch Schema is able to check and update indexes

Assignee:: Unassigned

Reporter:: Giuliano Rodrigues Lima

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Created:: 01/Sep/23 11:53 AM

Updated:: 27/Dec/23 1:26 PM

Resolved:: 08/Dec/23 10:06 AM

Camunda Optimize

Details

Description

Testing Notes

mgm-controller-panel

This is the controller panel for Smart Panels app

Attachments

Activity

People

Dates

Salesforce