Uploaded image for project: 'Camunda Optimize'
  1. Camunda Optimize
  2. OPT-1622

Create Upgrade Ingest pipeline

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: L3 - Default L3 - Default
    • None
    • None
    • backend
    • None
    • Not defined

      AT:

      • To prevent redindexing the same index several times, we should use an ingest pipeline per release
      • each migration task will be implemented as an processor

      As a rough guideline the upgrade might be performed like this with piplines in place per type:
      // #1 create target index with new mappings per type
      // #2 create ingest pipeline for the migration fromVerion->toVersion with potential document modification processors per type
      // #3 execute reindex per type using pipeline
      // #4 delete ingest pipeline
      // #5 update the alias to point to target index and remove alias from old index
      // #5 delete old index

      Note:
      we could also postpone the alias switch and the delete of the old index to the very end of the upgrade, after all types have been migrated and only then update the alias + update the version in metadata + delete old indexes. This will ensure the upgrade is failsafe and we never end up with an inconsistent state of some indexes migrated and other not.

        This is the controller panel for Smart Panels app

              Unassigned Unassigned
              sebastian.bathke Sebastian Bathke
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: