Uploaded image for project: 'Camunda Optimize'
  1. Camunda Optimize
  2. OPT-7402

Deleting a process before it was imported to Optimize blocks import

    • Not defined

      What/Where is the issue ?

      If you delete a definition before it was imported into Optimize, the import of data relating to this definition (if present) is blocked because Optimize relies on information to be retrieved about this definition from the engine but the definiiton doesn't exist there anymore.

      Environment: C7/ C8SaaS/ C8SM

      This has been observed in C7 but could theoretically also happen for C8 environments if Optimize was started after the retention period of zeebe records has passed.

      Optimize version : All - fix will be on master, 3.10 and 3.11
      ES version : Irrelevant
      OS + Browser version : Irrelevant

      Steps to reproduce C7:

      • Preconditions:
        • Optimize isnt running yet 
        • Engine is running
      • Steps:
        • Deploy a definition to the engine
        • Start some instances on that definition
        • Delete the definition from the engine 
        • Start Optimize
        • Observe import logs

      Steps to reproduce C8:

      • Preconditions:
        • Optimize isnt running yet 
        • Adjust retention period in zeebe to 5mins or so — may need to check with zeebe team if there's an env var for this
      • Steps:
        • Deploy a definition to Zeebe
        • Start some instances on that definition
        • Wait until the retention period has passed 
        • Start Optimize
        • Observe import logs

      Observed behavior:

      Various import pipelines throw a DefinitionNotFound error when they attempt to import data related to this definition (eg flownode data, userOperationsLogs etc)

      Expected behavior:

      Observe in logs: No exception during import

      Additional Information:

      The described issue does not occur when the definition was already imported to Optimize before it was deleted from the engine.

      GH epic: https://github.com/camunda/product-hub/issues/1730 

        This is the controller panel for Smart Panels app

            [OPT-7402] Deleting a process before it was imported to Optimize blocks import

            Helene Waechtler created issue -
            Helene Waechtler made changes -
            Status Original: Triage [ 10612 ] New: In Development [ 10312 ]
            Helene Waechtler made changes -
            Labels New: SUPPORT
            Helene Waechtler made changes -
            Link New: This issue causes SUPPORT-17463 [ SUPPORT-17463 ]
            Helene Waechtler made changes -
            Description Original: h3. What/Where is the issue ?

            If you delete a definition before it was imported into Optimize, the import of data relating to this definition (if present) is blocked because Optimize relies on information to be retrieved about this definition from the engine but the definiiton doesn't exist there anymore.
            h3. Environment: C7/ C8SaaS/ C8SM

            This has been observed in C7 but could theoretically also happen for C8 environments if Optimize was started after the retention period of zeebe records has passed.

            Optimize version : All
            ES version : Irrelevant
            OS + Browser version : Irrelevant
            h3. Steps to reproduce:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Deploy a definition to the engine
             -- Start some instances on that definition
             -- Delete the definition from the engine
             - Steps:
             -- Start Optimize
             -- Observe import logs

            h3. Observed behavior:

            Various import pipelines throw a DefinitionNotFound error when they attempt to import data related to this definition (eg flownode data, userOperationsLogs etc)
            h3. Expected behavior:

            Observe in logs: No exception during import,
            Observe in ES: data from the deleted definition should not be imported into Optimize. 
            h3. Additional Information:

            The described issue does not occur when the definition was already imported to Optimize before it was deleted from the engine.

            GH epic: [https://github.com/camunda/product-hub/issues/1730
            New: h3. What/Where is the issue ?

            If you delete a definition before it was imported into Optimize, the import of data relating to this definition (if present) is blocked because Optimize relies on information to be retrieved about this definition from the engine but the definiiton doesn't exist there anymore.
            h3. Environment: C7/ C8SaaS/ C8SM

            This has been observed in C7 but could theoretically also happen for C8 environments if Optimize was started after the retention period of zeebe records has passed.

            Optimize version : All
            ES version : Irrelevant
            OS + Browser version : Irrelevant
            h3. Steps to reproduce C7:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Engine is running
             - Steps:
             -- Deploy a definition to the engine
             -- Start some instances on that definition
             -- Delete the definition from the engine 
             -- Start Optimize
             -- Observe import logs

            h3. Steps to reproduce C8:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Adjust retention period in zeebe to 5mins or so — TODO add how
             - Steps:
             -- Deploy a definition to Zeebe
             -- Start some instances on that definition
             -- Wait until the retention period has passed 
             -- Start Optimize
             -- Observe import logs

            h3. Observed behavior:

            Various import pipelines throw a DefinitionNotFound error when they attempt to import data related to this definition (eg flownode data, userOperationsLogs etc)
            h3. Expected behavior:

            Observe in logs: No exception during import,
            Observe in ES: data from the deleted definition should not be imported into Optimize. 
            h3. Additional Information:

            The described issue does not occur when the definition was already imported to Optimize before it was deleted from the engine.

            GH epic: [https://github.com/camunda/product-hub/issues/1730
            Helene Waechtler made changes -
            Description Original: h3. What/Where is the issue ?

            If you delete a definition before it was imported into Optimize, the import of data relating to this definition (if present) is blocked because Optimize relies on information to be retrieved about this definition from the engine but the definiiton doesn't exist there anymore.
            h3. Environment: C7/ C8SaaS/ C8SM

            This has been observed in C7 but could theoretically also happen for C8 environments if Optimize was started after the retention period of zeebe records has passed.

            Optimize version : All
            ES version : Irrelevant
            OS + Browser version : Irrelevant
            h3. Steps to reproduce C7:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Engine is running
             - Steps:
             -- Deploy a definition to the engine
             -- Start some instances on that definition
             -- Delete the definition from the engine 
             -- Start Optimize
             -- Observe import logs

            h3. Steps to reproduce C8:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Adjust retention period in zeebe to 5mins or so — TODO add how
             - Steps:
             -- Deploy a definition to Zeebe
             -- Start some instances on that definition
             -- Wait until the retention period has passed 
             -- Start Optimize
             -- Observe import logs

            h3. Observed behavior:

            Various import pipelines throw a DefinitionNotFound error when they attempt to import data related to this definition (eg flownode data, userOperationsLogs etc)
            h3. Expected behavior:

            Observe in logs: No exception during import,
            Observe in ES: data from the deleted definition should not be imported into Optimize. 
            h3. Additional Information:

            The described issue does not occur when the definition was already imported to Optimize before it was deleted from the engine.

            GH epic: [https://github.com/camunda/product-hub/issues/1730
            New: h3. What/Where is the issue ?

            If you delete a definition before it was imported into Optimize, the import of data relating to this definition (if present) is blocked because Optimize relies on information to be retrieved about this definition from the engine but the definiiton doesn't exist there anymore.
            h3. Environment: C7/ C8SaaS/ C8SM

            This has been observed in C7 but could theoretically also happen for C8 environments if Optimize was started after the retention period of zeebe records has passed.

            Optimize version : All
            ES version : Irrelevant
            OS + Browser version : Irrelevant
            h3. Steps to reproduce C7:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Engine is running
             - Steps:
             -- Deploy a definition to the engine
             -- Start some instances on that definition
             -- Delete the definition from the engine 
             -- Start Optimize
             -- Observe import logs

            h3. Steps to reproduce C8:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Adjust retention period in zeebe to 5mins or so — TODO add how
             - Steps:
             -- Deploy a definition to Zeebe
             -- Start some instances on that definition
             -- Wait until the retention period has passed 
             -- Start Optimize
             -- Observe import logs

            h3. Observed behavior:

            Various import pipelines throw a DefinitionNotFound error when they attempt to import data related to this definition (eg flownode data, userOperationsLogs etc)
            h3. Expected behavior:

            Observe in logs: No exception during import
            h3. Additional Information:

            The described issue does not occur when the definition was already imported to Optimize before it was deleted from the engine.

            GH epic: [https://github.com/camunda/product-hub/issues/1730
            Helene Waechtler made changes -
            Description Original: h3. What/Where is the issue ?

            If you delete a definition before it was imported into Optimize, the import of data relating to this definition (if present) is blocked because Optimize relies on information to be retrieved about this definition from the engine but the definiiton doesn't exist there anymore.
            h3. Environment: C7/ C8SaaS/ C8SM

            This has been observed in C7 but could theoretically also happen for C8 environments if Optimize was started after the retention period of zeebe records has passed.

            Optimize version : All
            ES version : Irrelevant
            OS + Browser version : Irrelevant
            h3. Steps to reproduce C7:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Engine is running
             - Steps:
             -- Deploy a definition to the engine
             -- Start some instances on that definition
             -- Delete the definition from the engine 
             -- Start Optimize
             -- Observe import logs

            h3. Steps to reproduce C8:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Adjust retention period in zeebe to 5mins or so — TODO add how
             - Steps:
             -- Deploy a definition to Zeebe
             -- Start some instances on that definition
             -- Wait until the retention period has passed 
             -- Start Optimize
             -- Observe import logs

            h3. Observed behavior:

            Various import pipelines throw a DefinitionNotFound error when they attempt to import data related to this definition (eg flownode data, userOperationsLogs etc)
            h3. Expected behavior:

            Observe in logs: No exception during import
            h3. Additional Information:

            The described issue does not occur when the definition was already imported to Optimize before it was deleted from the engine.

            GH epic: [https://github.com/camunda/product-hub/issues/1730
            New: h3. What/Where is the issue ?

            If you delete a definition before it was imported into Optimize, the import of data relating to this definition (if present) is blocked because Optimize relies on information to be retrieved about this definition from the engine but the definiiton doesn't exist there anymore.
            h3. Environment: C7/ C8SaaS/ C8SM

            This has been observed in C7 but could theoretically also happen for C8 environments if Optimize was started after the retention period of zeebe records has passed.

            Optimize version : All
            ES version : Irrelevant
            OS + Browser version : Irrelevant
            h3. Steps to reproduce C7:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Engine is running
             - Steps:
             -- Deploy a definition to the engine
             -- Start some instances on that definition
             -- Delete the definition from the engine 
             -- Start Optimize
             -- Observe import logs

            h3. Steps to reproduce C8:
             - Preconditions:
             -- Optimize isnt running yet 
             -- Adjust retention period in zeebe to 5mins or so — may need to check with zeebe team if there's an env var for this
             - Steps:
             -- Deploy a definition to Zeebe
             -- Start some instances on that definition
             -- Wait until the retention period has passed 
             -- Start Optimize
             -- Observe import logs

            h3. Observed behavior:

            Various import pipelines throw a DefinitionNotFound error when they attempt to import data related to this definition (eg flownode data, userOperationsLogs etc)
            h3. Expected behavior:

            Observe in logs: No exception during import
            h3. Additional Information:

            The described issue does not occur when the definition was already imported to Optimize before it was deleted from the engine.

            GH epic: [https://github.com/camunda/product-hub/issues/1730
            Helene Waechtler made changes -
            Assignee Original: Helene Waechtler [ helene.waechtler ] New: Giuliano Rodrigues Lima [ giuliano.rodrigues-lima ]
            Status Original: In Development [ 10312 ] New: In Review [ 10212 ]
            Giuliano Rodrigues Lima made changes -
            Assignee Original: Giuliano Rodrigues Lima [ giuliano.rodrigues-lima ] New: Helene Waechtler [ helene.waechtler ]
            Status Original: In Review [ 10212 ] New: Rework [ 11413 ]
            Giuliano Rodrigues Lima made changes -
            Summary Original: Deleting a process before it was imported to Optimzie blocks import New: Deleting a process before it was imported to Optimize blocks import

              Unassigned Unassigned
              helene.waechtler Helene Waechtler
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: