Uploaded image for project: 'camunda BPM'
  1. camunda BPM
  2. CAM-13673

BatchMigrationTest is unstable on CRDB

    XMLWordPrintable

Details

    • Task
    • Resolution: Unresolved
    • L3 - Default
    • None
    • None
    • None

    Description

      Acceptance Criteria (Required on creation):

      BatchMigrationTest.testMigrationJobsExecutionByJobExecutorWithAuthorizationEnabledAndTenantUsesCockroachDB usually fails with:

      Error
      time limit of 30000 was exceeded
      Stacktrace
      java.lang.AssertionError: time limit of 30000 was exceeded
      	at org.camunda.bpm.engine.test.api.runtime.migration.batch.BatchMigrationTest.testMigrationJobsExecutionByJobExecutorWithAuthorizationEnabledAndTenantUsesCockroachDB(BatchMigrationTest.java:424)
      ...
      Standard Output
      04:50:59.264 [JobExecutor[org.camunda.bpm.engine.impl.jobexecutor.DefaultJobExecutor]] ERROR org.camunda.bpm.engine.jobexecutor - ENGINE-14019 Exception during job acquisition ENGINE-03104 Could not commit transaction. The transaction needs to be retried.
      org.camunda.bpm.engine.CrdbTransactionRetryException: ENGINE-03104 Could not commit transaction. The transaction needs to be retried.
      	at org.camunda.bpm.engine.impl.db.EnginePersistenceLogger.crdbTransactionRetryExceptionOnCommit(EnginePersistenceLogger.java:811) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:202) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:119) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.ProcessApplicationContextInterceptor.execute(ProcessApplicationContextInterceptor.java:70) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandCounterInterceptor.execute(CommandCounterInterceptor.java:35) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:33) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CrdbTransactionRetryInterceptor.execute(CrdbTransactionRetryInterceptor.java:46) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.acquireJobs(SequentialJobAcquisitionRunnable.java:164) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.run(SequentialJobAcquisitionRunnable.java:80) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_181]
      Caused by: org.camunda.bpm.engine.ProcessEngineException: An exception occurred in the persistence layer. Please check the server logs for a detailed message and the entire exception stack trace.
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.wrapPersistenceException(ExceptionUtil.java:263) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.doWithExceptionWrapper(ExceptionUtil.java:257) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.db.sql.DbSqlSession.commit(DbSqlSession.java:461) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.cfg.standalone.StandaloneTransactionContext.commit(StandaloneTransactionContext.java:67) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:197) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	... 8 common frames omitted
      Caused by: org.apache.ibatis.exceptions.PersistenceException: 
      ### Error committing transaction.  Cause: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=50667688 key=/Table/58/1/"870673"/0 pri=0.01657363 epo=0 ts=1624589459.201180246,1 min=1624589459.131454312,0 seq=2} lock=true stat=PENDING rts=1624589459.131454312,0 wto=false max=1624589459.131454312,0
      ### Cause: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=50667688 key=/Table/58/1/"870673"/0 pri=0.01657363 epo=0 ts=1624589459.201180246,1 min=1624589459.131454312,0 seq=2} lock=true stat=PENDING rts=1624589459.131454312,0 wto=false max=1624589459.131454312,0
      	at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:226) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:217) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.camunda.bpm.engine.impl.db.sql.DbSqlSession.lambda$commit$7(DbSqlSession.java:462) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.doWithExceptionWrapper(ExceptionUtil.java:254) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	... 11 common frames omitted
      Caused by: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=50667688 key=/Table/58/1/"870673"/0 pri=0.01657363 epo=0 ts=1624589459.201180246,1 min=1624589459.131454312,0 seq=2} lock=true stat=PENDING rts=1624589459.131454312,0 wto=false max=1624589459.131454312,0
      	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2505) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2241) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:310) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.jdbc.PgConnection.executeTransactionCommand(PgConnection.java:829) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.jdbc.PgConnection.commit(PgConnection.java:851) ~[postgresql-42.2.9.jar:42.2.9]
      	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source) ~[na:na]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_181]
      	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_181]
      	at org.apache.ibatis.datasource.pooled.PooledConnection.invoke(PooledConnection.java:255) ~[mybatis-3.5.6.jar:3.5.6]
      	at com.sun.proxy.$Proxy20.commit(Unknown Source) ~[na:na]
      	at org.apache.ibatis.transaction.jdbc.JdbcTransaction.commit(JdbcTransaction.java:72) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.executor.BaseExecutor.commit(BaseExecutor.java:244) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.executor.CachingExecutor.commit(CachingExecutor.java:119) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:223) ~[mybatis-3.5.6.jar:3.5.6]
      	... 14 common frames omitted
      04:50:59.624 [pool-28-thread-1] WARN  org.camunda.bpm.engine.jobexecutor - ENGINE-14006 Exception while executing job 870658: CrdbTransactionRetryException. To see the full stacktrace set logging level to DEBUG.
      ...
      04:51:02.618 [JobExecutor[org.camunda.bpm.engine.impl.jobexecutor.DefaultJobExecutor]] ERROR org.camunda.bpm.engine.jobexecutor - ENGINE-14019 Exception during job acquisition ENGINE-03104 Could not commit transaction. The transaction needs to be retried.
      org.camunda.bpm.engine.CrdbTransactionRetryException: ENGINE-03104 Could not commit transaction. The transaction needs to be retried.
      	at org.camunda.bpm.engine.impl.db.EnginePersistenceLogger.crdbTransactionRetryExceptionOnCommit(EnginePersistenceLogger.java:811) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:202) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:119) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.ProcessApplicationContextInterceptor.execute(ProcessApplicationContextInterceptor.java:70) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandCounterInterceptor.execute(CommandCounterInterceptor.java:35) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:33) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CrdbTransactionRetryInterceptor.execute(CrdbTransactionRetryInterceptor.java:46) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.acquireJobs(SequentialJobAcquisitionRunnable.java:164) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.run(SequentialJobAcquisitionRunnable.java:80) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_181]
      Caused by: org.camunda.bpm.engine.ProcessEngineException: An exception occurred in the persistence layer. Please check the server logs for a detailed message and the entire exception stack trace.
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.wrapPersistenceException(ExceptionUtil.java:263) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.doWithExceptionWrapper(ExceptionUtil.java:257) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.db.sql.DbSqlSession.commit(DbSqlSession.java:461) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.cfg.standalone.StandaloneTransactionContext.commit(StandaloneTransactionContext.java:67) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:197) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	... 8 common frames omitted
      Caused by: org.apache.ibatis.exceptions.PersistenceException: 
      ### Error committing transaction.  Cause: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=5f085830 key=/Table/58/1/"870664"/0 pri=0.00317530 epo=0 ts=1624589462.541185211,1 min=1624589462.541180841,0 seq=3} lock=true stat=PENDING rts=1624589462.541180841,0 wto=false max=1624589462.541180841,0
      ### Cause: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=5f085830 key=/Table/58/1/"870664"/0 pri=0.00317530 epo=0 ts=1624589462.541185211,1 min=1624589462.541180841,0 seq=3} lock=true stat=PENDING rts=1624589462.541180841,0 wto=false max=1624589462.541180841,0
      	at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:226) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:217) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.camunda.bpm.engine.impl.db.sql.DbSqlSession.lambda$commit$7(DbSqlSession.java:462) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.doWithExceptionWrapper(ExceptionUtil.java:254) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	... 11 common frames omitted
      Caused by: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=5f085830 key=/Table/58/1/"870664"/0 pri=0.00317530 epo=0 ts=1624589462.541185211,1 min=1624589462.541180841,0 seq=3} lock=true stat=PENDING rts=1624589462.541180841,0 wto=false max=1624589462.541180841,0
      	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2505) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2241) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:310) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.jdbc.PgConnection.executeTransactionCommand(PgConnection.java:829) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.jdbc.PgConnection.commit(PgConnection.java:851) ~[postgresql-42.2.9.jar:42.2.9]
      	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source) ~[na:na]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_181]
      	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_181]
      	at org.apache.ibatis.datasource.pooled.PooledConnection.invoke(PooledConnection.java:255) ~[mybatis-3.5.6.jar:3.5.6]
      	at com.sun.proxy.$Proxy20.commit(Unknown Source) ~[na:na]
      	at org.apache.ibatis.transaction.jdbc.JdbcTransaction.commit(JdbcTransaction.java:72) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.executor.BaseExecutor.commit(BaseExecutor.java:244) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.executor.CachingExecutor.commit(CachingExecutor.java:119) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:223) ~[mybatis-3.5.6.jar:3.5.6]
      	... 14 common frames omitted
      04:51:02.977 [pool-28-thread-3] WARN  org.camunda.bpm.engine.jobexecutor - ENGINE-14006 Exception while executing job 870670: CrdbTransactionRetryException. To see the full stacktrace set logging level to DEBUG.
      ...
      04:51:05.182 [JobExecutor[org.camunda.bpm.engine.impl.jobexecutor.DefaultJobExecutor]] ERROR org.camunda.bpm.engine.jobexecutor - ENGINE-14019 Exception during job acquisition ENGINE-03104 Could not commit transaction. The transaction needs to be retried.
      org.camunda.bpm.engine.CrdbTransactionRetryException: ENGINE-03104 Could not commit transaction. The transaction needs to be retried.
      	at org.camunda.bpm.engine.impl.db.EnginePersistenceLogger.crdbTransactionRetryExceptionOnCommit(EnginePersistenceLogger.java:811) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:202) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:119) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.ProcessApplicationContextInterceptor.execute(ProcessApplicationContextInterceptor.java:70) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandCounterInterceptor.execute(CommandCounterInterceptor.java:35) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:33) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CrdbTransactionRetryInterceptor.execute(CrdbTransactionRetryInterceptor.java:46) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.acquireJobs(SequentialJobAcquisitionRunnable.java:164) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.run(SequentialJobAcquisitionRunnable.java:80) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_181]
      Caused by: org.camunda.bpm.engine.ProcessEngineException: An exception occurred in the persistence layer. Please check the server logs for a detailed message and the entire exception stack trace.
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.wrapPersistenceException(ExceptionUtil.java:263) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.doWithExceptionWrapper(ExceptionUtil.java:257) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.db.sql.DbSqlSession.commit(DbSqlSession.java:461) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.cfg.standalone.StandaloneTransactionContext.commit(StandaloneTransactionContext.java:67) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:197) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	... 8 common frames omitted
      Caused by: org.apache.ibatis.exceptions.PersistenceException: 
      ### Error committing transaction.  Cause: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=d8e78078 key=/Table/58/1/"870655"/0 pri=0.01132325 epo=0 ts=1624589465.114255692,1 min=1624589465.114250279,0 seq=2} lock=true stat=PENDING rts=1624589465.114250279,0 wto=false max=1624589465.114250279,0
      ### Cause: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=d8e78078 key=/Table/58/1/"870655"/0 pri=0.01132325 epo=0 ts=1624589465.114255692,1 min=1624589465.114250279,0 seq=2} lock=true stat=PENDING rts=1624589465.114250279,0 wto=false max=1624589465.114250279,0
      	at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:226) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:217) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.camunda.bpm.engine.impl.db.sql.DbSqlSession.lambda$commit$7(DbSqlSession.java:462) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.doWithExceptionWrapper(ExceptionUtil.java:254) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	... 11 common frames omitted
      Caused by: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=d8e78078 key=/Table/58/1/"870655"/0 pri=0.01132325 epo=0 ts=1624589465.114255692,1 min=1624589465.114250279,0 seq=2} lock=true stat=PENDING rts=1624589465.114250279,0 wto=false max=1624589465.114250279,0
      	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2505) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2241) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:310) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.jdbc.PgConnection.executeTransactionCommand(PgConnection.java:829) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.jdbc.PgConnection.commit(PgConnection.java:851) ~[postgresql-42.2.9.jar:42.2.9]
      	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source) ~[na:na]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_181]
      	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_181]
      	at org.apache.ibatis.datasource.pooled.PooledConnection.invoke(PooledConnection.java:255) ~[mybatis-3.5.6.jar:3.5.6]
      	at com.sun.proxy.$Proxy20.commit(Unknown Source) ~[na:na]
      	at org.apache.ibatis.transaction.jdbc.JdbcTransaction.commit(JdbcTransaction.java:72) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.executor.BaseExecutor.commit(BaseExecutor.java:244) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.executor.CachingExecutor.commit(CachingExecutor.java:119) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:223) ~[mybatis-3.5.6.jar:3.5.6]
      	... 14 common frames omitted
      04:51:05.483 [pool-28-thread-1] WARN  org.camunda.bpm.engine.jobexecutor - ENGINE-14006 Exception while executing job 870673: CrdbTransactionRetryException. To see the full stacktrace set logging level to DEBUG.
      ...
      04:51:10.439 [JobExecutor[org.camunda.bpm.engine.impl.jobexecutor.DefaultJobExecutor]] ERROR org.camunda.bpm.engine.jobexecutor - ENGINE-14019 Exception during job acquisition ENGINE-03104 Could not commit transaction. The transaction needs to be retried.
      org.camunda.bpm.engine.CrdbTransactionRetryException: ENGINE-03104 Could not commit transaction. The transaction needs to be retried.
      	at org.camunda.bpm.engine.impl.db.EnginePersistenceLogger.crdbTransactionRetryExceptionOnCommit(EnginePersistenceLogger.java:811) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:202) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:119) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.ProcessApplicationContextInterceptor.execute(ProcessApplicationContextInterceptor.java:70) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandCounterInterceptor.execute(CommandCounterInterceptor.java:35) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:33) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CrdbTransactionRetryInterceptor.execute(CrdbTransactionRetryInterceptor.java:46) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.acquireJobs(SequentialJobAcquisitionRunnable.java:164) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.run(SequentialJobAcquisitionRunnable.java:80) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_181]
      Caused by: org.camunda.bpm.engine.ProcessEngineException: An exception occurred in the persistence layer. Please check the server logs for a detailed message and the entire exception stack trace.
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.wrapPersistenceException(ExceptionUtil.java:263) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.doWithExceptionWrapper(ExceptionUtil.java:257) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.db.sql.DbSqlSession.commit(DbSqlSession.java:461) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.cfg.standalone.StandaloneTransactionContext.commit(StandaloneTransactionContext.java:67) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:197) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	... 8 common frames omitted
      Caused by: org.apache.ibatis.exceptions.PersistenceException: 
      ### Error committing transaction.  Cause: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=7be36534 key=/Table/58/1/"870682"/0 pri=0.00846875 epo=0 ts=1624589470.374860054,1 min=1624589470.313429370,0 seq=2} lock=true stat=PENDING rts=1624589470.313429370,0 wto=false max=1624589470.313429370,0
      ### Cause: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=7be36534 key=/Table/58/1/"870682"/0 pri=0.00846875 epo=0 ts=1624589470.374860054,1 min=1624589470.313429370,0 seq=2} lock=true stat=PENDING rts=1624589470.313429370,0 wto=false max=1624589470.313429370,0
      	at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:226) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:217) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.camunda.bpm.engine.impl.db.sql.DbSqlSession.lambda$commit$7(DbSqlSession.java:462) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	at org.camunda.bpm.engine.impl.util.ExceptionUtil.doWithExceptionWrapper(ExceptionUtil.java:254) ~[camunda-engine-7.15.3-SNAPSHOT.jar:7.15.3-SNAPSHOT]
      	... 11 common frames omitted
      Caused by: org.postgresql.util.PSQLException: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE): "sql txn" meta={id=7be36534 key=/Table/58/1/"870682"/0 pri=0.00846875 epo=0 ts=1624589470.374860054,1 min=1624589470.313429370,0 seq=2} lock=true stat=PENDING rts=1624589470.313429370,0 wto=false max=1624589470.313429370,0
      	at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2505) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2241) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:310) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.jdbc.PgConnection.executeTransactionCommand(PgConnection.java:829) ~[postgresql-42.2.9.jar:42.2.9]
      	at org.postgresql.jdbc.PgConnection.commit(PgConnection.java:851) ~[postgresql-42.2.9.jar:42.2.9]
      	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source) ~[na:na]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_181]
      	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_181]
      	at org.apache.ibatis.datasource.pooled.PooledConnection.invoke(PooledConnection.java:255) ~[mybatis-3.5.6.jar:3.5.6]
      	at com.sun.proxy.$Proxy20.commit(Unknown Source) ~[na:na]
      	at org.apache.ibatis.transaction.jdbc.JdbcTransaction.commit(JdbcTransaction.java:72) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.executor.BaseExecutor.commit(BaseExecutor.java:244) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.executor.CachingExecutor.commit(CachingExecutor.java:119) ~[mybatis-3.5.6.jar:3.5.6]
      	at org.apache.ibatis.session.defaults.DefaultSqlSession.commit(DefaultSqlSession.java:223) ~[mybatis-3.5.6.jar:3.5.6]
      	... 14 common frames omitted
      04:51:10.725 [pool-28-thread-3] WARN  org.camunda.bpm.engine.jobexecutor - ENGINE-14006 Exception while executing job 870664: CrdbTransactionRetryException. To see the full stacktrace set logging level to DEBUG.
      ...
      04:51:21.724 [main] INFO  org.camunda.bpm.engine.jobexecutor - ENGINE-14015 Shutting down the JobExecutor[org.camunda.bpm.engine.impl.jobexecutor.DefaultJobExecutor]
      04:51:21.734 [JobExecutor[org.camunda.bpm.engine.impl.jobexecutor.DefaultJobExecutor]] INFO  org.camunda.bpm.engine.jobexecutor - ENGINE-14020 JobExecutor[org.camunda.bpm.engine.impl.jobexecutor.DefaultJobExecutor] stopped job acquisition
      04:51:22.093 [pool-28-thread-1] WARN  org.camunda.bpm.engine.jobexecutor - ENGINE-14006 Exception while executing job 870661: CrdbTransactionRetryException. To see the full stacktrace set logging level to DEBUG.
      04:51:22.141 [pool-28-thread-3] WARN  org.camunda.bpm.engine.jobexecutor - ENGINE-14006 Exception while executing job 870670: CrdbTransactionRetryException. To see the full stacktrace set logging level to DEBUG.
      04:51:22.169 [pool-28-thread-2] WARN  org.camunda.bpm.engine.jobexecutor - ENGINE-14006 Exception while executing job 870682: CrdbTransactionRetryException. To see the full stacktrace set logging level to DEBUG.
      

      Hints (Optional):

      The long execution time of SQL queries on CRDB is a known issue (CAM-12461, CAM-12239). However, the test causes failing stages in sidetrack pipeline.

      mgm-controller-panel

        This is the controller panel for Smart Panels app

        Attachments

          Issue Links

            Activity

              People

                Unassigned Unassigned
                yana.vasileva Yana Vasileva
                Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                  Created:
                  Updated:

                  Salesforce