-
Type:
Task
-
Resolution: Unresolved
-
Priority:
L3 - Default
-
None
-
Affects Version/s: None
-
Component/s: backend
-
Not defined
Context:
Currently, when cleaning up instance data, we first retrieve all defintionKeys currently existing within the instanceData to be able to target the appropriate index for each instance cleanup step. We are currently using a limit of 10k for this retrieval which should be adequate for most use cases, but theoretically users could have more than 10k different definitions with "old" data that needs cleaned up, in which case this cleanup will not cover all data. We could instead consider using a composite aggregation and scrolling to retrieve all definitionKeys.
AT:
- Retrieve all definitionKeys with scrolling