Skip to main content

​
FlowX Engine

​
Partitioning and archiving configuration restructure

FlowX.AI v5.3.0 reorganizes the partitioning and archiving configuration structure. The scheduler.dataPartitioning section has been removed, and archiving settings are now under partitioning.archiving.

​
Variables to remove

If you are using environment variables to override FlowX Engine configuration, remove these variables:
Remove This VariableReason
SCHEDULER_DATAPARTITIONING_ENABLEDReplaced by FLOWX_DATA_PARTITIONING_ARCHIVING_ENABLED
SCHEDULER_DATAPARTITIONING_CRONEXPRESSIONReplaced by FLOWX_DATA_PARTITIONING_ARCHIVING_CRONEXPRESSION

​
Variables to replace

Old Variable NameNew Variable NameDefault ValueDescription
FLOWX_DATA_PARTITIONING_RETENTION_INTERVALSFLOWX_DATA_PARTITIONING_ARCHIVING_RETENTIONINTERVALS3Number of partition intervals to retain before archiving
FLOWX_DATA_PARTITIONING_DETACHED_PARTITION_COMPRESSIONFLOWX_DATA_PARTITIONING_ARCHIVING_DETACHED_PARTITION_COMPRESSIONOFFCompression level for archived partitions (Oracle only): OFF, BASIC, ADVANCED
FLOWX_DATA_PARTITIONING_MOVED_DATA_BATCH_SIZEFLOWX_DATA_PARTITIONING_ARCHIVING_MOVED_DATA_BATCH_SIZE5000Batch size for moving data during archiving (PostgreSQL only)

​
New variables structure

The archiving configuration is now nested under partitioning.archiving:
VariableDefault ValueDescription
FLOWX_DATA_PARTITIONING_ENABLEDfalseTurn on or off data partitioning
FLOWX_DATA_PARTITIONING_INTERVALMONTHPartition interval: DAY, WEEK, MONTH
FLOWX_DATA_PARTITIONING_ARCHIVING_ENABLEDfalseTurn on or off automatic archiving of old partitions
FLOWX_DATA_PARTITIONING_ARCHIVING_RETENTIONINTERVALS3Number of intervals to retain before archiving
FLOWX_DATA_PARTITIONING_ARCHIVING_CRONEXPRESSION0 0 1 * * ?Schedule expression for archiving operations (default: daily at 1:00 AM)
FLOWX_DATA_PARTITIONING_ARCHIVING_DETACHED_PARTITION_COMPRESSIONOFFCompression for archived partitions (Oracle only)
FLOWX_DATA_PARTITIONING_ARCHIVING_MOVED_DATA_BATCH_SIZE5000Batch size for data movement (PostgreSQL only)
Configuration structure changes:
  • Removed: scheduler.dataPartitioning section
  • Added: partitioning.archiving subsection with all archiving-related settings
  • Unchanged: Core partitioning settings (enabled, interval) remain at partitioning level
  • Moved: Archiving-specific settings (retention-intervals, cronExpression, detached-partition-compression, moved-data-batch-size) are now under partitioning.archiving
Action required if using partitioning:If you have enabled data partitioning in FlowX Engine, you must update your configuration:
  1. YAML configuration: Update your application.yml to follow the new structure (see Deployment Guidelines)
  2. Environment variables: Update variable names as shown in the tables above
  3. Deployment order: Update configuration before or immediately after upgrading to v5.3.0

​
Configuration examples

  • Environment Variables (Before)
  • Environment Variables (After)
# Old structure (v5.2 and earlier)
SCHEDULER_DATAPARTITIONING_ENABLED=true
SCHEDULER_DATAPARTITIONING_CRONEXPRESSION=0 0 1 * * ?
FLOWX_DATA_PARTITIONING_ENABLED=true
FLOWX_DATA_PARTITIONING_INTERVAL=MONTH
FLOWX_DATA_PARTITIONING_RETENTION_INTERVALS=3
FLOWX_DATA_PARTITIONING_DETACHED_PARTITION_COMPRESSION=OFF
FLOWX_DATA_PARTITIONING_MOVED_DATA_BATCH_SIZE=5000
Impact assessment:This change only affects deployments that have:
  • Enabled data partitioning (FLOWX_DATA_PARTITIONING_ENABLED=true)
  • Configured archiving settings
If partitioning is disabled, you should still update your configuration files for future compatibility, but there is no immediate operational impact.

Complete migration guide

See the Deployment Guidelines for complete configuration examples, step-by-step migration instructions, and troubleshooting guidance.