FlowX CMS setup

​

Infrastructure prerequisites

The CMS service requires the following components to be set up before it can be started:

• Docker engine - version 17.06 or higher
• MongoDB - version 4.4 or higher for storing taxonomies and contents
• Redis - version 6.0 or higher
• Kafka - version 2.8 or higher
• Elastisearch - version 7.11.0 or higher

​

Dependencies

• DB instance
• Authorization & access roles
• Redis
• Kafka

​

Configuration

​

MongoDB database

A basic MongoDB configuration for the CMS service can be set up using a helm values.yaml file as follows:

cms-mdb:
    existingSecret: {{secretName}}
    mongodbDatabase: {{CmsDatabaseName}}
    mongodbUsername: {{CmsDatabaseUser}}
    persistence:
      enabled: true
      mountPath: /bitnami/mongodb
      size: 4Gi
    replicaSet:
      enabled: true
      name: rs0
      pdb:
        enabled: true
        minAvailable:
          arbiter: 1
          secondary: 1
      replicas:
        arbiter: 1
        secondary: 1
      useHostnames: true
    serviceAccount:
      create: false
    usePassword: true

​

Configuration

​

Configuring authorization & access roles

To connect to the identity management platform, the following variables need to be set:

• SECURITY_OAUTH2_BASE_SERVER_URL - the base URL for the OAuth 2.0 Authorization Server, which is responsible for authentication and authorization for clients and users, it is used to authorize clients, as well as to issue and validate access tokens
• SECURITY_OAUTH2_CLIENT_CLIENT_ID - a unique identifier for a client application that is registered with the OAuth 2.0 Authorization Server, this is used to authenticate the client application when it attempts to access resources on behalf of a user
• SECURITY_OAUTH2_CLIENT_CLIENT_SECRET - secret key that is used to authenticate requests made by an authorization client
• SECURITY_OAUTH2_REALM - security configuration env var in the Spring Security OAuth2 framework, it is used to specify the realm name used when authenticating with OAuth2 provider

​

Configuring MongoDB

The MongoDB database is used for storing taxonomies and contents. The following configurations need to be set using environment variables:

• SPRING_DATA_MONGODB_URI - environment variable used to provide the connection string for a MongoDB database that is used with, this connection string provides the host, port, database name, user credentials, and other configuration details for the MongoDB server

​

Configuring Redis

The following values should be set with the corresponding Redis-related values:

• SPRING_REDIS_HOST - environment variable used to configure the hostname or IP address of a Redis server when using Spring Data Redis
• SPRING_REDIS_PASSWORD - environment variable is used to store the password used to authenticate with a Redis server, it is used to secure access to the Redis server and should be kept confidential
• REDIS_TTL - environment variable is used to specify the maximum time-to-live (TTL) for a key in Redis, it is used to set a limit on how long a key can exist before it is automatically expired (Redis will delete the key after the specified TTL has expired)

All the data produced by the service will be stored in Redis under a specific key. The name of the key can be configured using the environment variable:

​

Configuring Kafka

To configure the Kafka server, you need to set the following environment variables:

• SPRING_KAFKA_BOOTSTRAP_SERVERS - address of the Kafka server, it should be in the format “host:port”
• SPRING_KAFKA_CONSUMER_GROUP_ID - a group of consumers
• KAFKA_CONSUMER_THREADS - the number of Kafka consumer threads
• KAFKA_AUTH_EXCEPTION_RETRY_INTERVAL - the interval between retries after AuthorizationException is thrown by KafkaConsumer
• KAFKA_TOPIC_AUDIT_OUT - the topic key for receiving audit logs

​

Request content

• KAFKA_TOPIC_REQUEST_CONTENT_IN: This variable defines the topic used by the CMS to listen for incoming content retrieval requests.
• KAFKA_TOPIC_REQUEST_CONTENT_OUT: This variable defines the topic where the CMS sends the results of content retrieval requests back to the FlowX Engine.

Each action available in the service corresponds to a Kafka event. A separate Kafka topic must be configured for each use case.

​

Configuring logging

To control the log levels, the following environment variables can be set:

• LOGGING_LEVEL_ROOT - the log level for the root spring boot microservice logs
• LOGGING_LEVEL_APP - the log level for app-level logs
• LOGGING_LEVEL_MONGO_DRIVER - the log level for mongo driver

​

Configuring file storage

• APPLICATION_FILE_STORAGE_S3_SERVER_URL - environment variable used to store the URL of the S3 server that is used to store files for the application.
• APPLICATION_FILE_STORAGE_S3_BUCKET_NAME - environment variable used to store the name of the S3 bucket that is used to store files for the application
• APPLICATION_FILE_STORAGE_S3_ROOT_DIRECTORY - environment variable used to store the root directory within the S3 bucket where the files for the application are stored
• APPLICATION_FILE_STORAGE_S3_CREATE_BUCKET - environment variable used to indicate whether the S3 bucket should be created if it does not already exist, it can be set to true or false
• APPLICATION_FILE_STORAGE_S3_PUBLIC_URL - the public URL of the S3 solution, it specifies the URL that can be used to access the files stored

​

Configuring the maximum file size for uploads

To set the maximum file size for uploads through the CMS service (e.g., the Media Library), you can adjust the following environment variables:

• SPRING_SERVLET_MULTIPART_MAX_FILE_SIZE: ${MULTIPART_MAX_FILE_SIZE:50MB}: Defines the maximum file size allowed for uploads. Default is 50 MB.
• SPRING_SERVLET_MULTIPART_MAX_REQUEST_SIZE: ${MULTIPART_MAX_REQUEST_SIZE:50MB}: Defines the maximum request size allowed for uploads. Default is 50 MB.

​

Configuring application management

The FlowX helm chart provides a management service with the necessary parameters to integrate with the Prometheus operator. However, this integration is disabled by default.

​

Prometheus metrics export configuration

To configure Prometheus metrics export for the FlowX.AI Engine, the following environment variable is required: