Application Information¶
Architecture¶
Postgres via CloudNativePG
Kafka via Strimzi
A Postgres database is deployed in the rucio-db-prod and rucio-db-dev namespaces.
The rucio-kafka Kafka Cluster is deployed in the Rucio vClusters. The Rucio-Butler integration uses this to ingest files into Butler. Kafka MirrorMaker is deployed at the UK and France Data Facilities to synchronize Kafka messages and ingest files locally in each Data Facility into Butler. To allow this connectivity rucio-kafka is configured with external IP Addresses on the external bootstrap and brokers.
Architecture Diagram¶
Associated Systems¶
FTS3
Cloud Native PG: Postgres Operator
Strimzi: Kafka Operator
Configuration Location¶
Config Area |
Location |
|---|---|
Configuration |
|
Vault Secrets Dev |
|
Vault Secrets Prod |
|
Data Flow¶
Dependencies - S3DF¶
Weka Storage
USDF FTS3
Dependencies - External¶
RAL FTS3