Application Information¶
Architecture¶
OpenSearch is installed on Kubernetes in a high availability configuration with 3 master, 3 workers, and 1 dashboard instance. Rucio, PanDA, and HTCondor are all configured to send metrics to the OpenSearch API with Python code in each respective application. The SLAC Grafana is used to display the dashboards with OpenSearch configured as a Grafana data source. OpenSearch dashboards are installed, but not currently supported for production use.
Dashboards are for end users in Panda and HTCondor. Dashboards for Rucio are used with Campaign Management to view data between different sites.
Architecture Diagram¶
Associated Systems¶
Rucio, PanDA, and HTCondor all send metrics to OpenSearch. OpenSearch is integrated with the the S3DF Grafana.
Configuration Location¶
Config Area |
Location |
|---|---|
Configuration |
|
Vault Secrets Dev |
Not applicable. No dev environment |
Vault Secrets Prod |
secret/rubin/usdf-opensearch/opensearch |
Data Flow¶
Rucio, PanDA, and HTCondor use Python code to send metrics to the OpenSearch API. No OpenSearch agents are currently used.
Dependencies - S3DF¶
Kubernetes
S3DF Grafana
Dependencies - External¶
No external dependencies.