Large File Annex Replication

Overview

Duplication of Rubin LFA S3 data to USDF. Rubin Observatory keeps various non-image data in an S3 datastore called the Large File Annex (LFA). It is necessary to replicate the contents of this datastore at the USDF for read-only access to aid Operator analysis.

The application essentially runs an instance of mc that uses the mirror subcommand to connect to both the S3 storage that is part of the telescope systems in Chile and the storage at SLAC.

Service Grouping	Data Curation
Operating Hours	24x7 (some instrumentation may be used during daytime calibration)
Service Tier	Operational
GitHub Application Code Repository	slaclab/rubin-lfa-replicate-deploy
GitHub Deployment Repository	slaclab/rubin-lfa-replicate-deploy
Slack Support Channel
Slack Alerts Channel
Prod vCluster	usdf-lfa
Dev vCluster	N/A

• Application Information
  • Architecture
  • Architecture Diagram
  • Associated Systems
  • Configuration Location
  • Data Flow
  • Dependencies - S3DF
  • Dependencies - External
  • Disaster Recovery
• Documentation and Training
• Security
  • Requesting Access
  • Service accounts
  • Security Incident Response
  • Security Policies
• Procedures
  • Deployment
  • Maintenance
  • Backup
  • Cold Startup
  • Cold Shutdown
  • Reproduce Service
• Troubleshooting
  • Known Issues
  • Monitoring
  • Sample Troubleshooting