Data Transfer Monitoring

Overview

Data Transfer Monitoring is an application deployed in the usdf-embargo-dmz vCluster and Grafana Dashboard that monitors file transfer timing from the Summit to the USDF.

The dashboard for USDF staff is here

The simplified dashboard for Summit is here

Service Grouping	Monitoring and Telemetry
Operating Hours	24x7
Service Tier	Operational
GitHub Application Code Repository	lsst-dm/data_transfer_monitoring
GitHub Deployment Repository	lsst-dm/data_transfer_monitoring
Slack Support Channel	usdf-support
Slack Alerts Channel
Prod vCluster	usdf-embargo-dmz
Dev vCluster	N/A

• Service Information
  • Architecture
  • Architecture Diagram
  • Associated Systems
  • Configuration Location
  • Data Flow
  • Dependencies - S3DF
  • Dependencies - External
  • Disaster Recovery
• Documentation and Training
• Security
  • Requesting Access
  • Service accounts
  • Security Incident Response
  • Security Policies
• Procedures
  • Deployment
  • Maintenance
  • Backup
  • Cold Startup
  • Cold Shutdown
  • Reproduce Service
  • Calculate File Counts
  • Review End Readout and File Transfer Logs
  • Using Data Transfer Monitoring Metrics in Queries and Dashboards
  • Enable Debug Logs
  • Changing Late File Time Parameter
• Troubleshooting
  • Known Issues
  • Monitoring
  • Metrics not Displaying