Deployment best practices Checklist

Daily Tasks:

• Monitor the status of the environment and ensure every single service is running (https://<domain_monitoring>/monitoring
• Monitoring the resources of environments https://central-dashboard.digit.org/d/gzIcCaiVz/kubernetes-cluster-ram-and-cpu-utilization
• Monitoring alerts-overview dashboard and taking appropriate action on critical and warning alerts https://central-dashboard.digit.org/d/smo98XK4z/alerts-overview?orgId=1&refresh=30s
• Keep track of all tasks by creating tickets
• In the Slack channel, watch the Prometheus Alters
• Monitor the Kafka consumer group lags https://<domain_name>/monitoring/d/N9uZBy8Wz/1-kubernetes-cluster-overview-kubrnettes?viewPanel=137&orgId=1and
• In case of Kafka-related issues, troubleshoot them https://core.digit.org/guides/operations-guide/kafka-troubleshooting-guide

Weekly Tasks:

• Monitoring the resources of environments https://central-dashboard.digit.org/d/gzIcCaiVz/kubernetes-cluster-ram-and-cpu-utilization
• Monitoring alerts-overview dashboard and taking appropriate action on critical and working alerts https://central-dashboard.digit.org/d/smo98XK4z/alerts-overview?orgId=1&refresh=30s
• Monitor the Kubecost Dashboard https://central-dashboard.digit.org/d/JOUdHGZZz/kubecost-dashboard-for-grafana-cloud?orgId=1
• Cleanup logs
• Backup logs
• Weekly DB dump in case of SDC
• ES Data backup
• Publish Weekly Summary report/Come up with the format
• Publish the JIRA board status

Monthly Tasks: