January 2020 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - labstore1007/High 1m load average is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Sun Jan 26 15:01:07 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

4 years, 3 months

1
0
0 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Sun Jan 26 14:38:43 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

4 years, 3 months

1
0
0 0

** PROBLEM alert - labstore1007/High 1m load average is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: PROBLEM Service: High 1m load average Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Sun Jan 26 13:38:51 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=wmcs instance=labstore1007:9100 job=node site=eqiad

4 years, 3 months

1
0
0 0

** ACKNOWLEDGEMENT alert - cloudvirt1024/MegaRAID is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: ACKNOWLEDGEMENT Service: MegaRAID Host: cloudvirt1024 Address: 10.64.20.43 State: CRITICAL Date/Time: Fri Jan 24 15:31:07 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring Acknowledged by nagiosadmin: RAID handler auto-ack: https://phabricator.wikimedia.org/T243605 Additional Info: CRITICAL: 1 failed LD(s) (Degraded)

4 years, 3 months

1
0
0 0

** ACKNOWLEDGEMENT alert - cloudvirt1024/MegaRAID is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: ACKNOWLEDGEMENT Service: MegaRAID Host: cloudvirt1024 Address: 10.64.20.43 State: CRITICAL Date/Time: Thu Jan 23 21:53:56 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring Acknowledged by nagiosadmin: RAID handler auto-ack: https://phabricator.wikimedia.org/T243555 Additional Info: CRITICAL: 1 failed LD(s) (Degraded)

4 years, 3 months

1
0
0 0

** RECOVERY alert - labstore1004/High 1m load average is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: High 1m load average Host: labstore1004 Address: 10.64.37.19 State: OK Date/Time: Thu Jan 23 19:49:42 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: All metrics within thresholds.

4 years, 3 months

1
0
0 0

** PROBLEM alert - labstore1004/High 1m load average is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: PROBLEM Service: High 1m load average Host: labstore1004 Address: 10.64.37.19 State: CRITICAL Date/Time: Thu Jan 23 19:33:22 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Labstore https://grafana.wikimedia.org/dashboard/db/labs-monitoring Acknowledged by : Additional Info: cluster=labsnfs instance=labstore1004:9100 job=node site=eqiad

4 years, 3 months

1
0
0 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: check mtime mod from tools cron job is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: toolschecker: check mtime mod from tools cron job Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Thu Jan 23 18:07:41 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.015 second response time

4 years, 3 months

1
0
0 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: check mtime mod from tools cron job is CRITICAL **

by nagios＠icinga1001.wikimedia.org

Notification Type: PROBLEM Service: toolschecker: check mtime mod from tools cron job Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Thu Jan 23 18:00:21 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/cron - 177 bytes in 0.010 second response time

4 years, 3 months

1
0
0 0

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is OK **

by nagios＠icinga1001.wikimedia.org

Notification Type: RECOVERY Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Thu Jan 23 17:06:30 UTC 2020 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.195 second response time

4 years, 3 months

1
0
0 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed January 2020