May 2021 - Cloud-admin-feed - lists.wikimedia.org

** RECOVERY alert - checker.tools.wmflabs.org/toolschecker: All k8s etcd nodes are healthy is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: toolschecker: All k8s etcd nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: OK Date/Time: Wed May 26 02:48:06 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 158 bytes in 0.302 second response time

2 years, 12 months

1
0
0 0

** PROBLEM alert - labstore1007/Device not healthy -SMART- is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: Device not healthy -SMART- Host: labstore1007 Address: 208.80.155.106 State: CRITICAL Date/Time: Wed May 26 02:47:54 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/SMART%23Alerts https://grafana.wikimedia.org/dashboard/db/host-overview?var-server=labstor… Acknowledged by : Additional Info: cluster=wmcs device=1I:1:5 instance=labstore1007 job=node site=eqiad

2 years, 12 months

1
0
0 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: All k8s etcd nodes are healthy is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: toolschecker: All k8s etcd nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Wed May 26 02:42:24 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/etcd/k8s - 177 bytes in 1.474 second response time

2 years, 12 months

1
0
0 0

RECOVERY Host cloudvirt1040.mgmt - PING OK - Packet loss = 0%, RTA = 12.04 ms

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Host: cloudvirt1040.mgmt State: UP Address: 10.65.0.227 Info: PING OK - Packet loss = 0%, RTA = 12.04 ms Date/Time: Tue May 25 22:06:47 UTC 2021 Acknowledged by :

2 years, 12 months

1
0
0 0

ACKNOWLEDGEMENT Host cloudvirt1040.mgmt - PING CRITICAL - Packet loss = 100%

by nagios＠alert1001.wikimedia.org

Notification Type: ACKNOWLEDGEMENT Host: cloudvirt1040.mgmt State: DOWN Address: 10.65.0.227 Info: PING CRITICAL - Packet loss = 100% Date/Time: Tue May 25 21:39:19 UTC 2021 Acknowledged by andrew bogott: this host is cursed and will be under repair forever

2 years, 12 months

1
0
0 0

PROBLEM Host cloudvirt1040.mgmt - PING CRITICAL - Packet loss = 100%

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Host: cloudvirt1040.mgmt State: DOWN Address: 10.65.0.227 Info: PING CRITICAL - Packet loss = 100% Date/Time: Tue May 25 21:38:15 UTC 2021 Acknowledged by :

2 years, 12 months

1
0
0 0

RECOVERY Host labstore1007.mgmt - PING WARNING - Packet loss = 77%, RTA = 1.63 ms

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Host: labstore1007.mgmt State: UP Address: 10.65.3.122 Info: PING WARNING - Packet loss = 77%, RTA = 1.63 ms Date/Time: Tue May 25 21:07:11 UTC 2021 Acknowledged by :

3 years

1
0
0 0

PROBLEM Host labstore1007.mgmt - PING CRITICAL - Packet loss = 100%

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Host: labstore1007.mgmt State: DOWN Address: 10.65.3.122 Info: PING CRITICAL - Packet loss = 100% Date/Time: Tue May 25 20:49:27 UTC 2021 Acknowledged by :

3 years

1
0
0 0

** PROBLEM alert - checker.tools.wmflabs.org/toolschecker: All k8s worker nodes are healthy is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: toolschecker: All k8s worker nodes are healthy Host: checker.tools.wmflabs.org Address: checker.tools.wmflabs.org State: CRITICAL Date/Time: Tue May 25 13:52:03 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolschecker Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 503 SERVICE UNAVAILABLE - string OK not found on http://checker.tools.wmflabs.org:80/k8s/nodes/ready - 177 bytes in 0.078 second response time

3 years

1
0
0 0

** RECOVERY alert - labstore1007/HTTP is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: HTTP Host: labstore1007 Address: 208.80.155.106 State: OK Date/Time: Mon May 24 06:21:07 UTC 2021 Notes URLs: https://wikitech.wikimedia.org/wiki/Dumps/XML-SQL_Dumps%23A_labstore_host_d… Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 301 Moved Permanently - 383 bytes in 0.001 second response time

3 years

1
0
0 0

2024

2023

2022

2021

2020

2019

2018

Cloud-admin-feed May 2021