- Discovery-alerts - lists.wikimedia.org

[FIRING:1] ProbeDown search-platform (2620:0:861:10a:10:64:131:25 ip6 wdqs1018:443 probes/custom http_wdqs_external_sparql_endpoint_search_ip6 ops info eqiad prometheus)

by sre-observability＠wikimedia.org

5 days, 6 hours

1
0
0 0

[airflow] SLA miss on DAG=image_suggestions_weekly

by search

5 days, 6 hours

1
0
0 0

** PROBLEM alert - alert1001/MediaWiki CirrusSearch update rate - codfw is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: MediaWiki CirrusSearch update rate - codfw Host: alert1001 Address: 208.80.154.88 State: CRITICAL Date/Time: Sat May 11 00:01:47 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23No_updates https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44… Acknowledged by : Additional Info: CRITICAL: 100.00% of data under the critical threshold [50.0]

6 days, 6 hours

1
0
0 0

[FIRING:2] ProbeDown search-platform (wdqs1021:443 probes/custom ops info eqiad prometheus)

by sre-observability＠wikimedia.org

6 days, 13 hours

1
0
0 0

[FIRING:1] ProbeDown search-platform (10.64.131.25 ip4 wdqs1018:443 probes/custom http_wdqs_external_sparql_endpoint_search_ip4 ops info eqiad prometheus)

by sre-observability＠wikimedia.org

6 days, 15 hours

1
0
0 0

[FIRING:1] ProbeDown search-platform (2620:0:861:103:10:64:32:105 ip6 wdqs1013:443 probes/custom http_wdqs_external_sparql_endpoint_search_ip6 ops info eqiad prometheus)

by sre-observability＠wikimedia.org

6 days, 16 hours

1
0
0 0

** RECOVERY alert - graphite1005/CirrusSearch more_like eqiad 95th percentile latency is OK **

by nagios＠alert1001.wikimedia.org

Notification Type: RECOVERY Service: CirrusSearch more_like eqiad 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: OK Date/Time: Fri May 10 07:05:25 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: OK: Less than 20.00% above the threshold [1000.0]

6 days, 23 hours

1
0
0 0

** PROBLEM alert - graphite1005/CirrusSearch more_like eqiad 95th percentile latency is CRITICAL **

by nagios＠alert1001.wikimedia.org

Notification Type: PROBLEM Service: CirrusSearch more_like eqiad 95th percentile latency Host: graphite1005 Address: 10.64.16.81 State: CRITICAL Date/Time: Fri May 10 07:00:27 UTC 2024 Notes URLs: https://wikitech.wikimedia.org/wiki/Search%23Health/Activity_Monitoring https://grafana.wikimedia.org/d/000000455/elasticsearch-percentiles?orgId=1… Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [1500.0]

6 days, 23 hours

1
0
0 0

[FIRING:1] PuppetFailure wdqs-test search-platform (wdqs2023:9100 node ops critical codfw prometheus)

by sre-observability＠wikimedia.org

1 week

1
0
0 0

[FIRING:1] CirrusStreamingUpdaterFlinkJobUnstable search-platform (cirrus_streaming_updater_consumer_cloudelastic_eqiad cirrus-streaming-updater k8s consumer-cloudelastic critical eqiad prometheus)

by sre-observability＠wikimedia.org

1 week

1
0
0 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

Discovery-alerts