[Engineering] Analytics Hadoop cluster maintenance postponed - Tue 13th February

Tue Feb 13 11:49:11 UTC 2018

Hi everybody,

the Analytics Hadoop upgrade to Java 8 has been postponed due to unexpected
hw failures (https://phabricator.wikimedia.org/T187164 and
https://phabricator.wikimedia.org/T187162) happened this morning and
causing some HDFS blocks to be under replicated/corrupted. To be on the
safe side, we'll wait for the cluster's metrics to fully recover before
doing anything. I will update this email thread as soon as we'll be ready,
but it this might happen in EU late evening / SF morning.

Sorry for the delay! The Analytics Hadoop cluster staged a rebellion for
Java 8, but we'll eventually succeed :)

Luca

2018-02-05 19:48 GMT+01:00 Joseph Allemandou <jallemandou at wikimedia.org>:

> Hi Analytics folks,
>
> *TL;DR: Hadoop cluster maintenance postponed to Tue 13th February*
>
> We've experienced an issue in getting some data onto the cluster this
> month, making some of our monthly datasets (the ones that depend on that
> late data) not yet computed.
> We have decided to postpone the maintenance of the cluster to next week,
> allowing for those jobs to be finished.
> We are very sorry about the short notice and will send another email the
> day before maintenance.
> Best
>
> Joseph Allemandou on behalf of the Analytics-Team
> Data Engineer @ Wikimedia Foundation
> IRC: joal
>
> _______________________________________________
> Engineering mailing list
> Engineering at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/engineering
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/engineering/attachments/20180213/fd46efe2/attachment.html>