[Labs-l] Currently having a glusterfs outage

Wed Jan 30 07:54:25 UTC 2013

All volumes are now up and should be working properly. If you have any
issues with home directories, project storage, or login issues, let me know.

On Tue, Jan 29, 2013 at 7:29 PM, Ryan Lane <rlane at wikimedia.org> wrote:

> An update:
>
> This is still ongoing. Most projects are back up and functional, but
> there's still a few that need to be brought back online. Gluster is running
> self-heals on all of the volumes, so gluster may be slower than normal
> tonight.
>
>
> On Tue, Jan 29, 2013 at 2:03 PM, Ryan Lane <rlane at wikimedia.org> wrote:
>
>> Logins and project storage are having an outage now. I pushed a point
>> upgrade, which unfortunately gluster didn't handle well. The processes
>> aren't connecting to each other, so the entire cluster is down. I'm working
>> on fixing it now.
>>
>> - Ryan
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/labs-l/attachments/20130129/0654dfd9/attachment-0001.html>