-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
hi,
s2 is now replicating again. assuming there are no more problems, it should
be up-to-date within 24 hours.
- river.
-----BEGIN PGP SIGNATURE-----
iEYEARECAAYFAkkB94UACgkQIXd7fCuc5vI2yACbBhkiHq10QX8fmxOLu3JPbF9L
OrMAoKcUPxL53CrdXTxt+hXwDQgDKIUD
=yk6g
-----END PGP SIGNATURE-----
Hello all,
for an more or less unknow reason nightshade had have problems with the nfs
tonight. The only sollution that I found was a (hard) reboot. I doubt that
all user-scripts started automaticaly at reboot so please check.
The other roots and I will investigate that further in a few hours after my
sleep.
Good night everybody,
DaB.
--
Diese eMail sollte mit dem PGP-Schlüssel 0x2D3EE2D42B255885 digital signiert
sein. Bitte beachten Sie, das unsignierte eMails beliebig gefälscht sein
können. Achten Sie daher auf Signaturen.
--
wp-blog.de
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
hi,
this morning a power failure at Wikimedia's Amsterdam hosting facility (SARA)
affected the login server, preventing user logins. the web server was
unaffected.
total downtime was around one hour.
- river.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (SunOS)
iEYEARECAAYFAkj0d0sACgkQIXd7fCuc5vKmjwCdHRXxOblTrxQzYIA2I4juXy7x
XpcAoI2G0dhlZXDBxJgXd7q7PzumD0EQ
=K9bg
-----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
hi,
due to problems at Wikimedia, the s2-master server's binlogs were corrupted.
this means replication on s2 is now halted.
re-starting replication will require dumping the cluster and re-importing it on
zedler. this means it will be at least a few days before replication is
re-started.
- river.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (SunOS)
iEYEARECAAYFAkjycEQACgkQIXd7fCuc5vLrIACgudyDLP5JCGccoX+NDjolBWNN
1VMAnA4h0E63avQYyFaJ6zw0e5eUihNE
=+el1
-----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
hi,
today we experienced a 6-second power failure at SARA, the colocation facility
where the toolserver is hosted. this affected both us and Wikimedia (who
provide our hosting there).
this affected all servers except willow (stable), which was connected to a
different circuit and remained up. while hemlock also didn't lose power, its
NFS server (zedler) and LDAP server (nightshade) were both down.
as no administrator was immediately available, and the platform did not restart
graciously, total downtime was around 5 hours.
i will investigate the problems preventing an automatic recovery after restart,
to reduce the downtime if this should happen again.
this downtime does not affect the maintenance currently scheduled for Monday.
- river.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (SunOS)
iEYEARECAAYFAkjnzMkACgkQIXd7fCuc5vLDbwCdHVVWqxZGrLZSQ6VmLQiUU99P
frwAoI1/wQYiTniuO0HqMtv5i97Im/SG
=O3Eh
-----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
hi,
with the maintenance on Monday, the old stable server (stable.ts.wikimedia.org)
will be shut down. old URLs will turn into redirects to the new server.
files still present on old stable will be kept, but if you have files there you
want to keep, you should copy them across before the shutdown, to reduce load
on the administrators.
- river.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (SunOS)
iEYEARECAAYFAkji4r8ACgkQIXd7fCuc5vLgeACcD1erIxQnfl/CD2A+eR61WuSG
JP4AoI8wXh0KhIyfs8o1wYSU6TMJbixn
=cuai
-----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
hi,
maintenance will be done on the above servers on Monday, 6th October between
5-7AM UTC. each server will be unavailable for the duration of the
maintenance, which should be less than one hour in total.
- river.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (SunOS)
iEYEARECAAYFAkji4BMACgkQIXd7fCuc5vJiqACeLlLm0+MQ2xs5jvVt1I0u3CS/
TfIAn1bQol7tcDyRZOnNvYt3SflFr4wU
=oN6Z
-----END PGP SIGNATURE-----